2024-03-04T08:38:16.949 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T08:38:16.950 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} --name leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807 --owner scheduled_leonidus@teuthology --verbose -- /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/orig.config.yaml 2024-03-04T08:38:16.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T08:38:17.076 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807 branch: wip-lusov-qdb description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} email: null first_in_suite: false job_id: '7580807' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5072 sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd sleep_before_teardown: 0 subset: 246/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9kqw+BqHyBfGE5GCu2rKbuEMZ1KM54owRrtfc5JSlQM9QddMpIXoWd/C3QeoRQaGDSKHW5GAlSdQ/yvKuVnSs= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUmglADe64NXOnrbc/6ULgz/f9+cAf/t3i3c7DUc0onDNLvv5/djyvNx+j/UOisJmmVoK+oplvQR6lhLZOYvPE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_07:05:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-04T08:38:17.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa; will attempt to use it 2024-03-04T08:38:17.077 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks 2024-03-04T08:38:17.077 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T08:38:17.078 INFO:teuthology.task.internal:Checking packages... 2024-03-04T08:38:17.106 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd' 2024-03-04T08:38:17.106 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T08:38:17.106 INFO:teuthology.packaging:ref: None 2024-03-04T08:38:17.106 INFO:teuthology.packaging:tag: None 2024-03-04T08:38:17.107 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-03-04T08:38:17.107 INFO:teuthology.packaging:sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:38:17.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-03-04T08:38:17.475 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1739.g1bc250c7 2024-03-04T08:38:17.477 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T08:38:17.484 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T08:38:17.484 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T08:38:17.515 INFO:teuthology.task.internal:Saving configuration 2024-03-04T08:38:17.531 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T08:38:17.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T08:38:17.562 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:32:58.887987', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9kqw+BqHyBfGE5GCu2rKbuEMZ1KM54owRrtfc5JSlQM9QddMpIXoWd/C3QeoRQaGDSKHW5GAlSdQ/yvKuVnSs='} 2024-03-04T08:38:17.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:32:58.889885', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUmglADe64NXOnrbc/6ULgz/f9+cAf/t3i3c7DUc0onDNLvv5/djyvNx+j/UOisJmmVoK+oplvQR6lhLZOYvPE='} 2024-03-04T08:38:17.587 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T08:38:17.594 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-04T08:38:17.594 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-04T08:38:17.594 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T08:38:17.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa04db2f70>, signals=[15]) 2024-03-04T08:38:17.678 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T08:38:17.685 INFO:teuthology.task.internal:Opening connections... 2024-03-04T08:38:17.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:38:17.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:38:17.798 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:38:17.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:38:17.888 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T08:38:17.895 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-03-04T08:38:17.912 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-03-04T08:38:17.912 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:38:17.970 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:38:17.971 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:38:17.971 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:38:17.971 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-04T08:38:17.992 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-03-04T08:38:18.009 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-03-04T08:38:18.010 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:38:18.065 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:38:18.066 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:38:18.066 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-03-04T08:38:18.083 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T08:38:18.092 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T08:38:18.106 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T08:38:18.106 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:38:18.109 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:38:18.125 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T08:38:18.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T08:38:18.131 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:38:18.168 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:38:18.204 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T08:38:18.263 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T08:38:18.278 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-04T08:38:18.278 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-04T08:38:18.278 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:38:18.279 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:38:18.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:38:18.295 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-04T08:38:18.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:38:18.296 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-04T08:38:18.349 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:38:18.350 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-361.el9.x86_64 2024-03-04T08:38:18.350 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2024-03-04T08:38:18.354 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:38:18.354 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-361.el9.x86_64 2024-03-04T08:38:18.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-03-04T08:38:20.495 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-04T08:38:20.654 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 9.9 MB/s | 6.7 MB 00:00 2024-03-04T08:38:21.937 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-04T08:38:22.096 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-04T08:38:22.953 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-04T08:38:27.186 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.0 MB 00:04 2024-03-04T08:38:29.096 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-04T08:38:32.997 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.1 MB 00:00 2024-03-04T08:38:34.306 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 15 kB 00:00 2024-03-04T08:38:36.382 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2024-03-04T08:38:41.449 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 8.1 kB/s | 1.7 kB 00:00 2024-03-04T08:38:43.747 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T08:38:43.748 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T08:38:43.836 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-03-04T08:38:43.845 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-03-04T08:38:43.846 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:38:43.847 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 100 M 2024-03-04T08:38:43.847 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 123 M 2024-03-04T08:38:43.847 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-03-04T08:38:44.284 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 19 MB/s | 6.0 MB 00:00 2024-03-04T08:38:44.684 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 29 MB/s | 21 MB 00:00 2024-03-04T08:38:45.367 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 28 MB/s | 39 MB 00:01 2024-03-04T08:38:45.368 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 923 kB/s | 19 MB 00:21 2024-03-04T08:38:45.934 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 20 MB/s | 33 MB 00:01 2024-03-04T08:38:45.935 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:38:45.935 INFO:teuthology.orchestra.run.smithi204.stdout:Total 48 MB/s | 100 MB 00:02 2024-03-04T08:38:46.825 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-03-04T08:38:47.195 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-03-04T08:38:47.195 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-03-04T08:38:48.849 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-03-04T08:38:48.850 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-03-04T08:38:50.577 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.1 MB 00:01 2024-03-04T08:38:51.778 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-03-04T08:38:52.103 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2024-03-04T08:38:52.448 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:38:52.586 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:38:54.579 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 20 MB 00:02 2024-03-04T08:38:55.378 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:38:55.572 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:38:59.629 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-04T08:39:00.278 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:39:00.410 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:01.944 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T08:39:01.945 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T08:39:02.054 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-04T08:39:02.069 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-03-04T08:39:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:02.071 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 100 M 2024-03-04T08:39:02.071 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 123 M 2024-03-04T08:39:02.071 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-04T08:39:02.439 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 24 MB/s | 6.0 MB 00:00 2024-03-04T08:39:02.889 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 30 MB/s | 21 MB 00:00 2024-03-04T08:39:03.681 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 27 MB/s | 33 MB 00:01 2024-03-04T08:39:04.223 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 19 MB/s | 39 MB 00:02 2024-03-04T08:39:04.223 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:39:04.223 INFO:teuthology.orchestra.run.smithi019.stdout:Total 46 MB/s | 100 MB 00:02 2024-03-04T08:39:05.146 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-04T08:39:05.148 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:05.591 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-04T08:39:05.591 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-04T08:39:06.990 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-04T08:39:06.991 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-04T08:39:09.869 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-04T08:39:10.549 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:39:10.683 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:39:13.616 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:39:13.792 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:39:18.923 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:39:19.038 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:24.191 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:34.383 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:34.383 INFO:teuthology.orchestra.run.smithi204.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:39:34.383 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:39:34.469 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:34.883 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:34.883 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:39:34.883 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:39:34.883 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:39:35.309 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-03-04T08:39:35.835 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:39:36.019 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:36.020 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:39:36.020 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T08:39:36.020 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T08:39:36.020 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T08:39:36.020 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-04T08:39:36.020 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T08:39:36.020 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:39:36.142 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:36.142 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:39:36.142 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 68.el9 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8264254 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:39:36.177 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:39:36.178 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:39:36.178 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:39:36.178 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-03-04T08:39:36.180 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:39:36.181 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:39:36.183 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:39:36.183 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-427.el9.x86_64 2024-03-04T08:39:36.183 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:39:36.787 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-03-04T08:39:38.181 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:39:38.221 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-03-04T08:39:38.223 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-04T08:39:38.239 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.HKlgDyi3Og 2024-03-04T08:39:38.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HKlgDyi3Og 2024-03-04T08:39:38.309 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.HKlgDyi3Og 2024-03-04T08:39:38.450 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.HKlgDyi3Og is 6KB 2024-03-04T08:39:38.498 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.HKlgDyi3Og 2024-03-04T08:39:38.513 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:39:38.578 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:39:38.578 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:39:38.579 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:39:38.579 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T08:39:38.580 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T08:39:38.724 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-03-04T08:39:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:55.002 INFO:teuthology.orchestra.run.smithi019.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:39:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:55.554 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:55.554 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:39:55.554 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:39:55.554 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T08:39:55.979 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T08:39:55.980 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:55.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-04T08:39:56.501 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:39:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:56.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:39:56.656 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T08:39:56.656 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T08:39:56.656 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T08:39:56.656 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-04T08:39:56.656 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T08:39:56.656 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:39:56.783 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:39:56.783 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:39:56.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 68.el9 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-03-04T08:39:56.832 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8264254 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:39:56.833 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-03-04T08:39:56.834 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:39:56.834 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:39:56.834 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:39:56.835 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-427.el9.x86_64 2024-03-04T08:39:56.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:39:57.495 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-03-04T08:39:58.883 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:39:58.922 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-03-04T08:39:58.926 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-03-04T08:39:58.941 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.HQSOTepfDJ 2024-03-04T08:39:58.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HQSOTepfDJ 2024-03-04T08:39:59.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.HQSOTepfDJ 2024-03-04T08:39:59.150 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.HQSOTepfDJ is 6KB 2024-03-04T08:39:59.198 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.HQSOTepfDJ 2024-03-04T08:39:59.213 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:39:59.282 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:39:59.282 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:39:59.282 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:39:59.282 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T08:39:59.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T08:39:59.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-03-04T08:40:08.736 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-04T08:40:08.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:40:08.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:40:29.460 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-04T08:40:29.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-04T08:40:29.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:40:43.328 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-04T08:40:52.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:40:52.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:41:29.501 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T08:41:38.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-04T08:41:38.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:41:38.964 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-04T08:41:39.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-04T08:41:39.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-04T08:41:39.355 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-04T08:41:39.369 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-427.el9.x86_64 2024-03-04T08:41:39.369 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T08:41:39.369 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:41:39.369 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:41:40.370 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-04T08:41:40.370 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T08:41:40.485 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-03-04T08:41:40.525 DEBUG:teuthology.parallel:result is None 2024-03-04T08:41:52.340 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T08:42:04.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:42:04.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:42:04.789 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-04T08:42:05.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:42:05.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-04T08:42:05.150 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-03-04T08:42:05.164 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-427.el9.x86_64 2024-03-04T08:42:05.165 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T08:42:05.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:42:05.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:42:06.165 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-04T08:42:06.166 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T08:42:06.236 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-03-04T08:42:06.272 DEBUG:teuthology.parallel:result is None 2024-03-04T08:42:06.273 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T08:42:06.283 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T08:42:06.283 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:42:06.286 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:42:06.304 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T08:42:06.318 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T08:42:06.352 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T08:42:06.352 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:42:06.355 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:42:06.387 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T08:42:06.394 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T08:42:06.394 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:42:06.424 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:42:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:42:06.459 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:42:06.471 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:42:06.473 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:42:06.475 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T08:42:06.482 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T08:42:06.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:42:06.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:42:06.547 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T08:42:06.557 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T08:42:06.557 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:42:06.587 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:42:06.603 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:42:06.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:42:06.736 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:42:06.820 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:42:06.863 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:42:06.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:42:06.933 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:42:06.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:42:07.028 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:42:07.111 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:42:07.156 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:42:07.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:42:07.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-03-04T08:42:07.228 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-03-04T08:42:07.272 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:42:07.310 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:42:07.822 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T08:42:07.830 INFO:teuthology.task.internal:Starting timer... 2024-03-04T08:42:07.830 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T08:42:07.856 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T08:42:07.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-03-04T08:42:07.950 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-03-04T08:42:07.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-03-04T08:42:08.008 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-03-04T08:42:08.009 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T08:42:08.010 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-03-04T08:42:08.040 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-03-04T08:42:08.040 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-03-04T08:42:08.063 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-03-04T08:42:08.063 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-03-04T08:42:08.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:42:08.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:42:08.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:42:08.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:42:08.140 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T08:42:08.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:42:08.183 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:42:08.223 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T08:42:08.232 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-04T08:42:08.238 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-04T08:42:08.383 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T08:42:08.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T08:42:08.402 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T08:46:22.811 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-03-04T08:46:22.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-04T08:46:22.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:46:22.910 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-04T08:46:22.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-04T08:46:22.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:46:22.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:46:23.075 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-04T08:46:23.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-04T08:46:23.155 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T08:46:23.242 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T08:46:23.243 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T08:46:23.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:46:23.246 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T08:46:23.246 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:46:23.276 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T08:46:23.277 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T08:46:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T08:46:23.294 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T08:46:23.323 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-03-04T08:46:23.323 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-03-04T08:46:23.336 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-03-04T08:46:23.337 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-03-04T08:46:23.353 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T08:46:23.354 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T08:46:23.369 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T08:46:23.370 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T08:46:23.420 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.423 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.427 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:46:23.428 INFO:teuthology.run_tasks:Running task install... 2024-03-04T08:46:23.437 DEBUG:teuthology.task.install:project ceph 2024-03-04T08:46:23.437 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}} 2024-03-04T08:46:23.437 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'} 2024-03-04T08:46:23.437 INFO:teuthology.task.install:Using flavor: default 2024-03-04T08:46:23.443 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-04T08:46:23.443 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-04T08:46:23.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T08:46:23.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:46:23.446 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T08:46:23.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:46:23.675 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T08:46:23.675 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T08:46:23.680 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T08:46:23.680 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T08:46:23.786 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T08:46:23.786 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:46:23.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T08:46:23.815 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T08:46:23.815 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T08:46:23.854 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T08:46:23.854 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:46:23.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T08:46:23.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T08:46:23.882 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T08:46:23.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T08:46:23.950 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T08:46:23.964 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T08:46:24.030 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T08:46:24.031 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-03-04T08:46:24.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-03-04T08:46:24.097 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-03-04T08:46:24.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-03-04T08:46:24.285 INFO:teuthology.orchestra.run.smithi019.stdout:74 files removed 2024-03-04T08:46:24.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T08:46:24.341 INFO:teuthology.orchestra.run.smithi204.stdout:74 files removed 2024-03-04T08:46:24.368 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T08:46:25.030 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 210 kB/s | 83 kB 00:00 2024-03-04T08:46:25.150 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 180 kB/s | 83 kB 00:00 2024-03-04T08:46:25.431 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 29 kB/s | 10 kB 00:00 2024-03-04T08:46:25.559 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 28 kB/s | 10 kB 00:00 2024-03-04T08:46:25.915 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-03-04T08:46:25.943 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-03-04T08:46:26.367 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-04T08:46:26.396 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-04T08:46:27.888 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-04T08:46:27.926 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-04T08:46:28.770 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-03-04T08:46:28.952 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-04T08:46:30.843 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-03-04T08:46:30.997 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-03-04T08:46:34.994 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-04T08:46:35.200 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.1 MB 00:00 2024-03-04T08:46:36.395 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 15 kB 00:00 2024-03-04T08:46:37.115 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2024-03-04T08:46:37.388 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2024-03-04T08:46:42.438 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-04T08:46:45.077 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:46:45.078 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:46:45.092 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T08:46:45.094 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T08:46:45.095 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T08:46:45.096 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T08:46:45.098 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T08:46:45.101 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T08:46:45.102 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T08:46:45.192 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-04T08:46:45.212 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-04T08:46:45.212 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-04T08:46:45.212 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-04T08:46:45.212 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T08:46:45.213 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T08:46:45.214 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-03-04T08:46:45.215 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T08:46:45.216 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T08:46:45.217 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T08:46:45.218 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T08:46:45.219 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T08:46:45.220 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T08:46:45.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T08:46:45.222 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T08:46:45.223 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T08:46:45.224 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T08:46:45.225 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout:Install 150 Packages 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 26 Packages 2024-03-04T08:46:45.226 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:46:45.227 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 224 M 2024-03-04T08:46:45.227 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-04T08:46:45.881 INFO:teuthology.orchestra.run.smithi019.stdout:(1/176): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-03-04T08:46:46.315 INFO:teuthology.orchestra.run.smithi019.stdout:(2/176): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 8.0 MB/s | 5.3 MB 00:00 2024-03-04T08:46:46.390 INFO:teuthology.orchestra.run.smithi019.stdout:(3/176): ceph-immutable-object-cache-19.0.0-173 1.9 MB/s | 145 kB 00:00 2024-03-04T08:46:46.649 INFO:teuthology.orchestra.run.smithi019.stdout:(4/176): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 8.9 MB/s | 2.3 MB 00:00 2024-03-04T08:46:46.874 INFO:teuthology.orchestra.run.smithi019.stdout:(5/176): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x86 6.6 MB/s | 1.5 MB 00:00 2024-03-04T08:46:46.907 INFO:teuthology.orchestra.run.smithi019.stdout:(6/176): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 866 kB/s | 888 kB 00:01 2024-03-04T08:46:47.157 INFO:teuthology.orchestra.run.smithi019.stdout:(7/176): ceph-common-19.0.0-1739.g1bc250c7.el9. 14 MB/s | 20 MB 00:01 2024-03-04T08:46:47.458 INFO:teuthology.orchestra.run.smithi019.stdout:(8/176): ceph-mon-19.0.0-1739.g1bc250c7.el9.x86 8.0 MB/s | 4.7 MB 00:00 2024-03-04T08:46:47.508 INFO:teuthology.orchestra.run.smithi019.stdout:(9/176): ceph-selinux-19.0.0-1739.g1bc250c7.el9 507 kB/s | 25 kB 00:00 2024-03-04T08:46:47.750 INFO:teuthology.orchestra.run.smithi019.stdout:(10/176): ceph-radosgw-19.0.0-1739.g1bc250c7.el 17 MB/s | 9.8 MB 00:00 2024-03-04T08:46:47.809 INFO:teuthology.orchestra.run.smithi019.stdout:(11/176): cephfs-mirror-19.0.0-1739.g1bc250c7.e 3.7 MB/s | 220 kB 00:00 2024-03-04T08:46:47.859 INFO:teuthology.orchestra.run.smithi019.stdout:(12/176): cephfs-shell-19.0.0-1739.g1bc250c7.el 543 kB/s | 27 kB 00:00 2024-03-04T08:46:47.909 INFO:teuthology.orchestra.run.smithi019.stdout:(13/176): libcephfs-devel-19.0.0-1739.g1bc250c7 626 kB/s | 31 kB 00:00 2024-03-04T08:46:48.001 INFO:teuthology.orchestra.run.smithi019.stdout:(14/176): libcephfs2-19.0.0-1739.g1bc250c7.el9. 8.0 MB/s | 747 kB 00:00 2024-03-04T08:46:48.077 INFO:teuthology.orchestra.run.smithi019.stdout:(15/176): libcephsqlite-19.0.0-1739.g1bc250c7.e 2.1 MB/s | 163 kB 00:00 2024-03-04T08:46:48.144 INFO:teuthology.orchestra.run.smithi019.stdout:(16/176): librados-devel-19.0.0-1739.g1bc250c7. 1.9 MB/s | 127 kB 00:00 2024-03-04T08:46:48.219 INFO:teuthology.orchestra.run.smithi019.stdout:(17/176): libradosstriper1-19.0.0-1739.g1bc250c 6.5 MB/s | 501 kB 00:00 2024-03-04T08:46:48.627 INFO:teuthology.orchestra.run.smithi019.stdout:(18/176): librgw2-19.0.0-1739.g1bc250c7.el9.x86 13 MB/s | 5.1 MB 00:00 2024-03-04T08:46:48.678 INFO:teuthology.orchestra.run.smithi019.stdout:(19/176): python3-ceph-argparse-19.0.0-1739.g1b 909 kB/s | 45 kB 00:00 2024-03-04T08:46:48.736 INFO:teuthology.orchestra.run.smithi019.stdout:(20/176): python3-ceph-common-19.0.0-1739.g1bc2 2.2 MB/s | 131 kB 00:00 2024-03-04T08:46:48.803 INFO:teuthology.orchestra.run.smithi019.stdout:(21/176): python3-cephfs-19.0.0-1739.g1bc250c7. 2.4 MB/s | 162 kB 00:00 2024-03-04T08:46:48.870 INFO:teuthology.orchestra.run.smithi019.stdout:(22/176): python3-rados-19.0.0-1739.g1bc250c7.e 4.7 MB/s | 321 kB 00:00 2024-03-04T08:46:48.954 INFO:teuthology.orchestra.run.smithi019.stdout:(23/176): python3-rbd-19.0.0-1739.g1bc250c7.el9 3.5 MB/s | 298 kB 00:00 2024-03-04T08:46:49.021 INFO:teuthology.orchestra.run.smithi019.stdout:(24/176): python3-rgw-19.0.0-1739.g1bc250c7.el9 1.5 MB/s | 99 kB 00:00 2024-03-04T08:46:49.088 INFO:teuthology.orchestra.run.smithi019.stdout:(25/176): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-04T08:46:49.338 INFO:teuthology.orchestra.run.smithi019.stdout:(26/176): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 12 MB/s | 3.1 MB 00:00 2024-03-04T08:46:49.397 INFO:teuthology.orchestra.run.smithi019.stdout:(27/176): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 2.9 MB/s | 171 kB 00:00 2024-03-04T08:46:49.464 INFO:teuthology.orchestra.run.smithi019.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1739.g 473 kB/s | 31 kB 00:00 2024-03-04T08:46:49.530 INFO:teuthology.orchestra.run.smithi019.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 2.0 MB/s | 138 kB 00:00 2024-03-04T08:46:49.698 INFO:teuthology.orchestra.run.smithi019.stdout:(30/176): ceph-mgr-dashboard-19.0.0-1739.g1bc25 11 MB/s | 1.8 MB 00:00 2024-03-04T08:46:50.256 INFO:teuthology.orchestra.run.smithi019.stdout:(31/176): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-03-04T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1739.g1b 3.7 MB/s | 248 kB 00:00 2024-03-04T08:46:50.390 INFO:teuthology.orchestra.run.smithi019.stdout:(33/176): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 739 kB/s | 49 kB 00:00 2024-03-04T08:46:50.457 INFO:teuthology.orchestra.run.smithi019.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1739.g1 230 kB/s | 15 kB 00:00 2024-03-04T08:46:50.532 INFO:teuthology.orchestra.run.smithi019.stdout:(35/176): ceph-volume-19.0.0-1739.g1bc250c7.el9 3.4 MB/s | 264 kB 00:00 2024-03-04T08:46:50.983 INFO:teuthology.orchestra.run.smithi019.stdout:(36/176): ceph-test-19.0.0-1739.g1bc250c7.el9.x 14 MB/s | 47 MB 00:03 2024-03-04T08:46:51.024 INFO:teuthology.orchestra.run.smithi019.stdout:(37/176): cephadm-19.0.0-1739.g1bc250c7.el9.noa 1.5 MB/s | 748 kB 00:00 2024-03-04T08:46:51.050 INFO:teuthology.orchestra.run.smithi019.stdout:(38/176): cephfs-top-19.0.0-1739.g1bc250c7.el9. 274 kB/s | 18 kB 00:00 2024-03-04T08:46:51.200 INFO:teuthology.orchestra.run.smithi019.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2024-03-04T08:46:51.242 INFO:teuthology.orchestra.run.smithi019.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2024-03-04T08:46:51.267 INFO:teuthology.orchestra.run.smithi019.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-04T08:46:51.284 INFO:teuthology.orchestra.run.smithi019.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 492 kB/s | 20 kB 00:00 2024-03-04T08:46:51.318 INFO:teuthology.orchestra.run.smithi019.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 5.9 MB/s | 307 kB 00:00 2024-03-04T08:46:51.335 INFO:teuthology.orchestra.run.smithi019.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 632 kB/s | 32 kB 00:00 2024-03-04T08:46:51.410 INFO:teuthology.orchestra.run.smithi019.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-03-04T08:46:51.427 INFO:teuthology.orchestra.run.smithi019.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 188 kB/s | 17 kB 00:00 2024-03-04T08:46:51.452 INFO:teuthology.orchestra.run.smithi019.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 408 kB/s | 10 kB 00:00 2024-03-04T08:46:51.478 INFO:teuthology.orchestra.run.smithi019.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-04T08:46:51.494 INFO:teuthology.orchestra.run.smithi019.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-04T08:46:51.528 INFO:teuthology.orchestra.run.smithi019.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-04T08:46:51.554 INFO:teuthology.orchestra.run.smithi019.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-03-04T08:46:51.570 INFO:teuthology.orchestra.run.smithi019.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 596 kB/s | 24 kB 00:00 2024-03-04T08:46:51.587 INFO:teuthology.orchestra.run.smithi019.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-04T08:46:51.613 INFO:teuthology.orchestra.run.smithi019.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-04T08:46:51.638 INFO:teuthology.orchestra.run.smithi019.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-04T08:46:51.655 INFO:teuthology.orchestra.run.smithi019.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 827 kB/s | 34 kB 00:00 2024-03-04T08:46:51.772 INFO:teuthology.orchestra.run.smithi019.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-03-04T08:46:51.822 INFO:teuthology.orchestra.run.smithi019.stdout:(58/176): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-03-04T08:46:51.864 INFO:teuthology.orchestra.run.smithi019.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2024-03-04T08:46:51.898 INFO:teuthology.orchestra.run.smithi019.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-04T08:46:51.923 INFO:teuthology.orchestra.run.smithi019.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-04T08:46:52.040 INFO:teuthology.orchestra.run.smithi019.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-04T08:46:52.077 INFO:teuthology.orchestra.run.smithi019.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-03-04T08:46:52.099 INFO:teuthology.orchestra.run.smithi019.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-04T08:46:52.233 INFO:teuthology.orchestra.run.smithi019.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 5.8 MB 00:00 2024-03-04T08:46:52.258 INFO:teuthology.orchestra.run.smithi019.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 227 kB 00:00 2024-03-04T08:46:52.283 INFO:teuthology.orchestra.run.smithi019.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2024-03-04T08:46:52.308 INFO:teuthology.orchestra.run.smithi019.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-03-04T08:46:52.334 INFO:teuthology.orchestra.run.smithi019.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T08:46:52.359 INFO:teuthology.orchestra.run.smithi019.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-03-04T08:46:52.485 INFO:teuthology.orchestra.run.smithi019.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-04T08:46:52.510 INFO:teuthology.orchestra.run.smithi019.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-04T08:46:52.535 INFO:teuthology.orchestra.run.smithi019.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-04T08:46:52.552 INFO:teuthology.orchestra.run.smithi019.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-03-04T08:46:52.577 INFO:teuthology.orchestra.run.smithi019.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 986 kB/s | 41 kB 00:00 2024-03-04T08:46:52.603 INFO:teuthology.orchestra.run.smithi019.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-04T08:46:52.636 INFO:teuthology.orchestra.run.smithi019.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2024-03-04T08:46:52.662 INFO:teuthology.orchestra.run.smithi019.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 132 kB 00:00 2024-03-04T08:46:52.687 INFO:teuthology.orchestra.run.smithi019.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 945 kB/s | 47 kB 00:00 2024-03-04T08:46:52.712 INFO:teuthology.orchestra.run.smithi019.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2024-03-04T08:46:52.862 INFO:teuthology.orchestra.run.smithi019.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 262 kB/s | 39 kB 00:00 2024-03-04T08:46:53.021 INFO:teuthology.orchestra.run.smithi019.stdout:(82/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-03-04T08:46:53.046 INFO:teuthology.orchestra.run.smithi019.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 226 kB/s | 41 kB 00:00 2024-03-04T08:46:53.072 INFO:teuthology.orchestra.run.smithi019.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-03-04T08:46:53.115 INFO:teuthology.orchestra.run.smithi019.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 499 kB/s | 34 kB 00:00 2024-03-04T08:46:53.139 INFO:teuthology.orchestra.run.smithi019.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2024-03-04T08:46:53.164 INFO:teuthology.orchestra.run.smithi019.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2024-03-04T08:46:53.189 INFO:teuthology.orchestra.run.smithi019.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-04T08:46:53.215 INFO:teuthology.orchestra.run.smithi019.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-03-04T08:46:53.240 INFO:teuthology.orchestra.run.smithi019.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-04T08:46:53.265 INFO:teuthology.orchestra.run.smithi019.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 876 kB/s | 44 kB 00:00 2024-03-04T08:46:53.291 INFO:teuthology.orchestra.run.smithi019.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-04T08:46:53.316 INFO:teuthology.orchestra.run.smithi019.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T08:46:53.341 INFO:teuthology.orchestra.run.smithi019.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T08:46:53.367 INFO:teuthology.orchestra.run.smithi019.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-03-04T08:46:53.392 INFO:teuthology.orchestra.run.smithi019.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-04T08:46:53.417 INFO:teuthology.orchestra.run.smithi019.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T08:46:53.451 INFO:teuthology.orchestra.run.smithi019.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-04T08:46:53.476 INFO:teuthology.orchestra.run.smithi019.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-04T08:46:53.502 INFO:teuthology.orchestra.run.smithi019.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-04T08:46:53.527 INFO:teuthology.orchestra.run.smithi019.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-03-04T08:46:53.544 INFO:teuthology.orchestra.run.smithi019.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 4.4 MB/s | 187 kB 00:00 2024-03-04T08:46:53.761 INFO:teuthology.orchestra.run.smithi019.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.0 MB/s | 245 kB 00:00 2024-03-04T08:46:53.820 INFO:teuthology.orchestra.run.smithi019.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-03-04T08:46:54.137 INFO:teuthology.orchestra.run.smithi019.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-03-04T08:46:54.570 INFO:teuthology.orchestra.run.smithi019.stdout:(106/176): abseil-cpp-20211102.0-3.el9.x86_64.r 731 kB/s | 548 kB 00:00 2024-03-04T08:46:54.804 INFO:teuthology.orchestra.run.smithi019.stdout:(107/176): ceph-osd-19.0.0-1739.g1bc250c7.el9.x 2.1 MB/s | 17 MB 00:07 2024-03-04T08:46:54.832 INFO:teuthology.orchestra.run.smithi019.stdout:(108/176): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-03-04T08:46:54.938 INFO:teuthology.orchestra.run.smithi019.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-03-04T08:46:54.963 INFO:teuthology.orchestra.run.smithi019.stdout:(110/176): gperftools-libs-2.9.1-2.el9.x86_64.r 374 kB/s | 309 kB 00:00 2024-03-04T08:46:55.046 INFO:teuthology.orchestra.run.smithi019.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-03-04T08:46:55.088 INFO:teuthology.orchestra.run.smithi019.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-03-04T08:46:55.164 INFO:teuthology.orchestra.run.smithi019.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-04T08:46:55.331 INFO:teuthology.orchestra.run.smithi019.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-03-04T08:46:55.397 INFO:teuthology.orchestra.run.smithi019.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.7 MB/s | 838 kB 00:00 2024-03-04T08:46:55.439 INFO:teuthology.orchestra.run.smithi019.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 400 kB/s | 43 kB 00:00 2024-03-04T08:46:55.506 INFO:teuthology.orchestra.run.smithi019.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-03-04T08:46:55.548 INFO:teuthology.orchestra.run.smithi019.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-03-04T08:46:55.632 INFO:teuthology.orchestra.run.smithi019.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-03-04T08:46:55.699 INFO:teuthology.orchestra.run.smithi019.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-03-04T08:46:55.766 INFO:teuthology.orchestra.run.smithi019.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-03-04T08:46:55.841 INFO:teuthology.orchestra.run.smithi019.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 249 kB/s | 35 kB 00:00 2024-03-04T08:46:55.908 INFO:teuthology.orchestra.run.smithi019.stdout:(123/176): libarrow-9.0.0-10.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-03-04T08:46:55.933 INFO:teuthology.orchestra.run.smithi019.stdout:(124/176): python3-google-auth-2.28.0-1.el9.noa 1.2 MB/s | 203 kB 00:00 2024-03-04T08:46:56.017 INFO:teuthology.orchestra.run.smithi019.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-03-04T08:46:56.042 INFO:teuthology.orchestra.run.smithi019.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-03-04T08:46:56.126 INFO:teuthology.orchestra.run.smithi019.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-03-04T08:46:56.176 INFO:teuthology.orchestra.run.smithi019.stdout:(128/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-03-04T08:46:56.202 INFO:teuthology.orchestra.run.smithi019.stdout:(129/176): python3-jaraco-collections-3.0.0-8.e 145 kB/s | 23 kB 00:00 2024-03-04T08:46:56.235 INFO:teuthology.orchestra.run.smithi019.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2024-03-04T08:46:56.277 INFO:teuthology.orchestra.run.smithi019.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-03-04T08:46:56.375 INFO:teuthology.orchestra.run.smithi019.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 5.9 MB/s | 1.0 MB 00:00 2024-03-04T08:46:56.394 INFO:teuthology.orchestra.run.smithi019.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 291 kB/s | 46 kB 00:00 2024-03-04T08:46:56.420 INFO:teuthology.orchestra.run.smithi019.stdout:(134/176): python3-more-itertools-8.12.0-2.el9. 554 kB/s | 79 kB 00:00 2024-03-04T08:46:56.478 INFO:teuthology.orchestra.run.smithi019.stdout:(135/176): python3-natsort-7.1.1-5.el9.noarch.r 559 kB/s | 58 kB 00:00 2024-03-04T08:46:56.520 INFO:teuthology.orchestra.run.smithi019.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-03-04T08:46:56.537 INFO:teuthology.orchestra.run.smithi019.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-03-04T08:46:56.588 INFO:teuthology.orchestra.run.smithi019.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-03-04T08:46:56.621 INFO:teuthology.orchestra.run.smithi019.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-03-04T08:46:56.638 INFO:teuthology.orchestra.run.smithi019.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-03-04T08:46:56.697 INFO:teuthology.orchestra.run.smithi019.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-03-04T08:46:56.730 INFO:teuthology.orchestra.run.smithi019.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 542 kB/s | 59 kB 00:00 2024-03-04T08:46:56.756 INFO:teuthology.orchestra.run.smithi019.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2024-03-04T08:46:56.806 INFO:teuthology.orchestra.run.smithi019.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-03-04T08:46:56.848 INFO:teuthology.orchestra.run.smithi019.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-04T08:46:56.876 INFO:teuthology.orchestra.run.smithi019.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 766 kB/s | 90 kB 00:00 2024-03-04T08:46:56.932 INFO:teuthology.orchestra.run.smithi019.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-04T08:46:56.957 INFO:teuthology.orchestra.run.smithi019.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-03-04T08:46:56.982 INFO:teuthology.orchestra.run.smithi019.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-03-04T08:46:57.099 INFO:teuthology.orchestra.run.smithi019.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-03-04T08:46:57.133 INFO:teuthology.orchestra.run.smithi019.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-03-04T08:46:57.225 INFO:teuthology.orchestra.run.smithi019.stdout:(152/176): NetworkManager-1.46.0-1.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-03-04T08:46:57.316 INFO:teuthology.orchestra.run.smithi019.stdout:(153/176): NetworkManager-libnm-1.46.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-03-04T08:46:57.358 INFO:teuthology.orchestra.run.smithi019.stdout:(154/176): NetworkManager-team-1.46.0-1.el9.x86 993 kB/s | 41 kB 00:00 2024-03-04T08:46:57.425 INFO:teuthology.orchestra.run.smithi019.stdout:(155/176): librbd1-19.0.0-1739.g1bc250c7.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-03-04T08:46:57.451 INFO:teuthology.orchestra.run.smithi019.stdout:(156/176): NetworkManager-tui-1.46.0-1.el9.x86_ 2.6 MB/s | 247 kB 00:00 2024-03-04T08:46:57.476 INFO:teuthology.orchestra.run.smithi019.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2024-03-04T08:46:57.510 INFO:teuthology.orchestra.run.smithi019.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 604 kB/s | 35 kB 00:00 2024-03-04T08:46:57.535 INFO:teuthology.orchestra.run.smithi019.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 191 kB 00:00 2024-03-04T08:46:57.569 INFO:teuthology.orchestra.run.smithi019.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 254 kB 00:00 2024-03-04T08:46:57.602 INFO:teuthology.orchestra.run.smithi019.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-03-04T08:46:57.644 INFO:teuthology.orchestra.run.smithi019.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.7 MB/s | 433 kB 00:00 2024-03-04T08:46:57.669 INFO:teuthology.orchestra.run.smithi019.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 329 kB/s | 22 kB 00:00 2024-03-04T08:46:57.695 INFO:teuthology.orchestra.run.smithi019.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-03-04T08:46:57.729 INFO:teuthology.orchestra.run.smithi019.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 154 kB 00:00 2024-03-04T08:46:57.754 INFO:teuthology.orchestra.run.smithi019.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 135 kB 00:00 2024-03-04T08:46:57.779 INFO:teuthology.orchestra.run.smithi019.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-03-04T08:46:57.804 INFO:teuthology.orchestra.run.smithi019.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 552 kB/s | 28 kB 00:00 2024-03-04T08:46:57.855 INFO:teuthology.orchestra.run.smithi019.stdout:(169/176): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-03-04T08:46:57.955 INFO:teuthology.orchestra.run.smithi019.stdout:(170/176): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-03-04T08:46:58.039 INFO:teuthology.orchestra.run.smithi019.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-03-04T08:46:58.064 INFO:teuthology.orchestra.run.smithi019.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 4.0 MB/s | 438 kB 00:00 2024-03-04T08:46:58.081 INFO:teuthology.orchestra.run.smithi019.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 733 kB/s | 30 kB 00:00 2024-03-04T08:46:58.115 INFO:teuthology.orchestra.run.smithi019.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-03-04T08:46:58.165 INFO:teuthology.orchestra.run.smithi019.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-04T08:46:58.373 INFO:teuthology.orchestra.run.smithi019.stdout:(176/176): librados2-19.0.0-1739.g1bc250c7.el9. 2.4 MB/s | 3.4 MB 00:01 2024-03-04T08:46:58.381 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:46:58.381 INFO:teuthology.orchestra.run.smithi019.stdout:Total 17 MB/s | 224 MB 00:13 2024-03-04T08:46:58.432 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-04T08:46:58.772 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-04T08:46:58.772 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-04T08:47:00.844 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-04T08:47:00.845 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-04T08:47:07.883 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-04T08:47:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/202 2024-03-04T08:47:08.153 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-03-04T08:47:08.310 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T08:47:08.336 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T08:47:08.381 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-03-04T08:47:08.421 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-03-04T08:47:08.476 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-03-04T08:47:08.515 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-03-04T08:47:08.540 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-03-04T08:47:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-03-04T08:47:08.930 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-03-04T08:47:08.999 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:47:09.123 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:47:09.266 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:47:09.342 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:47:09.380 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T08:47:09.585 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-03-04T08:47:09.644 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-03-04T08:47:09.671 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:47:09.776 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:47:09.806 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T08:47:09.870 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T08:47:09.901 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-03-04T08:47:09.924 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T08:47:09.939 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T08:47:10.124 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T08:47:10.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T08:47:10.187 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-03-04T08:47:10.350 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-03-04T08:47:10.481 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T08:47:10.540 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T08:47:10.645 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:47:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:47:10.922 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:47:11.029 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-03-04T08:47:11.157 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-03-04T08:47:11.317 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-03-04T08:47:11.388 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-03-04T08:47:11.448 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-03-04T08:47:11.487 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-03-04T08:47:11.523 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-03-04T08:47:11.562 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-03-04T08:47:11.629 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-03-04T08:47:11.670 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-03-04T08:47:11.713 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-03-04T08:47:11.746 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-03-04T08:47:11.774 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-03-04T08:47:11.846 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-03-04T08:47:11.878 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 39/202 2024-03-04T08:47:11.923 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 40/202 2024-03-04T08:47:11.950 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 41/202 2024-03-04T08:47:12.022 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-03-04T08:47:12.074 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-03-04T08:47:12.150 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-03-04T08:47:12.295 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-03-04T08:47:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-03-04T08:47:12.914 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-03-04T08:47:13.000 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-03-04T08:47:13.088 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-03-04T08:47:13.132 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T08:47:13.140 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T08:47:13.180 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-03-04T08:47:13.218 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 52/202 2024-03-04T08:47:13.255 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-03-04T08:47:13.343 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-03-04T08:47:13.401 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-03-04T08:47:13.865 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-03-04T08:47:14.030 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-03-04T08:47:14.102 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-03-04T08:47:14.138 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-03-04T08:47:14.280 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-03-04T08:47:14.332 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/202 2024-03-04T08:47:14.389 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-03-04T08:47:14.463 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-03-04T08:47:14.500 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-03-04T08:47:14.536 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-03-04T08:47:14.584 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-03-04T08:47:14.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-03-04T08:47:14.662 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-03-04T08:47:14.704 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-03-04T08:47:14.845 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-03-04T08:47:14.893 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-03-04T08:47:14.923 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-03-04T08:47:14.973 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-03-04T08:47:15.070 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-03-04T08:47:15.112 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/202 2024-03-04T08:47:15.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-03-04T08:47:15.180 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-03-04T08:47:15.205 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-03-04T08:47:15.287 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-03-04T08:47:15.418 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-03-04T08:47:15.524 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-03-04T08:47:15.572 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-03-04T08:47:15.629 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-03-04T08:47:15.694 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-03-04T08:47:15.883 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-03-04T08:47:15.934 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-03-04T08:47:16.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-03-04T08:47:16.132 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-03-04T08:47:16.165 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-03-04T08:47:16.196 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-03-04T08:47:16.232 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-03-04T08:47:16.263 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-03-04T08:47:16.291 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-03-04T08:47:16.325 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-03-04T08:47:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-03-04T08:47:16.387 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-03-04T08:47:16.417 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-03-04T08:47:16.495 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-03-04T08:47:16.527 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-03-04T08:47:16.561 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-03-04T08:47:16.603 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-03-04T08:47:16.636 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-03-04T08:47:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-03-04T08:47:16.818 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-03-04T08:47:16.869 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-03-04T08:47:16.899 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-03-04T08:47:16.947 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-03-04T08:47:17.047 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-03-04T08:47:17.102 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-03-04T08:47:17.863 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-03-04T08:47:17.914 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-03-04T08:47:17.948 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-03-04T08:47:17.997 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-03-04T08:47:18.089 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-03-04T08:47:18.149 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-03-04T08:47:18.333 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-03-04T08:47:18.364 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-03-04T08:47:18.450 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-03-04T08:47:19.125 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-03-04T08:47:19.248 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-03-04T08:47:20.537 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-03-04T08:47:20.809 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-03-04T08:47:20.835 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-03-04T08:47:21.164 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-03-04T08:47:21.191 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T08:47:21.281 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T08:47:21.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/202 2024-03-04T08:47:21.356 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-03-04T08:47:21.836 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-03-04T08:47:21.868 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T08:47:21.923 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T08:47:21.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/202 2024-03-04T08:47:24.255 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:47:24.292 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:47:24.859 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:47:24.895 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T08:47:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T08:47:24.970 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T08:47:24.970 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T08:47:24.970 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:25.005 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T08:47:37.429 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T08:47:37.429 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-03-04T08:47:37.430 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:37.600 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T08:47:37.615 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T08:47:37.615 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:37.615 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T08:47:37.615 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:39.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:47:39.181 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:39.406 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:47:39.428 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:39.889 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T08:47:39.911 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T08:47:39.911 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:39.911 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T08:47:39.912 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:47:39.912 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:47:39.912 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:40.008 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-03-04T08:47:40.376 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T08:47:40.407 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T08:47:40.430 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 140/202 2024-03-04T08:47:40.484 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 141/202 2024-03-04T08:47:40.504 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T08:47:40.745 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T08:47:40.780 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T08:47:41.794 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T08:47:41.830 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T08:47:41.935 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T08:47:42.100 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 145/202 2024-03-04T08:47:42.124 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T08:47:42.147 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T08:47:42.147 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:42.147 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T08:47:42.147 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:47:42.147 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:47:42.148 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:42.225 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T08:47:42.236 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T08:47:42.297 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 148/202 2024-03-04T08:47:43.204 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-03-04T08:47:43.237 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:47:43.260 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:43.296 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T08:47:43.318 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T08:47:43.318 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:43.318 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T08:47:43.318 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:43.372 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T08:47:43.393 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T08:47:43.393 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:43.393 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T08:47:43.393 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:47:43.393 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:47:43.394 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:43.714 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:47:43.736 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:47:43.737 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:47:43.737 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T08:47:43.737 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:47:43.737 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:47:43.737 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:47:48.411 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/202 2024-03-04T08:47:48.452 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/202 2024-03-04T08:47:48.482 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/202 2024-03-04T08:47:48.509 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-03-04T08:47:48.707 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 158/202 2024-03-04T08:47:48.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-03-04T08:47:48.891 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 160/202 2024-03-04T08:47:48.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-03-04T08:47:49.007 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-03-04T08:47:49.080 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-03-04T08:47:49.126 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-03-04T08:47:49.170 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-03-04T08:47:49.200 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 166/202 2024-03-04T08:47:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 167/202 2024-03-04T08:47:49.293 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 168/202 2024-03-04T08:47:49.340 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-03-04T08:47:49.428 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-03-04T08:47:50.058 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:47:50.093 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:47:50.112 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:47:50.978 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 172/202 2024-03-04T08:47:51.074 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 173/202 2024-03-04T08:47:51.116 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-03-04T08:47:51.206 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-03-04T08:47:51.245 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-03-04T08:47:51.267 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-03-04T08:47:51.292 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-03-04T08:47:51.319 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-03-04T08:47:51.319 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T08:47:51.403 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T08:47:51.431 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-03-04T08:47:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-03-04T08:47:51.461 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T08:47:51.538 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T08:47:51.564 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-03-04T08:47:51.598 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-03-04T08:47:51.631 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-03-04T08:47:51.673 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-03-04T08:47:51.707 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-03-04T08:47:51.742 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-03-04T08:47:51.788 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-03-04T08:47:51.837 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-03-04T08:47:51.862 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-03-04T08:47:51.887 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-03-04T08:47:51.913 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-03-04T08:47:51.938 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-03-04T08:47:51.945 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:47:51.945 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:47:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:47:52.133 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T08:47:52.219 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T08:47:52.247 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-03-04T08:47:52.275 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-03-04T08:47:52.300 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-03-04T08:47:52.325 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-03-04T08:47:52.393 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T08:47:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T08:47:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 3/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 5/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 6/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 8/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 9/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 10/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T08:47:57.181 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 15/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 18/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 19/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 20/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 21/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 22/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 23/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 26/202 2024-03-04T08:47:57.182 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 28/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 30/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 31/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 32/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 33/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 34/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 35/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 36/202 2024-03-04T08:47:57.199 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 37/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 38/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 39/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-03-04T08:47:57.200 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 59/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-03-04T08:47:57.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-03-04T08:47:57.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-03-04T08:47:57.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-03-04T08:47:57.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-03-04T08:47:57.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-03-04T08:47:57.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-03-04T08:47:57.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/202 2024-03-04T08:47:57.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-03-04T08:47:57.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 189/202 2024-03-04T08:47:57.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 191/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-03-04T08:47:57.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T08:48:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T08:48:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: jq-1.6-16.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T08:48:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T08:48:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T08:48:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T08:48:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T08:48:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T08:48:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T08:48:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T08:48:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:48:00.222 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-04T08:48:00.804 DEBUG:teuthology.parallel:result is None 2024-03-04T08:48:21.757 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 201 kB/s | 20 MB 01:44 2024-03-04T08:48:26.681 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-04T08:48:29.243 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:48:29.243 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T08:48:29.255 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T08:48:29.256 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T08:48:29.257 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T08:48:29.258 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T08:48:29.259 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T08:48:29.262 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T08:48:29.263 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T08:48:29.343 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T08:48:29.370 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T08:48:29.371 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T08:48:29.372 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T08:48:29.373 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T08:48:29.374 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T08:48:29.375 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T08:48:29.376 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T08:48:29.377 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T08:48:29.378 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T08:48:29.379 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T08:48:29.380 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T08:48:29.381 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T08:48:29.382 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T08:48:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout:Install 150 Packages 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 26 Packages 2024-03-04T08:48:29.384 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:48:29.385 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 224 M 2024-03-04T08:48:29.385 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-03-04T08:48:30.023 INFO:teuthology.orchestra.run.smithi204.stdout:(1/176): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-03-04T08:48:31.430 INFO:teuthology.orchestra.run.smithi204.stdout:(2/176): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 7.8 MB/s | 5.3 MB 00:00 2024-03-04T08:48:31.430 INFO:teuthology.orchestra.run.smithi204.stdout:(3/176): ceph-immutable-object-cache-19.0.0-173 2.4 MB/s | 145 kB 00:00 2024-03-04T08:48:31.430 INFO:teuthology.orchestra.run.smithi204.stdout:(4/176): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.4 MB/s | 888 kB 00:00 2024-03-04T08:48:31.430 INFO:teuthology.orchestra.run.smithi204.stdout:(5/176): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 8.9 MB/s | 2.3 MB 00:00 2024-03-04T08:48:31.443 INFO:teuthology.orchestra.run.smithi204.stdout:(6/176): ceph-common-19.0.0-1739.g1bc250c7.el9. 12 MB/s | 20 MB 00:01 2024-03-04T08:48:31.510 INFO:teuthology.orchestra.run.smithi204.stdout:(7/176): ceph-mon-19.0.0-1739.g1bc250c7.el9.x86 6.5 MB/s | 4.7 MB 00:00 2024-03-04T08:48:31.543 INFO:teuthology.orchestra.run.smithi204.stdout:(8/176): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x86 1.7 MB/s | 1.5 MB 00:00 2024-03-04T08:48:31.651 INFO:teuthology.orchestra.run.smithi204.stdout:(9/176): ceph-selinux-19.0.0-1739.g1bc250c7.el9 232 kB/s | 25 kB 00:00 2024-03-04T08:48:32.485 INFO:teuthology.orchestra.run.smithi204.stdout:(10/176): ceph-osd-19.0.0-1739.g1bc250c7.el9.x8 16 MB/s | 17 MB 00:01 2024-03-04T08:48:32.535 INFO:teuthology.orchestra.run.smithi204.stdout:(11/176): cephfs-mirror-19.0.0-1739.g1bc250c7.e 4.3 MB/s | 220 kB 00:00 2024-03-04T08:48:32.652 INFO:teuthology.orchestra.run.smithi204.stdout:(12/176): ceph-radosgw-19.0.0-1739.g1bc250c7.el 8.6 MB/s | 9.8 MB 00:01 2024-03-04T08:48:32.677 INFO:teuthology.orchestra.run.smithi204.stdout:(13/176): cephfs-shell-19.0.0-1739.g1bc250c7.el 190 kB/s | 27 kB 00:00 2024-03-04T08:48:32.703 INFO:teuthology.orchestra.run.smithi204.stdout:(14/176): libcephfs-devel-19.0.0-1739.g1bc250c7 625 kB/s | 31 kB 00:00 2024-03-04T08:48:32.745 INFO:teuthology.orchestra.run.smithi204.stdout:(15/176): libcephfs2-19.0.0-1739.g1bc250c7.el9. 11 MB/s | 747 kB 00:00 2024-03-04T08:48:32.770 INFO:teuthology.orchestra.run.smithi204.stdout:(16/176): libcephsqlite-19.0.0-1739.g1bc250c7.e 2.4 MB/s | 163 kB 00:00 2024-03-04T08:48:32.795 INFO:teuthology.orchestra.run.smithi204.stdout:(17/176): librados-devel-19.0.0-1739.g1bc250c7. 2.5 MB/s | 127 kB 00:00 2024-03-04T08:48:32.821 INFO:teuthology.orchestra.run.smithi204.stdout:(18/176): libradosstriper1-19.0.0-1739.g1bc250c 9.8 MB/s | 501 kB 00:00 2024-03-04T08:48:32.904 INFO:teuthology.orchestra.run.smithi204.stdout:(19/176): python3-ceph-argparse-19.0.0-1739.g1b 541 kB/s | 45 kB 00:00 2024-03-04T08:48:32.979 INFO:teuthology.orchestra.run.smithi204.stdout:(20/176): python3-ceph-common-19.0.0-1739.g1bc2 1.7 MB/s | 131 kB 00:00 2024-03-04T08:48:33.105 INFO:teuthology.orchestra.run.smithi204.stdout:(21/176): librgw2-19.0.0-1739.g1bc250c7.el9.x86 17 MB/s | 5.1 MB 00:00 2024-03-04T08:48:33.130 INFO:teuthology.orchestra.run.smithi204.stdout:(22/176): python3-cephfs-19.0.0-1739.g1bc250c7. 1.1 MB/s | 162 kB 00:00 2024-03-04T08:48:33.155 INFO:teuthology.orchestra.run.smithi204.stdout:(23/176): python3-rados-19.0.0-1739.g1bc250c7.e 6.2 MB/s | 321 kB 00:00 2024-03-04T08:48:33.181 INFO:teuthology.orchestra.run.smithi204.stdout:(24/176): python3-rbd-19.0.0-1739.g1bc250c7.el9 5.8 MB/s | 298 kB 00:00 2024-03-04T08:48:33.206 INFO:teuthology.orchestra.run.smithi204.stdout:(25/176): python3-rgw-19.0.0-1739.g1bc250c7.el9 1.9 MB/s | 99 kB 00:00 2024-03-04T08:48:33.231 INFO:teuthology.orchestra.run.smithi204.stdout:(26/176): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-04T08:48:33.307 INFO:teuthology.orchestra.run.smithi204.stdout:(27/176): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 2.2 MB/s | 171 kB 00:00 2024-03-04T08:48:33.390 INFO:teuthology.orchestra.run.smithi204.stdout:(28/176): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 17 MB/s | 3.1 MB 00:00 2024-03-04T08:48:33.415 INFO:teuthology.orchestra.run.smithi204.stdout:(29/176): ceph-grafana-dashboards-19.0.0-1739.g 289 kB/s | 31 kB 00:00 2024-03-04T08:48:33.441 INFO:teuthology.orchestra.run.smithi204.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 2.7 MB/s | 138 kB 00:00 2024-03-04T08:48:33.624 INFO:teuthology.orchestra.run.smithi204.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1739.g1bc25 8.5 MB/s | 1.8 MB 00:00 2024-03-04T08:48:33.708 INFO:teuthology.orchestra.run.smithi204.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1739.g1b 2.9 MB/s | 248 kB 00:00 2024-03-04T08:48:33.775 INFO:teuthology.orchestra.run.smithi204.stdout:(33/176): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 740 kB/s | 49 kB 00:00 2024-03-04T08:48:33.867 INFO:teuthology.orchestra.run.smithi204.stdout:(34/176): ceph-mgr-diskprediction-local-19.0.0- 17 MB/s | 7.4 MB 00:00 2024-03-04T08:48:33.884 INFO:teuthology.orchestra.run.smithi204.stdout:(35/176): ceph-prometheus-alerts-19.0.0-1739.g1 141 kB/s | 15 kB 00:00 2024-03-04T08:48:33.918 INFO:teuthology.orchestra.run.smithi204.stdout:(36/176): ceph-volume-19.0.0-1739.g1bc250c7.el9 5.2 MB/s | 264 kB 00:00 2024-03-04T08:48:33.951 INFO:teuthology.orchestra.run.smithi204.stdout:(37/176): cephadm-19.0.0-1739.g1bc250c7.el9.noa 11 MB/s | 748 kB 00:00 2024-03-04T08:48:33.968 INFO:teuthology.orchestra.run.smithi204.stdout:(38/176): cephfs-top-19.0.0-1739.g1bc250c7.el9. 363 kB/s | 18 kB 00:00 2024-03-04T08:48:34.135 INFO:teuthology.orchestra.run.smithi204.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2024-03-04T08:48:34.235 INFO:teuthology.orchestra.run.smithi204.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 920 kB 00:00 2024-03-04T08:48:34.277 INFO:teuthology.orchestra.run.smithi204.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 750 kB/s | 106 kB 00:00 2024-03-04T08:48:34.303 INFO:teuthology.orchestra.run.smithi204.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 306 kB/s | 20 kB 00:00 2024-03-04T08:48:34.328 INFO:teuthology.orchestra.run.smithi204.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-04T08:48:34.353 INFO:teuthology.orchestra.run.smithi204.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 640 kB/s | 32 kB 00:00 2024-03-04T08:48:34.445 INFO:teuthology.orchestra.run.smithi204.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-04T08:48:34.470 INFO:teuthology.orchestra.run.smithi204.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2024-03-04T08:48:34.504 INFO:teuthology.orchestra.run.smithi204.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-03-04T08:48:34.529 INFO:teuthology.orchestra.run.smithi204.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-04T08:48:34.555 INFO:teuthology.orchestra.run.smithi204.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-04T08:48:34.580 INFO:teuthology.orchestra.run.smithi204.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-04T08:48:34.605 INFO:teuthology.orchestra.run.smithi204.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-04T08:48:34.630 INFO:teuthology.orchestra.run.smithi204.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 495 kB/s | 24 kB 00:00 2024-03-04T08:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2024-03-04T08:48:34.681 INFO:teuthology.orchestra.run.smithi204.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-04T08:48:34.715 INFO:teuthology.orchestra.run.smithi204.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-04T08:48:34.740 INFO:teuthology.orchestra.run.smithi204.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 584 kB/s | 34 kB 00:00 2024-03-04T08:48:34.857 INFO:teuthology.orchestra.run.smithi204.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-03-04T08:48:34.908 INFO:teuthology.orchestra.run.smithi204.stdout:(58/176): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-03-04T08:48:34.949 INFO:teuthology.orchestra.run.smithi204.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2024-03-04T08:48:34.983 INFO:teuthology.orchestra.run.smithi204.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-04T08:48:35.008 INFO:teuthology.orchestra.run.smithi204.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-04T08:48:35.175 INFO:teuthology.orchestra.run.smithi204.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2024-03-04T08:48:35.209 INFO:teuthology.orchestra.run.smithi204.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-03-04T08:48:35.234 INFO:teuthology.orchestra.run.smithi204.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-04T08:48:35.393 INFO:teuthology.orchestra.run.smithi204.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 5.8 MB 00:00 2024-03-04T08:48:35.418 INFO:teuthology.orchestra.run.smithi204.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.2 MB/s | 227 kB 00:00 2024-03-04T08:48:35.443 INFO:teuthology.orchestra.run.smithi204.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2024-03-04T08:48:35.460 INFO:teuthology.orchestra.run.smithi204.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 431 kB/s | 18 kB 00:00 2024-03-04T08:48:35.486 INFO:teuthology.orchestra.run.smithi204.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-04T08:48:35.502 INFO:teuthology.orchestra.run.smithi204.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 758 kB/s | 32 kB 00:00 2024-03-04T08:48:35.628 INFO:teuthology.orchestra.run.smithi204.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-04T08:48:35.653 INFO:teuthology.orchestra.run.smithi204.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-04T08:48:35.679 INFO:teuthology.orchestra.run.smithi204.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-04T08:48:35.704 INFO:teuthology.orchestra.run.smithi204.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-04T08:48:35.729 INFO:teuthology.orchestra.run.smithi204.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-03-04T08:48:35.763 INFO:teuthology.orchestra.run.smithi204.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-04T08:48:35.788 INFO:teuthology.orchestra.run.smithi204.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-03-04T08:48:35.813 INFO:teuthology.orchestra.run.smithi204.stdout:(78/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-04T08:48:35.838 INFO:teuthology.orchestra.run.smithi204.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 949 kB/s | 47 kB 00:00 2024-03-04T08:48:35.864 INFO:teuthology.orchestra.run.smithi204.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2024-03-04T08:48:36.039 INFO:teuthology.orchestra.run.smithi204.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 223 kB/s | 39 kB 00:00 2024-03-04T08:48:36.198 INFO:teuthology.orchestra.run.smithi204.stdout:(82/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-03-04T08:48:36.223 INFO:teuthology.orchestra.run.smithi204.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 226 kB/s | 41 kB 00:00 2024-03-04T08:48:36.249 INFO:teuthology.orchestra.run.smithi204.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-03-04T08:48:36.274 INFO:teuthology.orchestra.run.smithi204.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 675 kB/s | 34 kB 00:00 2024-03-04T08:48:36.299 INFO:teuthology.orchestra.run.smithi204.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 864 kB/s | 43 kB 00:00 2024-03-04T08:48:36.325 INFO:teuthology.orchestra.run.smithi204.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-04T08:48:36.350 INFO:teuthology.orchestra.run.smithi204.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-04T08:48:36.375 INFO:teuthology.orchestra.run.smithi204.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-03-04T08:48:36.400 INFO:teuthology.orchestra.run.smithi204.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-04T08:48:36.426 INFO:teuthology.orchestra.run.smithi204.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 877 kB/s | 44 kB 00:00 2024-03-04T08:48:36.451 INFO:teuthology.orchestra.run.smithi204.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-04T08:48:36.476 INFO:teuthology.orchestra.run.smithi204.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T08:48:36.510 INFO:teuthology.orchestra.run.smithi204.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-03-04T08:48:36.536 INFO:teuthology.orchestra.run.smithi204.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 194 kB 00:00 2024-03-04T08:48:36.562 INFO:teuthology.orchestra.run.smithi204.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-04T08:48:36.586 INFO:teuthology.orchestra.run.smithi204.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T08:48:36.620 INFO:teuthology.orchestra.run.smithi204.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-04T08:48:36.645 INFO:teuthology.orchestra.run.smithi204.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-04T08:48:36.687 INFO:teuthology.orchestra.run.smithi204.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 1.8 MB/s | 124 kB 00:00 2024-03-04T08:48:36.712 INFO:teuthology.orchestra.run.smithi204.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 1.7 MB/s | 113 kB 00:00 2024-03-04T08:48:36.737 INFO:teuthology.orchestra.run.smithi204.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T08:48:36.813 INFO:teuthology.orchestra.run.smithi204.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2024-03-04T08:48:36.830 INFO:teuthology.orchestra.run.smithi204.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-03-04T08:48:36.980 INFO:teuthology.orchestra.run.smithi204.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-03-04T08:48:37.322 INFO:teuthology.orchestra.run.smithi204.stdout:(106/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-04T08:48:37.389 INFO:teuthology.orchestra.run.smithi204.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 293 kB/s | 19 kB 00:00 2024-03-04T08:48:37.422 INFO:teuthology.orchestra.run.smithi204.stdout:(108/176): gperftools-libs-2.9.1-2.el9.x86_64.r 700 kB/s | 309 kB 00:00 2024-03-04T08:48:37.498 INFO:teuthology.orchestra.run.smithi204.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-04T08:48:37.590 INFO:teuthology.orchestra.run.smithi204.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-03-04T08:48:37.690 INFO:teuthology.orchestra.run.smithi204.stdout:(111/176): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-03-04T08:48:37.715 INFO:teuthology.orchestra.run.smithi204.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 537 kB/s | 67 kB 00:00 2024-03-04T08:48:37.766 INFO:teuthology.orchestra.run.smithi204.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-03-04T08:48:37.841 INFO:teuthology.orchestra.run.smithi204.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-03-04T08:48:37.892 INFO:teuthology.orchestra.run.smithi204.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-03-04T08:48:37.917 INFO:teuthology.orchestra.run.smithi204.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-03-04T08:48:37.967 INFO:teuthology.orchestra.run.smithi204.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 429 kB/s | 32 kB 00:00 2024-03-04T08:48:37.992 INFO:teuthology.orchestra.run.smithi204.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-03-04T08:48:38.042 INFO:teuthology.orchestra.run.smithi204.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-04T08:48:38.076 INFO:teuthology.orchestra.run.smithi204.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-04T08:48:38.118 INFO:teuthology.orchestra.run.smithi204.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-03-04T08:48:38.152 INFO:teuthology.orchestra.run.smithi204.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-03-04T08:48:38.194 INFO:teuthology.orchestra.run.smithi204.stdout:(123/176): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-04T08:48:38.269 INFO:teuthology.orchestra.run.smithi204.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-04T08:48:38.319 INFO:teuthology.orchestra.run.smithi204.stdout:(125/176): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-03-04T08:48:38.345 INFO:teuthology.orchestra.run.smithi204.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-04T08:48:38.395 INFO:teuthology.orchestra.run.smithi204.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-03-04T08:48:38.420 INFO:teuthology.orchestra.run.smithi204.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-03-04T08:48:38.471 INFO:teuthology.orchestra.run.smithi204.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-03-04T08:48:38.496 INFO:teuthology.orchestra.run.smithi204.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-03-04T08:48:38.563 INFO:teuthology.orchestra.run.smithi204.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-03-04T08:48:38.580 INFO:teuthology.orchestra.run.smithi204.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-03-04T08:48:38.638 INFO:teuthology.orchestra.run.smithi204.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-04T08:48:38.664 INFO:teuthology.orchestra.run.smithi204.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-03-04T08:48:38.714 INFO:teuthology.orchestra.run.smithi204.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-04T08:48:38.731 INFO:teuthology.orchestra.run.smithi204.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-03-04T08:48:38.791 INFO:teuthology.orchestra.run.smithi204.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-04T08:48:38.807 INFO:teuthology.orchestra.run.smithi204.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-04T08:48:38.857 INFO:teuthology.orchestra.run.smithi204.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-03-04T08:48:38.882 INFO:teuthology.orchestra.run.smithi204.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-04T08:48:38.924 INFO:teuthology.orchestra.run.smithi204.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-03-04T08:48:38.958 INFO:teuthology.orchestra.run.smithi204.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-03-04T08:48:39.000 INFO:teuthology.orchestra.run.smithi204.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-03-04T08:48:39.033 INFO:teuthology.orchestra.run.smithi204.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-04T08:48:39.067 INFO:teuthology.orchestra.run.smithi204.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-04T08:48:39.109 INFO:teuthology.orchestra.run.smithi204.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-04T08:48:39.143 INFO:teuthology.orchestra.run.smithi204.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-03-04T08:48:39.185 INFO:teuthology.orchestra.run.smithi204.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-04T08:48:39.243 INFO:teuthology.orchestra.run.smithi204.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-04T08:48:39.594 INFO:teuthology.orchestra.run.smithi204.stdout:(150/176): librbd1-19.0.0-1739.g1bc250c7.el9.x8 9.0 MB/s | 3.1 MB 00:00 2024-03-04T08:48:39.644 INFO:teuthology.orchestra.run.smithi204.stdout:(151/176): librados2-19.0.0-1739.g1bc250c7.el9. 7.4 MB/s | 3.4 MB 00:00 2024-03-04T08:48:39.669 INFO:teuthology.orchestra.run.smithi204.stdout:(152/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 901 kB/s | 68 kB 00:00 2024-03-04T08:48:39.719 INFO:teuthology.orchestra.run.smithi204.stdout:(153/176): NetworkManager-1.46.0-1.el9.x86_64.r 30 MB/s | 2.3 MB 00:00 2024-03-04T08:48:39.762 INFO:teuthology.orchestra.run.smithi204.stdout:(154/176): NetworkManager-libnm-1.46.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-03-04T08:48:39.787 INFO:teuthology.orchestra.run.smithi204.stdout:(155/176): NetworkManager-team-1.46.0-1.el9.x86 640 kB/s | 41 kB 00:00 2024-03-04T08:48:39.812 INFO:teuthology.orchestra.run.smithi204.stdout:(156/176): NetworkManager-tui-1.46.0-1.el9.x86_ 4.8 MB/s | 247 kB 00:00 2024-03-04T08:48:39.837 INFO:teuthology.orchestra.run.smithi204.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-03-04T08:48:39.863 INFO:teuthology.orchestra.run.smithi204.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 35 kB 00:00 2024-03-04T08:48:39.888 INFO:teuthology.orchestra.run.smithi204.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-03-04T08:48:39.913 INFO:teuthology.orchestra.run.smithi204.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-03-04T08:48:39.939 INFO:teuthology.orchestra.run.smithi204.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T08:48:39.964 INFO:teuthology.orchestra.run.smithi204.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 8.7 MB/s | 433 kB 00:00 2024-03-04T08:48:39.981 INFO:teuthology.orchestra.run.smithi204.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 534 kB/s | 22 kB 00:00 2024-03-04T08:48:40.006 INFO:teuthology.orchestra.run.smithi204.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.5 MB/s | 107 kB 00:00 2024-03-04T08:48:40.031 INFO:teuthology.orchestra.run.smithi204.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-03-04T08:48:40.057 INFO:teuthology.orchestra.run.smithi204.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-03-04T08:48:40.082 INFO:teuthology.orchestra.run.smithi204.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-03-04T08:48:40.108 INFO:teuthology.orchestra.run.smithi204.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 552 kB/s | 28 kB 00:00 2024-03-04T08:48:40.150 INFO:teuthology.orchestra.run.smithi204.stdout:(169/176): openssl-3.0.7-27.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2024-03-04T08:48:40.200 INFO:teuthology.orchestra.run.smithi204.stdout:(170/176): openssl-libs-3.0.7-27.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2024-03-04T08:48:40.250 INFO:teuthology.orchestra.run.smithi204.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2024-03-04T08:48:40.275 INFO:teuthology.orchestra.run.smithi204.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 5.9 MB/s | 438 kB 00:00 2024-03-04T08:48:40.301 INFO:teuthology.orchestra.run.smithi204.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 607 kB/s | 30 kB 00:00 2024-03-04T08:48:40.326 INFO:teuthology.orchestra.run.smithi204.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-03-04T08:48:40.359 INFO:teuthology.orchestra.run.smithi204.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-03-04T08:48:42.510 INFO:teuthology.orchestra.run.smithi204.stdout:(176/176): ceph-test-19.0.0-1739.g1bc250c7.el9. 4.4 MB/s | 47 MB 00:10 2024-03-04T08:48:42.517 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:48:42.517 INFO:teuthology.orchestra.run.smithi204.stdout:Total 17 MB/s | 224 MB 00:13 2024-03-04T08:48:42.561 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-03-04T08:48:42.875 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-03-04T08:48:42.876 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-03-04T08:48:44.836 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-03-04T08:48:44.836 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-03-04T08:48:51.738 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-03-04T08:48:51.855 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/202 2024-03-04T08:48:51.890 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-03-04T08:48:51.930 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T08:48:51.958 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T08:48:52.010 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-03-04T08:48:52.058 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-03-04T08:48:52.110 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-03-04T08:48:52.143 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-03-04T08:48:52.178 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-03-04T08:48:52.233 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-03-04T08:48:52.556 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-03-04T08:48:52.629 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:48:52.733 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:48:52.763 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:48:52.838 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:48:52.871 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T08:48:53.038 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-03-04T08:48:53.089 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-03-04T08:48:53.118 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:48:53.222 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:48:53.244 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T08:48:53.301 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T08:48:53.339 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-03-04T08:48:53.362 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T08:48:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T08:48:53.533 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T08:48:53.572 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T08:48:53.612 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-03-04T08:48:53.782 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-03-04T08:48:53.919 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T08:48:53.977 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T08:48:54.094 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:48:54.153 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:48:54.378 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T08:48:54.492 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-03-04T08:48:54.585 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-03-04T08:48:54.616 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-03-04T08:48:54.684 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-03-04T08:48:54.738 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-03-04T08:48:54.770 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-03-04T08:48:54.805 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-03-04T08:48:54.845 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-03-04T08:48:54.917 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-03-04T08:48:54.952 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-03-04T08:48:54.996 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-03-04T08:48:55.029 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-03-04T08:48:55.056 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-03-04T08:48:55.126 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-03-04T08:48:55.161 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 39/202 2024-03-04T08:48:55.213 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 40/202 2024-03-04T08:48:55.242 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 41/202 2024-03-04T08:48:55.311 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-03-04T08:48:55.365 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-03-04T08:48:55.438 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-03-04T08:48:55.571 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-03-04T08:48:55.625 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-03-04T08:48:56.147 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-03-04T08:48:56.229 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-03-04T08:48:56.314 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-03-04T08:48:56.366 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T08:48:56.374 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T08:48:56.413 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-03-04T08:48:56.451 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 52/202 2024-03-04T08:48:56.483 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-03-04T08:48:56.579 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-03-04T08:48:56.634 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-03-04T08:48:56.916 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-03-04T08:48:57.127 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-03-04T08:48:57.236 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-03-04T08:48:57.407 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-03-04T08:48:57.665 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-03-04T08:48:57.708 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/202 2024-03-04T08:48:57.764 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-03-04T08:48:57.836 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-03-04T08:48:57.867 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-03-04T08:48:57.904 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-03-04T08:48:57.951 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-03-04T08:48:57.987 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-03-04T08:48:58.032 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-03-04T08:48:58.072 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-03-04T08:48:58.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-03-04T08:48:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-03-04T08:48:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-03-04T08:48:58.333 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-03-04T08:48:58.427 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-03-04T08:48:58.475 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/202 2024-03-04T08:48:58.515 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-03-04T08:48:58.540 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-03-04T08:48:58.565 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-03-04T08:48:58.644 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-03-04T08:48:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-03-04T08:48:58.875 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-03-04T08:48:58.915 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-03-04T08:48:58.964 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-03-04T08:48:59.020 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-03-04T08:48:59.205 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-03-04T08:48:59.253 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-03-04T08:48:59.391 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-03-04T08:48:59.434 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-03-04T08:48:59.467 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-03-04T08:48:59.507 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-03-04T08:48:59.542 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-03-04T08:48:59.573 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-03-04T08:48:59.601 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-03-04T08:48:59.635 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-03-04T08:48:59.675 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-03-04T08:48:59.707 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-03-04T08:48:59.745 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-03-04T08:48:59.821 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-03-04T08:48:59.864 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-03-04T08:48:59.905 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-03-04T08:48:59.947 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-03-04T08:48:59.981 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-03-04T08:49:00.070 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-03-04T08:49:00.153 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-03-04T08:49:00.196 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-03-04T08:49:00.227 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-03-04T08:49:00.266 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-03-04T08:49:00.364 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-03-04T08:49:00.416 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-03-04T08:49:01.150 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-03-04T08:49:01.196 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-03-04T08:49:01.230 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-03-04T08:49:01.278 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-03-04T08:49:01.392 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-03-04T08:49:01.399 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-03-04T08:49:01.570 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-03-04T08:49:01.612 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-03-04T08:49:01.691 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-03-04T08:49:02.335 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-03-04T08:49:02.451 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-03-04T08:49:03.676 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-03-04T08:49:03.758 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-03-04T08:49:03.785 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-03-04T08:49:04.095 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-03-04T08:49:04.132 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T08:49:04.221 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T08:49:04.253 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/202 2024-03-04T08:49:04.290 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-03-04T08:49:04.747 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-03-04T08:49:04.776 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T08:49:04.848 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T08:49:04.887 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/202 2024-03-04T08:49:07.070 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:49:07.108 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:49:07.645 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T08:49:07.695 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T08:49:07.777 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T08:49:07.778 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T08:49:07.778 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T08:49:07.778 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:07.821 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-03-04T08:49:19.274 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-03-04T08:49:19.275 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:19.444 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T08:49:19.458 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T08:49:19.458 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:19.458 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T08:49:19.459 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:20.956 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T08:49:20.982 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:21.199 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T08:49:21.221 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:21.658 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T08:49:21.680 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T08:49:21.680 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:21.681 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T08:49:21.681 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:49:21.681 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T08:49:21.681 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:21.768 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-03-04T08:49:22.153 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T08:49:22.183 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T08:49:22.215 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 140/202 2024-03-04T08:49:22.276 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 141/202 2024-03-04T08:49:22.298 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T08:49:22.525 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T08:49:22.549 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T08:49:23.510 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T08:49:23.541 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T08:49:23.643 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T08:49:23.804 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 145/202 2024-03-04T08:49:23.843 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T08:49:23.865 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T08:49:23.866 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:23.866 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T08:49:23.866 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:49:23.866 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T08:49:23.866 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:23.911 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T08:49:23.921 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T08:49:23.972 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 148/202 2024-03-04T08:49:24.833 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-03-04T08:49:24.863 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T08:49:24.886 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:24.923 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T08:49:24.943 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T08:49:24.944 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:24.944 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T08:49:24.944 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:24.998 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T08:49:25.020 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:25.323 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:49:25.345 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:49:25.346 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T08:49:25.346 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T08:49:25.346 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:49:25.346 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T08:49:25.346 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:29.770 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/202 2024-03-04T08:49:29.811 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/202 2024-03-04T08:49:29.841 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/202 2024-03-04T08:49:29.868 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-03-04T08:49:30.079 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 158/202 2024-03-04T08:49:30.193 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-03-04T08:49:30.233 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 160/202 2024-03-04T08:49:30.285 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-03-04T08:49:30.333 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-03-04T08:49:30.423 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-03-04T08:49:30.460 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-03-04T08:49:30.498 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-03-04T08:49:30.528 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 166/202 2024-03-04T08:49:30.558 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 167/202 2024-03-04T08:49:30.654 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 168/202 2024-03-04T08:49:30.708 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-03-04T08:49:30.740 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-03-04T08:49:31.295 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:49:31.338 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:49:31.358 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T08:49:32.183 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 172/202 2024-03-04T08:49:32.267 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 173/202 2024-03-04T08:49:32.308 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-03-04T08:49:32.401 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-03-04T08:49:32.438 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-03-04T08:49:32.463 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-03-04T08:49:32.488 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-03-04T08:49:32.515 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-03-04T08:49:32.515 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T08:49:32.599 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T08:49:32.627 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-03-04T08:49:32.657 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-03-04T08:49:32.657 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T08:49:32.734 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T08:49:32.760 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-03-04T08:49:32.793 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-03-04T08:49:32.818 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-03-04T08:49:32.853 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-03-04T08:49:32.886 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-03-04T08:49:32.920 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-03-04T08:49:32.959 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-03-04T08:49:32.991 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-03-04T08:49:33.017 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-03-04T08:49:33.042 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-03-04T08:49:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-03-04T08:49:33.084 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-03-04T08:49:33.090 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:49:33.090 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:49:33.279 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T08:49:33.279 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T08:49:33.370 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T08:49:33.402 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-03-04T08:49:33.429 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-03-04T08:49:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-03-04T08:49:33.480 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-03-04T08:49:33.546 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 3/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 5/202 2024-03-04T08:49:38.740 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 6/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 8/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 9/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 10/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 15/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 18/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 19/202 2024-03-04T08:49:38.741 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 20/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 21/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 22/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 23/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 26/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 28/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/202 2024-03-04T08:49:38.742 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 30/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 31/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 32/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 33/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 34/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 35/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 36/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 37/202 2024-03-04T08:49:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 38/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 39/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-03-04T08:49:38.760 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 59/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-03-04T08:49:38.761 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-03-04T08:49:38.762 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-03-04T08:49:38.763 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-03-04T08:49:38.764 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-03-04T08:49:38.765 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-03-04T08:49:38.766 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-03-04T08:49:38.767 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-03-04T08:49:38.768 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-03-04T08:49:38.769 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-03-04T08:49:38.770 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 189/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 191/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-03-04T08:49:38.771 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-03-04T08:49:38.772 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-03-04T08:49:38.772 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-03-04T08:49:38.772 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-03-04T08:49:38.772 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-03-04T08:49:38.772 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T08:49:41.711 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.712 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T08:49:41.713 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.714 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T08:49:41.715 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.6-16.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.716 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T08:49:41.717 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T08:49:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T08:49:41.719 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T08:49:41.720 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T08:49:41.721 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.722 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T08:49:41.723 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T08:49:41.724 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T08:49:41.725 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T08:49:41.725 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:41.725 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-03-04T08:49:42.218 DEBUG:teuthology.parallel:result is None 2024-03-04T08:49:42.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:49:42.440 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T08:49:42.466 INFO:teuthology.orchestra.run.smithi019.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T08:49:42.467 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T08:49:42.467 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T08:49:42.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:49:42.605 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T08:49:42.627 INFO:teuthology.orchestra.run.smithi204.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T08:49:42.627 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T08:49:42.627 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T08:49:42.629 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T08:49:42.629 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:42.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T08:49:42.665 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:42.665 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T08:49:42.696 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T08:49:42.696 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:42.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T08:49:42.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T08:49:42.807 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:42.807 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T08:49:42.837 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T08:49:42.915 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T08:49:42.915 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:42.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T08:49:42.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T08:49:43.013 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:43.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T08:49:43.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T08:49:43.110 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T08:49:43.111 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:43.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T08:49:43.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T08:49:43.223 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:43.223 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T08:49:43.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T08:49:43.339 INFO:teuthology.run_tasks:Running task ceph... 2024-03-04T08:49:43.734 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-04T08:49:43.735 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-03-04T08:49:43.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-03-04T08:49:43.769 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-04T08:49:43.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T08:49:43.809 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T08:49:43.837 INFO:tasks.ceph:Creating extra log directories... 2024-03-04T08:49:43.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T08:49:43.876 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T08:49:43.913 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-04T08:49:43.913 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-04T08:49:43.913 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-04T08:49:43.913 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:43.913 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-04T08:49:43.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:44.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:44.101 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:44.101 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-04T08:49:44.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:44.235 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-04T08:49:44.267 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-04T08:49:44.267 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-04T08:49:44.267 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807', 'branch': 'wip-lusov-qdb', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm}', 'email': None, 'first_in_suite': False, 'job_id': '7580807', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5072, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'sleep_before_teardown': 0, 'subset': '246/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9kqw+BqHyBfGE5GCu2rKbuEMZ1KM54owRrtfc5JSlQM9QddMpIXoWd/C3QeoRQaGDSKHW5GAlSdQ/yvKuVnSs=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUmglADe64NXOnrbc/6ULgz/f9+cAf/t3i3c7DUc0onDNLvv5/djyvNx+j/UOisJmmVoK+oplvQR6lhLZOYvPE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-03-04_07:05:03', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-04T08:49:44.268 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T08:49:44.270 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T08:49:44.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T08:49:44.325 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T08:49:44.383 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:44.384 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T08:49:44.408 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T08:49:44.408 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-04 08:47:52.743673899 +0000 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-04 08:45:59.776969305 +0000 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-04 08:45:59.776969305 +0000 2024-03-04T08:49:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-04 08:45:59.776969305 +0000 2024-03-04T08:49:44.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T08:49:44.529 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-04T08:49:44.529 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-04T08:49:44.529 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000253106 s, 2.0 MB/s 2024-03-04T08:49:44.530 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T08:49:44.587 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-04 08:47:52.743673899 +0000 2024-03-04T08:49:44.643 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-04 08:46:00.132965652 +0000 2024-03-04T08:49:44.644 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-04 08:46:00.132965652 +0000 2024-03-04T08:49:44.644 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-04 08:46:00.132965652 +0000 2024-03-04T08:49:44.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T08:49:44.709 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-04T08:49:44.709 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-04T08:49:44.709 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00022084 s, 2.3 MB/s 2024-03-04T08:49:44.710 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T08:49:44.767 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-03-04T08:49:44.822 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T08:49:44.822 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:44.822 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-04T08:49:44.822 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:44.823 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:44.823 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-04 08:47:52.744673889 +0000 2024-03-04T08:49:44.823 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-04 08:46:00.488961998 +0000 2024-03-04T08:49:44.823 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-04 08:46:00.488961998 +0000 2024-03-04T08:49:44.823 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-04 08:46:00.488961998 +0000 2024-03-04T08:49:44.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T08:49:44.889 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-04T08:49:44.889 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-04T08:49:44.889 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000163262 s, 3.1 MB/s 2024-03-04T08:49:44.889 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T08:49:44.945 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-04 08:47:52.744673889 +0000 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-04 08:46:00.813958663 +0000 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-04 08:46:00.813958663 +0000 2024-03-04T08:49:45.000 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-04 08:46:00.813958663 +0000 2024-03-04T08:49:45.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T08:49:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-04T08:49:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-04T08:49:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000165966 s, 3.1 MB/s 2024-03-04T08:49:45.067 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T08:49:45.124 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:45.124 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:45.124 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T08:49:45.142 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T08:49:45.143 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-03-04T08:49:45.199 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-04 08:49:33.921594283 +0000 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-04 08:45:59.293959488 +0000 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-04 08:45:59.293959488 +0000 2024-03-04T08:49:45.200 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-04 08:45:59.293959488 +0000 2024-03-04T08:49:45.201 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T08:49:45.267 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-04T08:49:45.268 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-04T08:49:45.268 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000190758 s, 2.7 MB/s 2024-03-04T08:49:45.270 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T08:49:45.328 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-04 08:49:33.922594268 +0000 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-04 08:45:59.641954270 +0000 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-04 08:45:59.641954270 +0000 2024-03-04T08:49:45.389 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-04 08:45:59.641954270 +0000 2024-03-04T08:49:45.390 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T08:49:45.456 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-04T08:49:45.456 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-04T08:49:45.456 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000214103 s, 2.4 MB/s 2024-03-04T08:49:45.457 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T08:49:45.515 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-04 08:49:33.922594268 +0000 2024-03-04T08:49:45.571 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-04 08:45:59.971949323 +0000 2024-03-04T08:49:45.572 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-04 08:45:59.971949323 +0000 2024-03-04T08:49:45.572 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-04 08:45:59.971949323 +0000 2024-03-04T08:49:45.572 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T08:49:45.638 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-04T08:49:45.638 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-04T08:49:45.638 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000265002 s, 1.9 MB/s 2024-03-04T08:49:45.639 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T08:49:45.697 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T08:49:45.752 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-03-04 08:49:33.923594253 +0000 2024-03-04T08:49:45.753 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-03-04 08:46:00.303944345 +0000 2024-03-04T08:49:45.753 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-03-04 08:46:00.303944345 +0000 2024-03-04T08:49:45.753 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-03-04 08:46:00.303944345 +0000 2024-03-04T08:49:45.753 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T08:49:45.819 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-03-04T08:49:45.820 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-03-04T08:49:45.820 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000188543 s, 2.7 MB/s 2024-03-04T08:49:45.821 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T08:49:45.877 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:45.877 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T08:49:45.878 INFO:tasks.ceph:Generating config... 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] debug client = 20 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] debug ms = 1 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] pid file = 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-04T08:49:45.879 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-04T08:49:45.879 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-04T08:49:45.879 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-04T08:49:45.879 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-04T08:49:45.879 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-04T08:49:45.880 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-04T08:49:45.880 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-04T08:49:45.880 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-04T08:49:45.881 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-04T08:49:45.882 INFO:tasks.ceph:Setting up mon.a... 2024-03-04T08:49:45.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-04T08:49:45.935 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-03-04T08:49:45.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-04T08:49:45.985 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:49:46.013 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.204'), ('mon.c', '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]')] 2024-03-04T08:49:46.013 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-04T08:49:46.014 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:46.014 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T08:49:46.068 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.204 --addv c '[v2:172.21.15.204:3301,v1:172.21.15.204:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 385c227e-6109-4019-8b7b-25dec95ce12d 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 385c227e-6109-4019-8b7b-25dec95ce12d 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-03-04T08:49:46.158937+0000 2024-03-04T08:49:46.154 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-03-04T08:49:46.158937+0000 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] mon.c 2024-03-04T08:49:46.155 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-04T08:49:46.156 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T08:49:46.171 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 385c227e-6109-4019-8b7b-25dec95ce12d... 2024-03-04T08:49:46.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T08:49:46.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.262 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-03-04T08:49:46.263 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.264 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 385c227e-6109-4019-8b7b-25dec95ce12d 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.265 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.266 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-03-04T08:49:46.267 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-03-04T08:49:46.268 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-03-04T08:49:46.269 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-03-04T08:49:46.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = "" 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-03-04T08:49:46.271 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2024-03-04T08:49:46.272 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T08:49:46.273 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-03-04T08:49:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T08:49:46.275 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.19,172.21.15.204,[v2:172.21.15.204:3301,v1:172.21.15.204:6790]" 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 385c227e-6109-4019-8b7b-25dec95ce12d 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.276 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.277 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-03-04T08:49:46.278 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-04T08:49:46.279 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-03-04T08:49:46.280 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-04T08:49:46.282 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = "" 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2024-03-04T08:49:46.283 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2024-03-04T08:49:46.284 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2024-03-04T08:49:46.284 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2024-03-04T08:49:46.284 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-03-04T08:49:46.284 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-03-04T08:49:46.284 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-03-04T08:49:46.286 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-04T08:49:46.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-04T08:49:46.382 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-04T08:49:46.383 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:46.383 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-04T08:49:46.398 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:46.398 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-04T08:49:46.452 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:49:46.452 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:46.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T08:49:46.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:49:46.531 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:49:46.531 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:46.585 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:49:46.585 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:46.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T08:49:46.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T08:49:46.627 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:49:46.627 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:46.682 INFO:tasks.ceph:Setting up mon nodes... 2024-03-04T08:49:46.682 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-04T08:49:46.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T08:49:46.737 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T08:49:46.739 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T08:49:46.827 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T08:49:46.830 INFO:tasks.ceph:Setting up mds nodes... 2024-03-04T08:49:46.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-04T08:49:46.884 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-04T08:49:46.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-04T08:49:46.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-04T08:49:47.007 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-04T08:49:47.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-04T08:49:47.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-04T08:49:47.094 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-04T08:49:47.096 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-04T08:49:47.123 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-04T08:49:47.218 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-04T08:49:47.221 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-04T08:49:47.247 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-04T08:49:47.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T08:49:47.289 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-04T08:49:47.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-04T08:49:47.386 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-04T08:49:47.402 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-04T08:49:47.444 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-04T08:49:47.460 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-04T08:49:47.542 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-04T08:49:47.557 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-04T08:49:47.557 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T08:49:47.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-04T08:49:47.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:47.584 INFO:tasks.ceph:role: osd.0 2024-03-04T08:49:47.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:49:47.584 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T08:49:47.661 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:49:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:49:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:49:47.661 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:49:47.662 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:49:48.167 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-04T08:49:48.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-04T08:49:48.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-04T08:49:48.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-04T08:49:48.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-04T08:49:48.446 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:48.446 INFO:tasks.ceph:role: osd.1 2024-03-04T08:49:48.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:49:48.447 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:49:48.522 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:49:48.523 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:49:48.523 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:49:48.523 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:49:48.978 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-04T08:49:48.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-04T08:49:48.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-04T08:49:49.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-04T08:49:49.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-04T08:49:49.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:49.189 INFO:tasks.ceph:role: osd.2 2024-03-04T08:49:49.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:49:49.189 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T08:49:49.265 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:49:49.265 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:49:49.265 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:49:49.266 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:49:49.769 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-04T08:49:49.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-04T08:49:49.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-04T08:49:49.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-04T08:49:49.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-04T08:49:50.031 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T08:49:50.031 INFO:tasks.ceph:role: osd.3 2024-03-04T08:49:50.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:49:50.032 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:49:50.109 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:49:50.110 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:49:50.600 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-04T08:49:50.602 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-04T08:49:50.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-04T08:49:50.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-04T08:49:50.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:50.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.957+0000 7f49100a6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-04T08:49:50.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.957+0000 7f49100a6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-04T08:49:50.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.957+0000 7f49100a6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:49:50.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.957+0000 7f49100a6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:49:50.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.957+0000 7f49100a6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T08:49:50.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:50.958+0000 7f49100a6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-04T08:49:53.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T08:49:53.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.938+0000 7f89d4211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.938+0000 7f89d4211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.938+0000 7f89d4211640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.938+0000 7f89d4211640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.938+0000 7f89d4211640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T08:49:53.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:53.939+0000 7f89d4211640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-04T08:49:56.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T08:49:56.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.921+0000 7f05ab813640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-04T08:49:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.922+0000 7f05ab813640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-04T08:49:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.922+0000 7f05ab813640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:49:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.922+0000 7f05ab813640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:49:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.922+0000 7f05ab813640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T08:49:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:56.922+0000 7f05ab813640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-04T08:49:59.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T08:49:59.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.896+0000 7f06dd612640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.896+0000 7f06dd612640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.896+0000 7f06dd612640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.896+0000 7f06dd612640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.896+0000 7f06dd612640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T08:49:59.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:49:59.897+0000 7f06dd612640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-04T08:50:02.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T08:50:02.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-04T08:50:02.818 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:50:02.819 INFO:tasks.ceph:role: osd.4 2024-03-04T08:50:02.819 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:50:02.819 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:50:02.897 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:50:03.410 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-04T08:50:03.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-04T08:50:03.412 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-04T08:50:03.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-04T08:50:03.564 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-04T08:50:03.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:50:03.631 INFO:tasks.ceph:role: osd.5 2024-03-04T08:50:03.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:50:03.632 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T08:50:03.706 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:50:03.707 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:50:04.148 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-04T08:50:04.150 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-04T08:50:04.151 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-04T08:50:04.241 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-04T08:50:04.271 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-04T08:50:04.339 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:50:04.339 INFO:tasks.ceph:role: osd.6 2024-03-04T08:50:04.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:50:04.339 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T08:50:04.414 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:50:04.415 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:50:04.899 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-04T08:50:04.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-04T08:50:04.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-04T08:50:05.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-04T08:50:05.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-04T08:50:05.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T08:50:05.133 INFO:tasks.ceph:role: osd.7 2024-03-04T08:50:05.133 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:50:05.133 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T08:50:05.207 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T08:50:05.725 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-03-04T08:50:05.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-03-04T08:50:05.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-04T08:50:05.865 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-04T08:50:05.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:05.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.001+0000 7f927a2a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-04T08:50:05.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.001+0000 7f927a2a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-04T08:50:05.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.001+0000 7f927a2a4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:50:05.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.001+0000 7f927a2a4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:50:05.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.001+0000 7f927a2a4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T08:50:05.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:06.002+0000 7f927a2a4640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-04T08:50:08.854 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T08:50:08.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:08.982 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.986+0000 7f15e801d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-04T08:50:08.982 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.986+0000 7f15e801d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-04T08:50:08.982 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.986+0000 7f15e801d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:50:08.983 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.986+0000 7f15e801d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:50:08.983 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.986+0000 7f15e801d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T08:50:08.983 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:08.987+0000 7f15e801d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-04T08:50:11.832 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T08:50:11.863 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:11.954 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.958+0000 7fadca328640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-04T08:50:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.958+0000 7fadca328640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-04T08:50:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.958+0000 7fadca328640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:50:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.958+0000 7fadca328640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:50:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.958+0000 7fadca328640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T08:50:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:11.959+0000 7fadca328640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-04T08:50:14.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:14.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:14.803 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T08:50:14.831 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.921+0000 7f5889c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.922+0000 7f5889c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.922+0000 7f5889c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.922+0000 7f5889c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.922+0000 7f5889c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T08:50:14.919 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:14.922+0000 7f5889c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-04T08:50:17.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T08:50:17.808 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-04T08:50:17.808 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:17.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-04T08:50:17.839 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:17.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-04T08:50:17.910 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:17.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-04T08:50:17.980 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:17.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-04T08:50:18.048 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:18.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-04T08:50:18.116 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:18.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-04T08:50:18.184 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:18.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-04T08:50:18.252 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.252 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-04T08:50:18.284 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-04T08:50:18.357 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.358 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-04T08:50:18.427 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-04T08:50:18.496 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.496 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-04T08:50:18.564 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-04T08:50:18.633 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-04T08:50:18.701 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:18.701 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-04T08:50:18.717 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:18.717 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-04T08:50:18.773 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.773 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-04T08:50:18.789 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:18.789 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-04T08:50:18.845 INFO:tasks.ceph:Adding keys to all mons... 2024-03-04T08:50:18.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T08:50:18.847 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAqi+VlVdUzLBAA+L2IVB+rX+am60b8e5H4cQ== 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAqi+VlEcsCNRAAUzvzvhMN8gnJosuFxLUHqw== 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+Vlhoe6ABAAPzUP1YdMlMQU37qwqLT+ZA== 2024-03-04T08:50:18.888 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAui+VlznMiORAAT96nxm14OosHC+bHoPIiZA== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAxi+VlbqD6NxAA4wfoo2B1x13CFMDPmsd8Ug== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQA0i+Vlter/NhAAXGwCH0THZXPTM1FEfDfeOg== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQA3i+VlOmJ/NRAANQB/YtVOIXxHaetd8eAdFA== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAqi+VldzSdMRAA+XTSL+TEsO9GpImB5ikozw== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VluQXtBRAA/wYzOXPS2Bqlh3VAhyOUpg== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlBRJSDRAAiwMfg88SW040cRjdKJXhRw== 2024-03-04T08:50:18.889 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQA+i+Vl9O8cABAAFSW2Lc4RkhNVvsVjK9BwiA== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBAi+VltIXWOhAAST+2+h/CZPskEGl4eXF7PQ== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBDi+VlBaMsORAAhhbWAiewRqh4N8TXwIjEKw== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBGi+VlktANNxAAtgoiE83zRaXvMj7mxC628g== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[client.2] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlPhBaFxAAaXF8WPorbi12hfYUPT8lrg== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+Vl1OrLGhAAZjajTghTwwRQZNoho6abMQ== 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout:[client.3] 2024-03-04T08:50:18.890 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VllNueIBAArPKtzKxHFoo5VMzuo8+H9Q== 2024-03-04T08:50:18.911 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-03-04T08:50:18.911 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAqi+VlVdUzLBAA+L2IVB+rX+am60b8e5H4cQ== 2024-03-04T08:50:18.911 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-03-04T08:50:18.911 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAqi+VlEcsCNRAAUzvzvhMN8gnJosuFxLUHqw== 2024-03-04T08:50:18.911 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+Vlhoe6ABAAPzUP1YdMlMQU37qwqLT+ZA== 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAui+VlznMiORAAT96nxm14OosHC+bHoPIiZA== 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAxi+VlbqD6NxAA4wfoo2B1x13CFMDPmsd8Ug== 2024-03-04T08:50:18.912 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA0i+Vlter/NhAAXGwCH0THZXPTM1FEfDfeOg== 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA3i+VlOmJ/NRAANQB/YtVOIXxHaetd8eAdFA== 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAqi+VldzSdMRAA+XTSL+TEsO9GpImB5ikozw== 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-03-04T08:50:18.913 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+VluQXtBRAA/wYzOXPS2Bqlh3VAhyOUpg== 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.d] 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+VlBRJSDRAAiwMfg88SW040cRjdKJXhRw== 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQA+i+Vl9O8cABAAFSW2Lc4RkhNVvsVjK9BwiA== 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBAi+VltIXWOhAAST+2+h/CZPskEGl4eXF7PQ== 2024-03-04T08:50:18.914 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBDi+VlBaMsORAAhhbWAiewRqh4N8TXwIjEKw== 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQBGi+VlktANNxAAtgoiE83zRaXvMj7mxC628g== 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:50:18.915 INFO:teuthology.orchestra.run.smithi204.stdout:[client.2] 2024-03-04T08:50:18.916 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+VlPhBaFxAAaXF8WPorbi12hfYUPT8lrg== 2024-03-04T08:50:18.916 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-03-04T08:50:18.916 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+Vl1OrLGhAAZjajTghTwwRQZNoho6abMQ== 2024-03-04T08:50:18.916 INFO:teuthology.orchestra.run.smithi204.stdout:[client.3] 2024-03-04T08:50:18.916 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAri+VllNueIBAArPKtzKxHFoo5VMzuo8+H9Q== 2024-03-04T08:50:18.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:50:18.935 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:50:19.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.070 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.124 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.127 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.235 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.288 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:50:19.342 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T08:50:19.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.396 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-04T08:50:19.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.687 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T08:50:19.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.798 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.913 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T08:50:19.967 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-04T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-04T08:50:19.994 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:50:20.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-04T08:50:20.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-04T08:50:20.143 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:50:20.240 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-04T08:50:20.267 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-04T08:50:20.334 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T08:50:20.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-04T08:50:20.457 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:20.460 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T08:50:20.512 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-04T08:50:20.512 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-04T08:50:20.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-04T08:50:20.515 INFO:tasks.ceph.mon.a:Started 2024-03-04T08:50:20.515 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-04T08:50:20.515 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-04T08:50:20.555 INFO:tasks.ceph.mon.b:Started 2024-03-04T08:50:20.555 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-04T08:50:20.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-04T08:50:20.557 INFO:tasks.ceph.mon.c:Started 2024-03-04T08:50:20.557 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-04T08:50:20.557 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-04T08:50:20.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-04T08:50:20.559 INFO:tasks.ceph.mgr.y:Started 2024-03-04T08:50:20.560 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-04T08:50:20.560 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-04T08:50:20.562 INFO:tasks.ceph.mgr.x:Started 2024-03-04T08:50:20.562 INFO:tasks.ceph:Setting crush tunables to default 2024-03-04T08:50:20.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-03-04T08:50:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.668+0000 7fbdf4d8a640 1 Processor -- start 2024-03-04T08:50:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.668+0000 7fbdf4d8a640 1 -- start start 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdf4d8a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdf0168c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdf4d8a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00d4cb0 con 0x7fbdf00d4480 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdf4d8a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00cf420 con 0x7fbdf0161440 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdf4d8a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00d49d0 con 0x7fbdf00c89d0 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdedd9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbdf00d4480 0x7fbdf00d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50562/0 (socket says 172.21.15.19:50562) 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdedd9b640 1 -- 172.21.15.19:0/382834514 learned_addr learned my addr 172.21.15.19:0/382834514 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdf0168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 msgr2=0x7fbdf0168c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 msgr2=0x7fbdf0168c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdf0168c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T08:50:20.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.669+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdf0168c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T08:50:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.856+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021065538 0 0) 0x7fbdf00d4cb0 con 0x7fbdf00d4480 2024-03-04T08:50:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.856+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd8003520 con 0x7fbdf00d4480 2024-03-04T08:50:20.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327249470 0 0) 0x7fbdd8003520 con 0x7fbdf00d4480 2024-03-04T08:50:20.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 msgr2=0x7fbdf0168c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:50:20.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdf0168c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 >> v1:172.21.15.204:6789/0 conn(0x7fbdf0161440 legacy=0x7fbdf00d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00cf6c0 con 0x7fbdf00d4480 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fbde4001670 con 0x7fbdf00d4480 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 >> v1:172.21.15.19:6789/0 conn(0x7fbdf00d4480 legacy=0x7fbdf00d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd80039e0 0x7fbdd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8004db0 0x7fbdd8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00d49d0 con 0x7fbdd8004db0 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd800bc90 con 0x7fbdd80039e0 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd800be90 con 0x7fbdf00c89d0 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8004db0 0x7fbdd8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdee59c640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd80039e0 0x7fbdd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdedd9b640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 msgr2=0x7fbdd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00c89d0 0x7fbdd8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd80039e0 msgr2=0x7fbdd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd80039e0 0x7fbdd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.857+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8003520 con 0x7fbdd8004db0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.858+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8004db0 0x7fbdd8005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009fc0 tx=0x7fbdd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc9e3ba61e60ba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.858+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8039070 con 0x7fbdd8004db0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.858+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde802cbc0 con 0x7fbdd8004db0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.858+0000 7fbded59a640 1 -- 172.21.15.19:0/382834514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009bc0 con 0x7fbdd8004db0 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/382834514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8004db0 msgr2=0x7fbdd8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 --2- 172.21.15.19:0/382834514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8004db0 0x7fbdd8005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009fc0 tx=0x7fbdd8005830 comp rx=0 tx=0).stop 2024-03-04T08:50:20.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdeed9d640 1 -- 172.21.15.19:0/382834514 reap_dead start 2024-03-04T08:50:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/382834514 shutdown_connections 2024-03-04T08:50:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/382834514 >> 172.21.15.19:0/382834514 conn(0x7fbdf009d030 msgr2=0x7fbdf00d3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/382834514 shutdown_connections 2024-03-04T08:50:20.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.859+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/382834514 wait complete. 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.861+0000 7fbdf4d8a640 1 Processor -- start 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.861+0000 7fbdf4d8a640 1 -- start start 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd8004db0 0x7fbdf015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf00b0a00 0x7fbdf00b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01619a0 con 0x7fbdf00b0a00 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0161820 con 0x7fbdd8004db0 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdf4d8a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00d1590 con 0x7fbdf00b9540 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:47256/0 (socket says 172.21.15.19:47256) 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 -- 172.21.15.19:0/3789700965 learned_addr learned my addr 172.21.15.19:0/3789700965 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:20.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdeed9d640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf00b0a00 0x7fbdf00b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdee59c640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd8004db0 0x7fbdf015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 -- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd8004db0 msgr2=0x7fbdf015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd8004db0 0x7fbdf015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 -- 172.21.15.19:0/3789700965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf00b0a00 msgr2=0x7fbdf00b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf00b0a00 0x7fbdf00b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 -- 172.21.15.19:0/3789700965 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00b3cf0 con 0x7fbdf00b9540 2024-03-04T08:50:20.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.862+0000 7fbdedd9b640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbde40072c0 tx=0x7fbde40076c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:20.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400f960 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4018070 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00b3fd0 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400fd40 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf015cf40 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbde401d460 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.866+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbde40136b0 con 0x7fbdf00b9540 2024-03-04T08:50:20.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.867+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf004f330 con 0x7fbdf00b9540 2024-03-04T08:50:20.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.874+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbde4013900 con 0x7fbdf00b9540 2024-03-04T08:50:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.940+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbdf00d0580 con 0x7fbdf00b9540 2024-03-04T08:50:20.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.949+0000 7fbddeffd640 1 -- 172.21.15.19:0/3789700965 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbde4013ae0 con 0x7fbdf00b9540 2024-03-04T08:50:20.945 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.949+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 msgr2=0x7fbdf00cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.949+0000 7fbdf4d8a640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbde40072c0 tx=0x7fbde40076c0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.949+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 shutdown_connections 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf00b0a00 0x7fbdf00b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf00b9540 0x7fbdf00cd560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 --2- 172.21.15.19:0/3789700965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdd8004db0 0x7fbdf015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 >> 172.21.15.19:0/3789700965 conn(0x7fbdf009d030 msgr2=0x7fbdf0160710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 shutdown_connections 2024-03-04T08:50:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:20.950+0000 7fbdf4d8a640 1 -- 172.21.15.19:0/3789700965 wait complete. 2024-03-04T08:50:20.956 INFO:tasks.ceph:check_enable_crimson: False 2024-03-04T08:50:20.956 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-04T08:50:20.957 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:20.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-04T08:50:20.984 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:20.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-04T08:50:21.051 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:21.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-04T08:50:21.118 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:50:21.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-04T08:50:21.185 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:21.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-04T08:50:21.213 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:21.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-04T08:50:21.279 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:21.280 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-04T08:50:21.338 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:21.342+0000 7f0a0786c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T08:50:21.346 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:50:21.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-04T08:50:21.348 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:21.351+0000 7fe864efa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T08:50:21.375 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new e8e90047-e5b7-4a7f-b7d2-ed007ee685ae 0 2024-03-04T08:50:21.394 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:21.398+0000 7f0a0786c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T08:50:21.406 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:21.409+0000 7fe864efa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T08:50:21.505 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.508+0000 7f3abf93e640 1 Processor -- start 2024-03-04T08:50:21.506 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.509+0000 7f3abf93e640 1 -- start start 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.509+0000 7f3abf93e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.509+0000 7f3abf93e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8072390 con 0x7f3ab80b42e0 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.509+0000 7f3abf93e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab80b46c0 con 0x7f3ab815ad90 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.509+0000 7f3abf93e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab815c020 con 0x7f3ab8071a70 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53196/0 (socket says 172.21.15.204:53196) 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 -- 172.21.15.204:0/3911472700 learned_addr learned my addr 172.21.15.204:0/3911472700 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3aaffff640 1 -- 172.21.15.204:0/3911472700 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634490734 0 0) 0x7f3ab80b46c0 con 0x7f3ab815ad90 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3aaffff640 1 -- 172.21.15.204:0/3911472700 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa4003520 con 0x7f3ab815ad90 2024-03-04T08:50:21.507 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 -- 172.21.15.204:0/3911472700 >> v1:172.21.15.204:6789/0 conn(0x7f3ab815ad90 legacy=0x7f3ab80b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.508 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 -- 172.21.15.204:0/3911472700 >> v1:172.21.15.19:6789/0 conn(0x7f3ab80b42e0 legacy=0x7f3ab815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.508 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.510+0000 7f3abd6da640 1 -- 172.21.15.204:0/3911472700 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab815b260 con 0x7f3ab8071a70 2024-03-04T08:50:21.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abd6da640 1 --2- 172.21.15.204:0/3911472700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80098a0 tx=0x7f3aa802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4067e21946bb6ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3aaffff640 1 -- 172.21.15.204:0/3911472700 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8034070 con 0x7f3ab8071a70 2024-03-04T08:50:21.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3aaffff640 1 -- 172.21.15.204:0/3911472700 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa8030840 con 0x7f3ab8071a70 2024-03-04T08:50:21.509 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3aaffff640 1 -- 172.21.15.204:0/3911472700 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8030c10 con 0x7f3ab8071a70 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abf93e640 1 -- 172.21.15.204:0/3911472700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 msgr2=0x7f3ab8071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abf93e640 1 --2- 172.21.15.204:0/3911472700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80098a0 tx=0x7f3aa802b980 comp rx=0 tx=0).stop 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abf93e640 1 -- 172.21.15.204:0/3911472700 shutdown_connections 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abf93e640 1 --2- 172.21.15.204:0/3911472700 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab8071a70 0x7f3ab8071e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.511+0000 7f3abf93e640 1 -- 172.21.15.204:0/3911472700 >> 172.21.15.204:0/3911472700 conn(0x7f3ab80b2660 msgr2=0x7f3ab80b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.512+0000 7f3abf93e640 1 -- 172.21.15.204:0/3911472700 shutdown_connections 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.512+0000 7f3abf93e640 1 -- 172.21.15.204:0/3911472700 wait complete. 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 Processor -- start 2024-03-04T08:50:21.510 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 -- start start 2024-03-04T08:50:21.513 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab8071a70 0x7f3ab81e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 0x7f3ab8155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 0x7f3ab81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab815bb00 con 0x7f3ab8071a70 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab815b820 con 0x7f3ab80b42e0 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abf93e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab815c920 con 0x7f3ab815ad90 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abced9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 0x7f3ab8155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abdedb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 0x7f3ab81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.513+0000 7f3abced9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 0x7f3ab8155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48100/0 (socket says 172.21.15.204:48100) 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abced9640 1 -- 172.21.15.204:0/1017393105 learned_addr learned my addr 172.21.15.204:0/1017393105 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.514 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abd6da640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab8071a70 0x7f3ab81e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 -- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 msgr2=0x7f3ab8155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 0x7f3ab8155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 -- 172.21.15.204:0/1017393105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab8071a70 msgr2=0x7f3ab81e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab8071a70 0x7f3ab81e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 -- 172.21.15.204:0/1017393105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8156270 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abdedb640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 0x7f3ab81526c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c690 tx=0x7f3ab000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0003b70 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab0003d10 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab81e5430 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0005310 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab81e59f0 con 0x7f3ab815ad90 2024-03-04T08:50:21.515 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3ab00054b0 con 0x7f3ab815ad90 2024-03-04T08:50:21.516 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.514+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3ab000a980 con 0x7f3ab815ad90 2024-03-04T08:50:21.516 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.515+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8073390 con 0x7f3ab815ad90 2024-03-04T08:50:21.516 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.517+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3ab00057a0 con 0x7f3ab815ad90 2024-03-04T08:50:21.586 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.589+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e8e90047-e5b7-4a7f-b7d2-ed007ee685ae", "id": 0} v 0) v1 -- 0x7f3ab80741c0 con 0x7f3ab815ad90 2024-03-04T08:50:21.589 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.592+0000 7f3aadffb640 1 -- 172.21.15.204:0/1017393105 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8e90047-e5b7-4a7f-b7d2-ed007ee685ae", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ab000ab80 con 0x7f3ab815ad90 2024-03-04T08:50:21.589 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-03-04T08:50:21.590 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 msgr2=0x7f3ab81526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.590 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 0x7f3ab81526c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000c690 tx=0x7f3ab000cb50 comp rx=0 tx=0).stop 2024-03-04T08:50:21.590 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 shutdown_connections 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3ab815ad90 0x7f3ab81526c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3ab80b42e0 0x7f3ab8155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 --2- 172.21.15.204:0/1017393105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab8071a70 0x7f3ab81e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 >> 172.21.15.204:0/1017393105 conn(0x7f3ab80b2660 msgr2=0x7f3ab806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 shutdown_connections 2024-03-04T08:50:21.591 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.593+0000 7f3abf93e640 1 -- 172.21.15.204:0/1017393105 wait complete. 2024-03-04T08:50:21.601 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new f2f71ed6-dc7f-45e9-845e-bf6537dc8fff 1 2024-03-04T08:50:21.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.704+0000 7f5d85d3a640 1 Processor -- start 2024-03-04T08:50:21.701 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.704+0000 7f5d85d3a640 1 -- start start 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d85d3a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d8006b9a0 0x7f5d800ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d85d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d85d3a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d80072e90 con 0x7f5d8006bd80 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d85d3a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d801619c0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d85d3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800cfed0 con 0x7f5d800b5e20 2024-03-04T08:50:21.703 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53220/0 (socket says 172.21.15.204:53220) 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 -- 172.21.15.204:0/3087505774 learned_addr learned my addr 172.21.15.204:0/3087505774 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d7f7fe640 1 --2- 172.21.15.204:0/3087505774 >> v2:172.21.15.19:3300/0 conn(0x7f5d8006b9a0 0x7f5d800ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 -- 172.21.15.204:0/3087505774 >> v2:172.21.15.19:3300/0 conn(0x7f5d8006b9a0 msgr2=0x7f5d800ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 --2- 172.21.15.204:0/3087505774 >> v2:172.21.15.19:3300/0 conn(0x7f5d8006b9a0 0x7f5d800ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 -- 172.21.15.204:0/3087505774 >> v1:172.21.15.19:6789/0 conn(0x7f5d8006bd80 legacy=0x7f5d8006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.705+0000 7f5d77fff640 1 -- 172.21.15.204:0/3087505774 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80073170 con 0x7f5d800b5e20 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.706+0000 7f5d77fff640 1 --2- 172.21.15.204:0/3087505774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009870 tx=0x7f5d6802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2333971013378208 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.706+0000 7f5d7effd640 1 -- 172.21.15.204:0/3087505774 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680317c0 con 0x7f5d800b5e20 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.706+0000 7f5d7effd640 1 -- 172.21.15.204:0/3087505774 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68037070 con 0x7f5d800b5e20 2024-03-04T08:50:21.704 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.706+0000 7f5d7effd640 1 -- 172.21.15.204:0/3087505774 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68031b80 con 0x7f5d800b5e20 2024-03-04T08:50:21.707 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 -- 172.21.15.204:0/3087505774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 msgr2=0x7f5d80072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/3087505774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009870 tx=0x7f5d6802b860 comp rx=0 tx=0).stop 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 -- 172.21.15.204:0/3087505774 shutdown_connections 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/3087505774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d800b5e20 0x7f5d80072590 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/3087505774 >> v2:172.21.15.19:3300/0 conn(0x7f5d8006b9a0 0x7f5d800ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 -- 172.21.15.204:0/3087505774 >> 172.21.15.204:0/3087505774 conn(0x7f5d800b4fe0 msgr2=0x7f5d800b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 -- 172.21.15.204:0/3087505774 shutdown_connections 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.707+0000 7f5d85d3a640 1 -- 172.21.15.204:0/3087505774 wait complete. 2024-03-04T08:50:21.708 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.708+0000 7f5d85d3a640 1 Processor -- start 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.708+0000 7f5d85d3a640 1 -- start start 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d8006bd80 0x7f5d800ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d800b5e20 0x7f5d8015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ad6a0 con 0x7f5d800b5e20 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800d0120 con 0x7f5d8006bd80 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d85d3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800c95a0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53224/0 (socket says 172.21.15.204:53224) 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 -- 172.21.15.204:0/2356762089 learned_addr learned my addr 172.21.15.204:0/2356762089 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d77fff640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d8006bd80 0x7f5d800ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.709 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7ffff640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d800b5e20 0x7f5d8015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 -- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d8006bd80 msgr2=0x7f5d800ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d8006bd80 0x7f5d800ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 -- 172.21.15.204:0/2356762089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d800b5e20 msgr2=0x7f5d8015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d800b5e20 0x7f5d8015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 -- 172.21.15.204:0/2356762089 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d801f7a10 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.709+0000 7f5d7f7fe640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d620 tx=0x7f5d7000dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000b620 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70019070 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000ba00 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d801f7cf0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d800cb760 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5d7000bba0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.710 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.710+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5d700148b0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.711 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.711+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8009e4e0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.711 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.713+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5d70014b00 con 0x7f5d8006b9a0 2024-03-04T08:50:21.781 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.785+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2f71ed6-dc7f-45e9-845e-bf6537dc8fff", "id": 1} v 0) v1 -- 0x7f5d8006ee90 con 0x7f5d8006b9a0 2024-03-04T08:50:21.785 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.788+0000 7f5d7cff9640 1 -- 172.21.15.204:0/2356762089 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2f71ed6-dc7f-45e9-845e-bf6537dc8fff", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d70014db0 con 0x7f5d8006b9a0 2024-03-04T08:50:21.785 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-04T08:50:21.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 msgr2=0x7f5d800cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d620 tx=0x7f5d7000dae0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 shutdown_connections 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d800b5e20 0x7f5d8015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d8006bd80 0x7f5d800ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 --2- 172.21.15.204:0/2356762089 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d8006b9a0 0x7f5d800cb220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 >> 172.21.15.204:0/2356762089 conn(0x7f5d800b4fe0 msgr2=0x7f5d800b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 shutdown_connections 2024-03-04T08:50:21.787 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.789+0000 7f5d85d3a640 1 -- 172.21.15.204:0/2356762089 wait complete. 2024-03-04T08:50:21.796 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 1589294e-bb68-4e20-9909-62aae9312f53 2 2024-03-04T08:50:21.899 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.902+0000 7f94cb839640 1 Processor -- start 2024-03-04T08:50:21.899 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.902+0000 7f94cb839640 1 -- start start 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94c415c090 0x7f94c40b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f94c415fb70 0x7f94c40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 0x7f94c406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40cddc0 con 0x7f94c415c090 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c415c470 con 0x7f94c415fb70 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94cb839640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4160000 con 0x7f94c40cf120 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f94c415fb70 0x7f94c40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c9dd6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 0x7f94c406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.901 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f94c415fb70 0x7f94c40cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48126/0 (socket says 172.21.15.204:48126) 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 -- 172.21.15.204:0/416659034 learned_addr learned my addr 172.21.15.204:0/416659034 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c95d5640 1 --2- 172.21.15.204:0/416659034 >> v2:172.21.15.19:3300/0 conn(0x7f94c415c090 0x7f94c40b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 -- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 msgr2=0x7f94c406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 0x7f94c406f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 -- 172.21.15.204:0/416659034 >> v2:172.21.15.19:3300/0 conn(0x7f94c415c090 msgr2=0x7f94c40b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 --2- 172.21.15.204:0/416659034 >> v2:172.21.15.19:3300/0 conn(0x7f94c415c090 0x7f94c40b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c8dd4640 1 -- 172.21.15.204:0/416659034 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c41602a0 con 0x7f94c415fb70 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.903+0000 7f94c9dd6640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 0x7f94c406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.904+0000 7f94c8dd4640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c415fb70 0x7f94c40cebe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f94c415fad0 tx=0x7f94b402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f801fa00b3855cd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.904+0000 7f94bbfff640 1 -- 172.21.15.204:0/416659034 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4035020 con 0x7f94c415fb70 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.904+0000 7f94bbfff640 1 -- 172.21.15.204:0/416659034 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4031870 con 0x7f94c415fb70 2024-03-04T08:50:21.902 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.904+0000 7f94bbfff640 1 -- 172.21.15.204:0/416659034 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4031c40 con 0x7f94c415fb70 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 -- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c415fb70 msgr2=0x7f94c40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c415fb70 0x7f94c40cebe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f94c415fad0 tx=0x7f94b402b910 comp rx=0 tx=0).stop 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 -- 172.21.15.204:0/416659034 shutdown_connections 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c40cf120 0x7f94c406f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 --2- 172.21.15.204:0/416659034 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c415fb70 0x7f94c40cebe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.905 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 --2- 172.21.15.204:0/416659034 >> v2:172.21.15.19:3300/0 conn(0x7f94c415c090 0x7f94c40b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 -- 172.21.15.204:0/416659034 >> 172.21.15.204:0/416659034 conn(0x7f94c40b3800 msgr2=0x7f94c40b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 -- 172.21.15.204:0/416659034 shutdown_connections 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.905+0000 7f94cb839640 1 -- 172.21.15.204:0/416659034 wait complete. 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.906+0000 7f94cb839640 1 Processor -- start 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.906+0000 7f94cb839640 1 -- start start 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c415c090 0x7f94c409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c415fb70 0x7f94c41e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c406f5f0 con 0x7f94c415c090 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4160860 con 0x7f94c40cf120 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94cb839640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c406f770 con 0x7f94c415fb70 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48140/0 (socket says 172.21.15.204:48140) 2024-03-04T08:50:21.906 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 -- 172.21.15.204:0/3979318762 learned_addr learned my addr 172.21.15.204:0/3979318762 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c9dd6640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c415fb70 0x7f94c41e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c8dd4640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c415c090 0x7f94c409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 -- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c415fb70 msgr2=0x7f94c41e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c415fb70 0x7f94c41e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 -- 172.21.15.204:0/3979318762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c415c090 msgr2=0x7f94c409cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c415c090 0x7f94c409cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.907+0000 7f94c95d5640 1 -- 172.21.15.204:0/3979318762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c409f090 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94c95d5640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94c000e9b0 tx=0x7f94c000edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0017070 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000c940 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c409f370 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000cd30 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c409f930 con 0x7f94c40cf120 2024-03-04T08:50:21.907 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f94c001a070 con 0x7f94c40cf120 2024-03-04T08:50:21.908 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.908+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f94c001c900 con 0x7f94c40cf120 2024-03-04T08:50:21.908 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.909+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c409fe60 con 0x7f94c40cf120 2024-03-04T08:50:21.910 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.913+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f94c001c4a0 con 0x7f94c40cf120 2024-03-04T08:50:21.948 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:21.952+0000 7f0a0786c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T08:50:21.974 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:21.977+0000 7fe864efa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T08:50:21.982 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.986+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1589294e-bb68-4e20-9909-62aae9312f53", "id": 2} v 0) v1 -- 0x7f94c406e980 con 0x7f94c40cf120 2024-03-04T08:50:21.988 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.992+0000 7f94b9ffb640 1 -- 172.21.15.204:0/3979318762 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1589294e-bb68-4e20-9909-62aae9312f53", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f94c001cb50 con 0x7f94c40cf120 2024-03-04T08:50:21.988 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.992+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 msgr2=0x7f94c409ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.992+0000 7f94cb839640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94c000e9b0 tx=0x7f94c000edb0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 shutdown_connections 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f94c415fb70 0x7f94c41e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94c415c090 0x7f94c409cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 --2- 172.21.15.204:0/3979318762 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f94c40cf120 0x7f94c409ea20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 >> 172.21.15.204:0/3979318762 conn(0x7f94c40b3800 msgr2=0x7f94c40aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 shutdown_connections 2024-03-04T08:50:21.990 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:21.993+0000 7f94cb839640 1 -- 172.21.15.204:0/3979318762 wait complete. 2024-03-04T08:50:22.000 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 20a952bf-0f60-459d-b04d-1a509093e413 3 2024-03-04T08:50:22.005 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.009+0000 7f0a0786c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T08:50:22.033 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.036+0000 7fe864efa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T08:50:22.052 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.055+0000 7f0a0786c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T08:50:22.081 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.084+0000 7fe864efa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T08:50:22.101 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.104+0000 7fc276355640 1 Processor -- start 2024-03-04T08:50:22.101 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.104+0000 7fc276355640 1 -- start start 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 0x7fc27006afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc27015c8a0 0x7fc2700d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27006b950 con 0x7fc270145650 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27015d120 con 0x7fc27015c8a0 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc276355640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27015f840 con 0x7fc27006b4f0 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.103 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53252/0 (socket says 172.21.15.204:53252) 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 -- 172.21.15.204:0/2178567751 learned_addr learned my addr 172.21.15.204:0/2178567751 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc2748f2640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.204:3300/0 conn(0x7fc27015c8a0 0x7fc2700d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26ffff640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 0x7fc27006afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 -- 172.21.15.204:0/2178567751 >> v2:172.21.15.204:3300/0 conn(0x7fc27015c8a0 msgr2=0x7fc2700d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.204:3300/0 conn(0x7fc27015c8a0 0x7fc2700d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 -- 172.21.15.204:0/2178567751 >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 msgr2=0x7fc27006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 0x7fc27006afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26f7fe640 1 -- 172.21.15.204:0/2178567751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27015fb20 con 0x7fc27006b4f0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.105+0000 7fc26ffff640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 0x7fc27006afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.106+0000 7fc26f7fe640 1 --2- 172.21.15.204:0/2178567751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2700d1a20 tx=0x7fc26002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1edaf854f926ea server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.106+0000 7fc26effd640 1 -- 172.21.15.204:0/2178567751 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260035020 con 0x7fc27006b4f0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.106+0000 7fc26effd640 1 -- 172.21.15.204:0/2178567751 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260031870 con 0x7fc27006b4f0 2024-03-04T08:50:22.104 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.106+0000 7fc26effd640 1 -- 172.21.15.204:0/2178567751 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260031c40 con 0x7fc27006b4f0 2024-03-04T08:50:22.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 -- 172.21.15.204:0/2178567751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 msgr2=0x7fc27015c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 --2- 172.21.15.204:0/2178567751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2700d1a20 tx=0x7fc26002b910 comp rx=0 tx=0).stop 2024-03-04T08:50:22.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 -- 172.21.15.204:0/2178567751 shutdown_connections 2024-03-04T08:50:22.107 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.204:3300/0 conn(0x7fc27015c8a0 0x7fc2700d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 --2- 172.21.15.204:0/2178567751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27006b4f0 0x7fc27015c360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 --2- 172.21.15.204:0/2178567751 >> v2:172.21.15.19:3300/0 conn(0x7fc270145650 0x7fc27006afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 -- 172.21.15.204:0/2178567751 >> 172.21.15.204:0/2178567751 conn(0x7fc27006c0c0 msgr2=0x7fc27006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 -- 172.21.15.204:0/2178567751 shutdown_connections 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.107+0000 7fc276355640 1 -- 172.21.15.204:0/2178567751 wait complete. 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.108+0000 7fc276355640 1 Processor -- start 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.108+0000 7fc276355640 1 -- start start 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc27006b4f0 0x7fc2701e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 0x7fc270139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270160600 con 0x7fc27006b4f0 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701600e0 con 0x7fc270145650 2024-03-04T08:50:22.108 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc276355640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27015cd30 con 0x7fc27015c8a0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc26f7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 0x7fc270139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53264/0 (socket says 172.21.15.204:53264) 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 -- 172.21.15.204:0/2472286170 learned_addr learned my addr 172.21.15.204:0/2472286170 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc26ffff640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc27006b4f0 0x7fc2701e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 -- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 msgr2=0x7fc270139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 0x7fc270139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 -- 172.21.15.204:0/2472286170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc27006b4f0 msgr2=0x7fc2701e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc27006b4f0 0x7fc2701e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 -- 172.21.15.204:0/2472286170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27013d750 con 0x7fc27015c8a0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc26f7fe640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 0x7fc270139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.109+0000 7fc2748f2640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc26800efc0 tx=0x7fc26800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268018020 con 0x7fc27015c8a0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc268014480 con 0x7fc27015c8a0 2024-03-04T08:50:22.109 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268014870 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc270137940 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27013da30 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc268005d10 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.110+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc268013870 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.111+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2700733b0 con 0x7fc27015c8a0 2024-03-04T08:50:22.110 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.111+0000 7f0a0786c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T08:50:22.111 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.114+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc268022070 con 0x7fc27015c8a0 2024-03-04T08:50:22.140 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.143+0000 7fe864efa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T08:50:22.151 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.155+0000 7f0a0786c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T08:50:22.182 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.186+0000 7fe864efa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T08:50:22.182 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.186+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "20a952bf-0f60-459d-b04d-1a509093e413", "id": 3} v 0) v1 -- 0x7fc270068ff0 con 0x7fc27015c8a0 2024-03-04T08:50:22.188 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.191+0000 7fc26cff9640 1 -- 172.21.15.204:0/2472286170 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20a952bf-0f60-459d-b04d-1a509093e413", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc268010040 con 0x7fc27015c8a0 2024-03-04T08:50:22.188 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-03-04T08:50:22.189 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 msgr2=0x7fc27013cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc26800efc0 tx=0x7fc26800c490 comp rx=0 tx=0).stop 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 shutdown_connections 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc27015c8a0 0x7fc27013cd70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc270145650 0x7fc270139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 --2- 172.21.15.204:0/2472286170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc27006b4f0 0x7fc2701e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 >> 172.21.15.204:0/2472286170 conn(0x7fc27006c0c0 msgr2=0x7fc27006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 shutdown_connections 2024-03-04T08:50:22.190 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.192+0000 7fc276355640 1 -- 172.21.15.204:0/2472286170 wait complete. 2024-03-04T08:50:22.199 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 975b0a21-9fbb-4788-8495-f1200e3ffdb2 4 2024-03-04T08:50:22.272 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.276+0000 7f0a0786c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T08:50:22.305 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.308+0000 7fe864efa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T08:50:22.341 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.344+0000 7f3155102640 1 Processor -- start 2024-03-04T08:50:22.341 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.344+0000 7f3155102640 1 -- start start 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f3155102640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f31500affc0 0x7f31500b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f3155102640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31500b3960 con 0x7f315006f2b0 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f3155102640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315006f850 con 0x7f31500afbe0 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f3155102640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315015e430 con 0x7f31500affc0 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314e59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f31500affc0 0x7f31500b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314ed9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f31500afbe0 0x7f315006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:40312/0 (socket says 172.21.15.204:40312) 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314ed9d640 1 -- 172.21.15.204:0/3681876540 learned_addr learned my addr 172.21.15.204:0/3681876540 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314e59c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f31500affc0 0x7f31500b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48162/0 (socket says 172.21.15.204:48162) 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314e59c640 1 -- 172.21.15.204:0/3681876540 >> v1:172.21.15.204:6789/0 conn(0x7f31500afbe0 legacy=0x7f315006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314e59c640 1 -- 172.21.15.204:0/3681876540 >> v1:172.21.15.19:6789/0 conn(0x7f315006f2b0 legacy=0x7f315006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.345+0000 7f314e59c640 1 -- 172.21.15.204:0/3681876540 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500b3c20 con 0x7f31500affc0 2024-03-04T08:50:22.343 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f314e59c640 1 --2- 172.21.15.204:0/3681876540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500b5550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31440097a0 tx=0x7f314402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99df841bdb6f8ca server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.344 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f314dd9b640 1 -- 172.21.15.204:0/3681876540 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144034070 con 0x7f31500affc0 2024-03-04T08:50:22.344 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f314dd9b640 1 -- 172.21.15.204:0/3681876540 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144030610 con 0x7f31500affc0 2024-03-04T08:50:22.344 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f314dd9b640 1 -- 172.21.15.204:0/3681876540 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31440309e0 con 0x7f31500affc0 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f3155102640 1 -- 172.21.15.204:0/3681876540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 msgr2=0x7f31500b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.346+0000 7f3155102640 1 --2- 172.21.15.204:0/3681876540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500b5550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31440097a0 tx=0x7f314402b960 comp rx=0 tx=0).stop 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.347+0000 7f3155102640 1 -- 172.21.15.204:0/3681876540 shutdown_connections 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.347+0000 7f3155102640 1 --2- 172.21.15.204:0/3681876540 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500b5550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.347+0000 7f3155102640 1 -- 172.21.15.204:0/3681876540 >> 172.21.15.204:0/3681876540 conn(0x7f315006c0c0 msgr2=0x7f315006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.347+0000 7f3155102640 1 -- 172.21.15.204:0/3681876540 shutdown_connections 2024-03-04T08:50:22.345 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.347+0000 7f3155102640 1 -- 172.21.15.204:0/3681876540 wait complete. 2024-03-04T08:50:22.346 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.348+0000 7f0a0786c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T08:50:22.346 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.349+0000 7f3155102640 1 Processor -- start 2024-03-04T08:50:22.346 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.349+0000 7f3155102640 1 -- start start 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31500afbe0 0x7f31500b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500726e0 con 0x7f31500afbe0 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315006e130 con 0x7f31500affc0 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f3155102640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315006b6c0 con 0x7f315006f2b0 2024-03-04T08:50:22.349 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314f59e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53276/0 (socket says 172.21.15.204:53276) 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314f59e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48164/0 (socket says 172.21.15.204:48164) 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 -- 172.21.15.204:0/2720030395 learned_addr learned my addr 172.21.15.204:0/2720030395 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314e59c640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31500afbe0 0x7f31500b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 -- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 msgr2=0x7f31500cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 -- 172.21.15.204:0/2720030395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31500afbe0 msgr2=0x7f31500b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31500afbe0 0x7f31500b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.350+0000 7f314ed9d640 1 -- 172.21.15.204:0/2720030395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150155d30 con 0x7f315006f2b0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f314f59e640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f314ed9d640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f314000c4a0 tx=0x7f314000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140017070 con 0x7f315006f2b0 2024-03-04T08:50:22.350 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140005ce0 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315014a970 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140007270 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31501562b0 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f314001a070 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.351+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f314001cc60 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.352+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150072c80 con 0x7f315006f2b0 2024-03-04T08:50:22.351 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.354+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3150072c80 con 0x7f315006f2b0 2024-03-04T08:50:22.381 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.384+0000 7fe864efa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T08:50:22.392 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.396+0000 7f0a0786c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T08:50:22.423 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.427+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "975b0a21-9fbb-4788-8495-f1200e3ffdb2", "id": 4} v 0) v1 -- 0x7f31500733b0 con 0x7f315006f2b0 2024-03-04T08:50:22.429 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.432+0000 7f31377fe640 1 -- 172.21.15.204:0/2720030395 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "975b0a21-9fbb-4788-8495-f1200e3ffdb2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3140007530 con 0x7f315006f2b0 2024-03-04T08:50:22.429 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-03-04T08:50:22.430 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.433+0000 7fe864efa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 msgr2=0x7f315014a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f314000c4a0 tx=0x7f314000c960 comp rx=0 tx=0).stop 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 shutdown_connections 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f31500affc0 0x7f31500cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31500afbe0 0x7f31500b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 --2- 172.21.15.204:0/2720030395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f315006f2b0 0x7f315014a430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.433+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 >> 172.21.15.204:0/2720030395 conn(0x7f315006c0c0 msgr2=0x7f315015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.434+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 shutdown_connections 2024-03-04T08:50:22.431 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.434+0000 7f3155102640 1 -- 172.21.15.204:0/2720030395 wait complete. 2024-03-04T08:50:22.441 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new bf747fb4-fb6f-4027-ba5c-a1614134d157 5 2024-03-04T08:50:22.447 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.451+0000 7f0a0786c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T08:50:22.486 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.489+0000 7fe864efa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T08:50:22.496 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.500+0000 7f0a0786c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T08:50:22.536 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.540+0000 7fe864efa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T08:50:22.542 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.545+0000 7faf019a2640 1 Processor -- start 2024-03-04T08:50:22.542 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.545+0000 7faf019a2640 1 -- start start 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf019a2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faefc15ba70 0x7faefc071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf019a2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faefc06b6c0 0x7faefc0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf019a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc06f310 con 0x7faefc0afd80 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf019a2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc06fbb0 con 0x7faefc15ba70 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf019a2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc06f5f0 con 0x7faefc06b6c0 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf011a1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faefc06b6c0 0x7faefc0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf011a1640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faefc06b6c0 0x7faefc0b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48170/0 (socket says 172.21.15.204:48170) 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.546+0000 7faf011a1640 1 -- 172.21.15.204:0/4237611527 learned_addr learned my addr 172.21.15.204:0/4237611527 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf009a0640 1 --2- 172.21.15.204:0/4237611527 >> v2:172.21.15.19:3300/0 conn(0x7faefc15ba70 0x7faefc071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.544 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf011a1640 1 -- 172.21.15.204:0/4237611527 >> v2:172.21.15.19:3300/0 conn(0x7faefc15ba70 msgr2=0x7faefc071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:22.545 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf011a1640 1 --2- 172.21.15.204:0/4237611527 >> v2:172.21.15.19:3300/0 conn(0x7faefc15ba70 0x7faefc071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.545 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf011a1640 1 -- 172.21.15.204:0/4237611527 >> v1:172.21.15.19:6789/0 conn(0x7faefc0afd80 legacy=0x7faefc06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.545 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf011a1640 1 -- 172.21.15.204:0/4237611527 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc06f8d0 con 0x7faefc06b6c0 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.547+0000 7faf011a1640 1 --2- 172.21.15.204:0/4237611527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc0b3bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faefc071900 tx=0x7faef402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e148ea49eefb0ef7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.548+0000 7faefb7fe640 1 -- 172.21.15.204:0/4237611527 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef402ca80 con 0x7faefc06b6c0 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.548+0000 7faefb7fe640 1 -- 172.21.15.204:0/4237611527 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef402cc20 con 0x7faefc06b6c0 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.548+0000 7faefb7fe640 1 -- 172.21.15.204:0/4237611527 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef40343f0 con 0x7faefc06b6c0 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.548+0000 7faf019a2640 1 -- 172.21.15.204:0/4237611527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 msgr2=0x7faefc0b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.548+0000 7faf019a2640 1 --2- 172.21.15.204:0/4237611527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc0b3bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faefc071900 tx=0x7faef402bee0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.546 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 -- 172.21.15.204:0/4237611527 shutdown_connections 2024-03-04T08:50:22.547 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 --2- 172.21.15.204:0/4237611527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc0b3bb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.547 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 --2- 172.21.15.204:0/4237611527 >> v2:172.21.15.19:3300/0 conn(0x7faefc15ba70 0x7faefc071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.547 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 -- 172.21.15.204:0/4237611527 >> 172.21.15.204:0/4237611527 conn(0x7faefc0b2510 msgr2=0x7faefc0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.547 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 -- 172.21.15.204:0/4237611527 shutdown_connections 2024-03-04T08:50:22.547 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.549+0000 7faf019a2640 1 -- 172.21.15.204:0/4237611527 wait complete. 2024-03-04T08:50:22.549 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.550+0000 7faf019a2640 1 Processor -- start 2024-03-04T08:50:22.549 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.550+0000 7faf019a2640 1 -- start start 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faefc0afd80 0x7faefc147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faefc15ba70 0x7faefc147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0721d0 con 0x7faefc15ba70 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc15be50 con 0x7faefc06b6c0 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0b40f0 con 0x7faefc0afd80 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48184/0 (socket says 172.21.15.204:48184) 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 -- 172.21.15.204:0/3998919322 learned_addr learned my addr 172.21.15.204:0/3998919322 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faefbfff640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faefc0afd80 0x7faefc147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf011a1640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faefc15ba70 0x7faefc147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 -- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faefc0afd80 msgr2=0x7faefc147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faefc0afd80 0x7faefc147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.550 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 -- 172.21.15.204:0/3998919322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faefc15ba70 msgr2=0x7faefc147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faefc15ba70 0x7faefc147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 -- 172.21.15.204:0/3998919322 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc147790 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf009a0640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faef000e870 tx=0x7faef000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0017070 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000c940 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000cd30 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc0af010 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.551+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc1488e0 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.552+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7faef001a070 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.552+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faef00064d0 con 0x7faefc06b6c0 2024-03-04T08:50:22.551 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.552+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc068f10 con 0x7faefc06b6c0 2024-03-04T08:50:22.552 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.555+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7faef00067b0 con 0x7faefc06b6c0 2024-03-04T08:50:22.623 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.626+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf747fb4-fb6f-4027-ba5c-a1614134d157", "id": 5} v 0) v1 -- 0x7faefc0b5630 con 0x7faefc06b6c0 2024-03-04T08:50:22.628 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.632+0000 7faef97fa640 1 -- 172.21.15.204:0/3998919322 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf747fb4-fb6f-4027-ba5c-a1614134d157", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faef0005990 con 0x7faefc06b6c0 2024-03-04T08:50:22.629 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 msgr2=0x7faefc147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faef000e870 tx=0x7faef000ed30 comp rx=0 tx=0).stop 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 shutdown_connections 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faefc15ba70 0x7faefc147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faefc0afd80 0x7faefc147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 --2- 172.21.15.204:0/3998919322 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faefc06b6c0 0x7faefc147250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 >> 172.21.15.204:0/3998919322 conn(0x7faefc0b2510 msgr2=0x7faefc06e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 shutdown_connections 2024-03-04T08:50:22.630 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.633+0000 7faf019a2640 1 -- 172.21.15.204:0/3998919322 wait complete. 2024-03-04T08:50:22.640 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 53a0da71-cca3-48e8-a70b-30887b44f6db 6 2024-03-04T08:50:22.740 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.743+0000 7f270275c640 1 Processor -- start 2024-03-04T08:50:22.741 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 -- start start 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 0x7f26fc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc0ce190 con 0x7f26fc15e680 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc144940 con 0x7f26fc144560 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f270275c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15eb10 con 0x7f26fc0d0f50 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f26fbfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 0x7f26fc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.744+0000 7f2700cf9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.742 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f26fb7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f26fc15e680 0x7f26fc0d0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.204:40314/0 (socket says 172.21.15.204:40314) 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f26fb7fe640 1 -- 172.21.15.204:0/3106964061 learned_addr learned my addr 172.21.15.204:0/3106964061 (peer_addr_for_me v1:172.21.15.204:0/0) 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f2700cf9640 1 -- 172.21.15.204:0/3106964061 >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 msgr2=0x7f26fc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f2700cf9640 1 --2- 172.21.15.204:0/3106964061 >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 0x7f26fc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f26faffd640 1 -- 172.21.15.204:0/3106964061 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777597376 0 0) 0x7f26ec001110 con 0x7f26fc15e680 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f2700cf9640 1 -- 172.21.15.204:0/3106964061 >> v1:172.21.15.204:6789/0 conn(0x7f26fc15e680 legacy=0x7f26fc0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f2700cf9640 1 -- 172.21.15.204:0/3106964061 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc15edf0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.743 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.745+0000 7f26fbfff640 1 --2- 172.21.15.204:0/3106964061 >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 0x7f26fc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:22.744 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f2700cf9640 1 --2- 172.21.15.204:0/3106964061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc0b44f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009d90 tx=0x7f26f402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3c93fd7d3f499 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f26faffd640 1 -- 172.21.15.204:0/3106964061 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4039070 con 0x7f26fc0d0f50 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f26faffd640 1 -- 172.21.15.204:0/3106964061 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f402cc50 con 0x7f26fc0d0f50 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f26faffd640 1 -- 172.21.15.204:0/3106964061 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4034440 con 0x7f26fc0d0f50 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 -- 172.21.15.204:0/3106964061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 msgr2=0x7f26fc0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 --2- 172.21.15.204:0/3106964061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc0b44f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009d90 tx=0x7f26f402bea0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 -- 172.21.15.204:0/3106964061 shutdown_connections 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 --2- 172.21.15.204:0/3106964061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc0b44f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 --2- 172.21.15.204:0/3106964061 >> v2:172.21.15.204:3300/0 conn(0x7f26fc144560 0x7f26fc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 -- 172.21.15.204:0/3106964061 >> 172.21.15.204:0/3106964061 conn(0x7f26fc06c0c0 msgr2=0x7f26fc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 -- 172.21.15.204:0/3106964061 shutdown_connections 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.746+0000 7f270275c640 1 -- 172.21.15.204:0/3106964061 wait complete. 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.747+0000 7f270275c640 1 Processor -- start 2024-03-04T08:50:22.745 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 -- start start 2024-03-04T08:50:22.747 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26fc144560 0x7f26fc15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc13d9b0 0x7f26fc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc06f2c0 con 0x7f26fc13d9b0 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15f3b0 con 0x7f26fc144560 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f270275c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc06f440 con 0x7f26fc0d0f50 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.748+0000 7f26fb7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26fc144560 0x7f26fc15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53296/0 (socket says 172.21.15.204:53296) 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 -- 172.21.15.204:0/2945274045 learned_addr learned my addr 172.21.15.204:0/2945274045 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f2700cf9640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc13d9b0 0x7f26fc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 -- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26fc144560 msgr2=0x7f26fc15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26fc144560 0x7f26fc15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.748 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 -- 172.21.15.204:0/2945274045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc13d9b0 msgr2=0x7f26fc15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc13d9b0 0x7f26fc15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 -- 172.21.15.204:0/2945274045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc143910 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26fbfff640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26f000ec10 tx=0x7f26f000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000cbd0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc1f5a00 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0013470 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc1f5fc0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f26f001a070 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.749+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f26f001cae0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.749 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.750+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc0733b0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.750 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.752+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f26f001c4f0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.822 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.825+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53a0da71-cca3-48e8-a70b-30887b44f6db", "id": 6} v 0) v1 -- 0x7f26fc141910 con 0x7f26fc0d0f50 2024-03-04T08:50:22.827 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.830+0000 7f26f8ff9640 1 -- 172.21.15.204:0/2945274045 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53a0da71-cca3-48e8-a70b-30887b44f6db", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26f001c6d0 con 0x7f26fc0d0f50 2024-03-04T08:50:22.827 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-03-04T08:50:22.828 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 msgr2=0x7f26fc1433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.828 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26f000ec10 tx=0x7f26f000c520 comp rx=0 tx=0).stop 2024-03-04T08:50:22.828 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 shutdown_connections 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26fc13d9b0 0x7f26fc15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f26fc144560 0x7f26fc15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 --2- 172.21.15.204:0/2945274045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26fc0d0f50 0x7f26fc1433d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 >> 172.21.15.204:0/2945274045 conn(0x7f26fc06c0c0 msgr2=0x7f26fc0b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 shutdown_connections 2024-03-04T08:50:22.829 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.831+0000 7f270275c640 1 -- 172.21.15.204:0/2945274045 wait complete. 2024-03-04T08:50:22.838 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a601bf0a-74ff-40f8-b2dd-4da01dbd53cb 7 2024-03-04T08:50:22.889 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:22.893+0000 7f0a0786c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T08:50:22.940 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.943+0000 7f639830c640 1 Processor -- start 2024-03-04T08:50:22.940 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.943+0000 7f639830c640 1 -- start start 2024-03-04T08:50:22.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f639830c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f639006afb0 0x7f639006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f639830c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f639830c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639006b8d0 con 0x7f63900cd250 2024-03-04T08:50:22.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f639830c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63900725a0 con 0x7f639006afb0 2024-03-04T08:50:22.941 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f639830c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390072db0 con 0x7f63900ceda0 2024-03-04T08:50:22.942 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:22.944+0000 7fe864efa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T08:50:22.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f639006afb0 0x7f639006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.943 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63968a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f639006afb0 0x7f639006b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48222/0 (socket says 172.21.15.204:48222) 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63968a9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53306/0 (socket says 172.21.15.204:53306) 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 -- 172.21.15.204:0/3126749797 learned_addr learned my addr 172.21.15.204:0/3126749797 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 -- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 msgr2=0x7f63900cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 -- 172.21.15.204:0/3126749797 >> v1:172.21.15.19:6789/0 conn(0x7f63900cd250 legacy=0x7f63900d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63960a8640 1 -- 172.21.15.204:0/3126749797 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900727f0 con 0x7f639006afb0 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.944+0000 7f63968a9640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.945+0000 7f63960a8640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f639006afb0 0x7f639006b390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6380009870 tx=0x7f638002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8eafec6347b18b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.945+0000 7f63950a6640 1 -- 172.21.15.204:0/3126749797 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380035020 con 0x7f639006afb0 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.945+0000 7f63950a6640 1 -- 172.21.15.204:0/3126749797 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380031640 con 0x7f639006afb0 2024-03-04T08:50:22.944 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.945+0000 7f63950a6640 1 -- 172.21.15.204:0/3126749797 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638002d040 con 0x7f639006afb0 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 -- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f639006afb0 msgr2=0x7f639006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f639006afb0 0x7f639006b390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6380009870 tx=0x7f638002b8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 -- 172.21.15.204:0/3126749797 shutdown_connections 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900ceda0 0x7f63900cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 --2- 172.21.15.204:0/3126749797 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f639006afb0 0x7f639006b390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 -- 172.21.15.204:0/3126749797 >> 172.21.15.204:0/3126749797 conn(0x7f639006c0c0 msgr2=0x7f639006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 -- 172.21.15.204:0/3126749797 shutdown_connections 2024-03-04T08:50:22.945 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.946+0000 7f639830c640 1 -- 172.21.15.204:0/3126749797 wait complete. 2024-03-04T08:50:22.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.947+0000 7f639830c640 1 Processor -- start 2024-03-04T08:50:22.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.947+0000 7f639830c640 1 -- start start 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f639006afb0 0x7f639015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 0x7f639015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900d0990 con 0x7f639006afb0 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63900d06b0 con 0x7f63900ceda0 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f639830c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390145880 con 0x7f63900cd250 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63968a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 0x7f639015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.204:53310/0 (socket says 172.21.15.204:53310) 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63968a9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 0x7f639015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:48224/0 (socket says 172.21.15.204:48224) 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 -- 172.21.15.204:0/2688236793 learned_addr learned my addr 172.21.15.204:0/2688236793 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63960a8640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f639006afb0 0x7f639015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:22.948 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 -- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 msgr2=0x7f639015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 0x7f639015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 -- 172.21.15.204:0/2688236793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f639006afb0 msgr2=0x7f639015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f639006afb0 0x7f639015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 -- 172.21.15.204:0/2688236793 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639012a7c0 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.948+0000 7f63958a7640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c3c0 tx=0x7f638c00c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c0052d0 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c005490 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639012aaa0 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c007260 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639012b060 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f638c007400 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.949+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f638c011bf0 con 0x7f63900cd250 2024-03-04T08:50:22.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.950+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63900733b0 con 0x7f63900cd250 2024-03-04T08:50:22.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:22.951+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f638c011df0 con 0x7f63900cd250 2024-03-04T08:50:23.021 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.024+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a601bf0a-74ff-40f8-b2dd-4da01dbd53cb", "id": 7} v 0) v1 -- 0x7f6390074930 con 0x7f63900cd250 2024-03-04T08:50:23.027 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.030+0000 7f6386ffd640 1 -- 172.21.15.204:0/2688236793 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a601bf0a-74ff-40f8-b2dd-4da01dbd53cb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f638c0039b0 con 0x7f63900cd250 2024-03-04T08:50:23.027 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-03-04T08:50:23.028 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 msgr2=0x7f6390159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c3c0 tx=0x7f638c00c7c0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 shutdown_connections 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63900ceda0 0x7f639015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63900cd250 0x7f6390159b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 --2- 172.21.15.204:0/2688236793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f639006afb0 0x7f639015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 >> 172.21.15.204:0/2688236793 conn(0x7f639006c0c0 msgr2=0x7f639006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 shutdown_connections 2024-03-04T08:50:23.029 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:50:23.031+0000 7f639830c640 1 -- 172.21.15.204:0/2688236793 wait complete. 2024-03-04T08:50:23.029 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.033+0000 7f0a0786c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T08:50:23.038 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-04T08:50:23.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-04T08:50:23.041 INFO:tasks.ceph.osd.0:Started 2024-03-04T08:50:23.041 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-04T08:50:23.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-04T08:50:23.044 INFO:tasks.ceph.osd.1:Started 2024-03-04T08:50:23.044 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-04T08:50:23.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-04T08:50:23.046 INFO:tasks.ceph.osd.2:Started 2024-03-04T08:50:23.046 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-04T08:50:23.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-04T08:50:23.049 INFO:tasks.ceph.osd.3:Started 2024-03-04T08:50:23.049 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-04T08:50:23.049 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-04T08:50:23.051 INFO:tasks.ceph.osd.4:Started 2024-03-04T08:50:23.051 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-04T08:50:23.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-04T08:50:23.053 INFO:tasks.ceph.osd.5:Started 2024-03-04T08:50:23.054 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-04T08:50:23.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-04T08:50:23.056 INFO:tasks.ceph.osd.6:Started 2024-03-04T08:50:23.056 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-04T08:50:23.056 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-04T08:50:23.059 INFO:tasks.ceph.osd.7:Started 2024-03-04T08:50:23.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:23.093 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.096+0000 7fe864efa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T08:50:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.183+0000 7f03817a2640 1 Processor -- start 2024-03-04T08:50:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.183+0000 7f03817a2640 1 -- start start 2024-03-04T08:50:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.183+0000 7f03817a2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 0x7f037c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.183+0000 7f03817a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.183+0000 7f03817a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c15cea0 con 0x7f037c0d1520 2024-03-04T08:50:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f03817a2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0cc620 con 0x7f037c0b0c80 2024-03-04T08:50:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f03817a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cc900 con 0x7f037c0cf440 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f037c0d1520 0x7f037c0d1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50594/0 (socket says 172.21.15.19:50594) 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037b7fe640 1 -- 172.21.15.19:0/2985819598 learned_addr learned my addr 172.21.15.19:0/2985819598 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 0x7f037c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f0380fa1640 1 --2- 172.21.15.19:0/2985819598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037affd640 1 -- 172.21.15.19:0/2985819598 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542511836 0 0) 0x7f037c15cea0 con 0x7f037c0d1520 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037affd640 1 -- 172.21.15.19:0/2985819598 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003520 con 0x7f037c0d1520 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f0380fa1640 1 -- 172.21.15.19:0/2985819598 >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 msgr2=0x7f037c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f0380fa1640 1 --2- 172.21.15.19:0/2985819598 >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 0x7f037c0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f0380fa1640 1 -- 172.21.15.19:0/2985819598 >> v1:172.21.15.19:6789/0 conn(0x7f037c0d1520 legacy=0x7f037c0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f0380fa1640 1 -- 172.21.15.19:0/2985819598 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0ccbe0 con 0x7f037c0cf440 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.184+0000 7f037bfff640 1 --2- 172.21.15.19:0/2985819598 >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 0x7f037c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.185+0000 7f0380fa1640 1 --2- 172.21.15.19:0/2985819598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0cf890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0374009d90 tx=0x7f037402bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3a0017aad218a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.185+0000 7f037affd640 1 -- 172.21.15.19:0/2985819598 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374039070 con 0x7f037c0cf440 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.185+0000 7f037affd640 1 -- 172.21.15.19:0/2985819598 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037402ccf0 con 0x7f037c0cf440 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.185+0000 7f037affd640 1 -- 172.21.15.19:0/2985819598 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374034640 con 0x7f037c0cf440 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 -- 172.21.15.19:0/2985819598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 msgr2=0x7f037c0cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 --2- 172.21.15.19:0/2985819598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0cf890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0374009d90 tx=0x7f037402bf40 comp rx=0 tx=0).stop 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 -- 172.21.15.19:0/2985819598 shutdown_connections 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 --2- 172.21.15.19:0/2985819598 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0cf890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 --2- 172.21.15.19:0/2985819598 >> v2:172.21.15.19:3300/0 conn(0x7f037c0b0c80 0x7f037c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 -- 172.21.15.19:0/2985819598 >> 172.21.15.19:0/2985819598 conn(0x7f037c09a9f0 msgr2=0x7f037c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 -- 172.21.15.19:0/2985819598 shutdown_connections 2024-03-04T08:50:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.186+0000 7f03817a2640 1 -- 172.21.15.19:0/2985819598 wait complete. 2024-03-04T08:50:23.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.187+0000 7f03817a2640 1 Processor -- start 2024-03-04T08:50:23.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.187+0000 7f03817a2640 1 -- start start 2024-03-04T08:50:23.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:23.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:23.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0d1520 0x7f037c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48078/0 (socket says 172.21.15.19:48078) 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cd640 con 0x7f037c0b0c80 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cfdd0 con 0x7f037c0d1520 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f03817a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c8940 con 0x7f037c0cf440 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 -- 172.21.15.19:0/3928612288 learned_addr learned my addr 172.21.15.19:0/3928612288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037b7fe640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f0380fa1640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0d1520 0x7f037c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 -- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 msgr2=0x7f037c0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 -- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0d1520 msgr2=0x7f037c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0d1520 0x7f037c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 -- 172.21.15.19:0/3928612288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0c8c20 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037b7fe640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.188+0000 7f037bfff640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ebe0 tx=0x7f036c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c017070 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00cc30 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c0c8f00 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0c94c0 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c013470 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f036c01a070 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.189+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f036c00cde0 con 0x7f037c0b0c80 2024-03-04T08:50:23.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.190+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c068f80 con 0x7f037c0b0c80 2024-03-04T08:50:23.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.192+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f036c021070 con 0x7f037c0b0c80 2024-03-04T08:50:23.193 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.198+0000 7f0a0786c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T08:50:23.234 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.237+0000 7fe864efa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T08:50:23.241 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.245+0000 7f0a0786c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T08:50:23.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.253+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037c15b330 con 0x7f037c0b0c80 2024-03-04T08:50:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.254+0000 7f0378ff9640 1 -- 172.21.15.19:0/3928612288 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f036c005990 con 0x7f037c0b0c80 2024-03-04T08:50:23.250 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:23.250 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:23.026557+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 msgr2=0x7f037c0c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ebe0 tx=0x7f036c00c520 comp rx=0 tx=0).stop 2024-03-04T08:50:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 shutdown_connections 2024-03-04T08:50:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0d1520 0x7f037c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c0cf440 0x7f037c0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 --2- 172.21.15.19:0/3928612288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0b0c80 0x7f037c0c9cc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 >> 172.21.15.19:0/3928612288 conn(0x7f037c09a9f0 msgr2=0x7f037c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 shutdown_connections 2024-03-04T08:50:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:23.255+0000 7f03817a2640 1 -- 172.21.15.19:0/3928612288 wait complete. 2024-03-04T08:50:23.261 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-04T08:50:23.262 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-04T08:50:23.279 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.282+0000 7fe864efa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T08:50:23.359 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.363+0000 7f0a0786c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:50:23.390 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.393+0000 7fe864efa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:50:23.458 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.461+0000 7f0a0786c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T08:50:23.487 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.490+0000 7fe864efa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T08:50:23.618 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.622+0000 7f0a0786c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:50:23.641 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.645+0000 7fe864efa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T08:50:23.649 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-04T08:50:23.653+0000 7f118bbe1640 -1 Falling back to public interface 2024-03-04T08:50:23.656 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-04T08:50:23.659+0000 7fc704fff640 -1 Falling back to public interface 2024-03-04T08:50:23.657 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-04T08:50:23.660+0000 7f7ec9819640 -1 Falling back to public interface 2024-03-04T08:50:23.662 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.666+0000 7f0a0786c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T08:50:23.664 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-04T08:50:23.667+0000 7f3426d81640 -1 Falling back to public interface 2024-03-04T08:50:23.665 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-04T08:50:23.669+0000 7f31cb648640 -1 Falling back to public interface 2024-03-04T08:50:23.666 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-04T08:50:23.670+0000 7f2b8da1d640 -1 Falling back to public interface 2024-03-04T08:50:23.674 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-04T08:50:23.678+0000 7fd904f6f640 -1 Falling back to public interface 2024-03-04T08:50:23.681 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-04T08:50:23.684+0000 7f89de61a640 -1 Falling back to public interface 2024-03-04T08:50:23.686 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.690+0000 7fe864efa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T08:50:23.826 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:23.830+0000 7f0a0786c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T08:50:23.842 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:23.845+0000 7fe864efa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T08:50:24.068 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:24.158 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.162+0000 7f0588015640 1 Processor -- start 2024-03-04T08:50:24.158 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.162+0000 7f0588015640 1 -- start start 2024-03-04T08:50:24.160 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f0588015640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 0x7f0580161a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:24.160 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f0588015640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f058006c100 0x7f05800b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:24.160 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f0588015640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058015e380 con 0x7f058015dfa0 2024-03-04T08:50:24.160 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f0588015640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05800cfc90 con 0x7f058006c100 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f0588015640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0580162100 con 0x7f05800d2160 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f058006c100 0x7f05800b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f058006c100 0x7f05800b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48082/0 (socket says 172.21.15.19:48082) 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 -- 172.21.15.19:0/596009831 learned_addr learned my addr 172.21.15.19:0/596009831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05855b0640 1 --2- 172.21.15.19:0/596009831 >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 0x7f0580161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 -- 172.21.15.19:0/596009831 >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 msgr2=0x7f0580161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 --2- 172.21.15.19:0/596009831 >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 0x7f0580161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 -- 172.21.15.19:0/596009831 >> v1:172.21.15.204:6789/0 conn(0x7f058015dfa0 legacy=0x7f05800d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05865b2640 1 -- 172.21.15.19:0/596009831 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05801623e0 con 0x7f058006c100 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.163+0000 7f05855b0640 1 --2- 172.21.15.19:0/596009831 >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 0x7f0580161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.164+0000 7f05865b2640 1 --2- 172.21.15.19:0/596009831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f05800b14d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05801619d0 tx=0x7f057802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86c495538d7c42c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:24.161 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.164+0000 7f0584daf640 1 -- 172.21.15.19:0/596009831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057802cb20 con 0x7f058006c100 2024-03-04T08:50:24.162 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.164+0000 7f0584daf640 1 -- 172.21.15.19:0/596009831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057802ccc0 con 0x7f058006c100 2024-03-04T08:50:24.162 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.164+0000 7f0584daf640 1 -- 172.21.15.19:0/596009831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578034610 con 0x7f058006c100 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 -- 172.21.15.19:0/596009831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 msgr2=0x7f05800b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 --2- 172.21.15.19:0/596009831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f05800b14d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05801619d0 tx=0x7f057802bf80 comp rx=0 tx=0).stop 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 -- 172.21.15.19:0/596009831 shutdown_connections 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 --2- 172.21.15.19:0/596009831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f05800b14d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 --2- 172.21.15.19:0/596009831 >> v2:172.21.15.204:3300/0 conn(0x7f05800d2160 0x7f0580161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 -- 172.21.15.19:0/596009831 >> 172.21.15.19:0/596009831 conn(0x7f0580072ff0 msgr2=0x7f058009a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 -- 172.21.15.19:0/596009831 shutdown_connections 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.165+0000 7f0588015640 1 -- 172.21.15.19:0/596009831 wait complete. 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.166+0000 7f0588015640 1 Processor -- start 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.166+0000 7f0588015640 1 -- start start 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:24.165 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05800d2160 0x7f05800b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f058015dfa0 0x7f05800b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800b11c0 con 0x7f058006c100 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800cfec0 con 0x7f05800d2160 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0588015640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800d03e0 con 0x7f058015dfa0 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48086/0 (socket says 172.21.15.19:48086) 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 -- 172.21.15.19:0/1253517145 learned_addr learned my addr 172.21.15.19:0/1253517145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f05855b0640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05800d2160 0x7f05800b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f05865b2640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f058015dfa0 0x7f05800b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 -- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f058015dfa0 msgr2=0x7f05800b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f058015dfa0 0x7f05800b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 -- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05800d2160 msgr2=0x7f05800b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05800d2160 0x7f05800b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.166 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 -- 172.21.15.19:0/1253517145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580161400 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f0585db1640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f057000c3c0 tx=0x7f057000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.167+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700052d0 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570005490 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580160b60 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570007260 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580161120 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0570007400 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.168+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0570011c60 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.169+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058004f330 con 0x7f058006c100 2024-03-04T08:50:24.167 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.171+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f05700035f0 con 0x7f058006c100 2024-03-04T08:50:24.229 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.233+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05800b7af0 con 0x7f058006c100 2024-03-04T08:50:24.229 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.233+0000 7f05767fc640 1 -- 172.21.15.19:0/1253517145 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f0570003a50 con 0x7f058006c100 2024-03-04T08:50:24.230 INFO:teuthology.misc.health.smithi019.stdout: 2024-03-04T08:50:24.230 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:23.026557+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 msgr2=0x7f058014e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f057000c3c0 tx=0x7f057000c880 comp rx=0 tx=0).stop 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 shutdown_connections 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f058015dfa0 0x7f05800b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f05800d2160 0x7f05800b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 --2- 172.21.15.19:0/1253517145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f058006c100 0x7f058014e6f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 >> 172.21.15.19:0/1253517145 conn(0x7f0580072ff0 msgr2=0x7f058006eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 shutdown_connections 2024-03-04T08:50:24.231 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:24.234+0000 7f0588015640 1 -- 172.21.15.19:0/1253517145 wait complete. 2024-03-04T08:50:24.240 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T08:50:24.662 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:24.665+0000 7fe864efa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T08:50:24.681 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:24.684+0000 7f0a0786c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T08:50:24.944 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:24.947+0000 7fe864efa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T08:50:24.969 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:24.973+0000 7f0a0786c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T08:50:24.995 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:24.998+0000 7fe864efa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T08:50:25.022 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:25.026+0000 7f0a0786c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T08:50:25.112 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:25.115+0000 7fe864efa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T08:50:25.143 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-04T08:50:25.147+0000 7f0a0786c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T08:50:26.141 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:26.144+0000 7fe80635a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-04T08:50:26.142 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-03-04T08:50:26.145+0000 7fe80635a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-04T08:50:27.095 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-04T08:50:27.099+0000 7f118bbe1640 -1 osd.1 0 log_to_monitors true 2024-03-04T08:50:27.108 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-04T08:50:27.108+0000 7f7ec9819640 -1 osd.4 0 log_to_monitors true 2024-03-04T08:50:27.146 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-04T08:50:27.150+0000 7fd904f6f640 -1 osd.0 0 log_to_monitors true 2024-03-04T08:50:27.152 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-04T08:50:27.156+0000 7f3426d81640 -1 osd.7 0 log_to_monitors true 2024-03-04T08:50:27.157 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-04T08:50:27.160+0000 7fc704fff640 -1 osd.5 0 log_to_monitors true 2024-03-04T08:50:27.174 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-04T08:50:27.178+0000 7f2b8da1d640 -1 osd.3 0 log_to_monitors true 2024-03-04T08:50:27.185 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-04T08:50:27.189+0000 7f31cb648640 -1 osd.2 0 log_to_monitors true 2024-03-04T08:50:27.193 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-04T08:50:27.197+0000 7f89de61a640 -1 osd.6 0 log_to_monitors true 2024-03-04T08:50:28.980 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-04T08:50:28.983+0000 7f7ec49e9640 -1 osd.4 0 waiting for initial osdmap 2024-03-04T08:50:28.991 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-03-04T08:50:28.994+0000 7f7ebd01b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:29.006 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-04T08:50:29.010+0000 7f1187354640 -1 osd.1 0 waiting for initial osdmap 2024-03-04T08:50:29.017 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-04T08:50:29.022+0000 7f117f986640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.690 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-04T08:50:30.694+0000 7fd9006e2640 -1 osd.0 0 waiting for initial osdmap 2024-03-04T08:50:30.702 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-04T08:50:30.706+0000 7fd8f8d14640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.790 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-04T08:50:30.794+0000 7fc700772640 -1 osd.5 0 waiting for initial osdmap 2024-03-04T08:50:30.800 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-04T08:50:30.803+0000 7f89d9762640 -1 osd.6 0 waiting for initial osdmap 2024-03-04T08:50:30.802 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-03-04T08:50:30.806+0000 7fc6f8da4640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.812 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-03-04T08:50:30.814+0000 7f89d1d94640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.816 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-04T08:50:30.820+0000 7f34224f4640 -1 osd.7 0 waiting for initial osdmap 2024-03-04T08:50:30.822 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-04T08:50:30.826+0000 7f2b8a302640 -1 osd.3 0 waiting for initial osdmap 2024-03-04T08:50:30.829 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-03-04T08:50:30.833+0000 7f341ab26640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.838 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-04T08:50:30.842+0000 7f2b8110d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:30.994 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-04T08:50:30.998+0000 7f31c6dbb640 -1 osd.2 0 waiting for initial osdmap 2024-03-04T08:50:31.008 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-04T08:50:31.013+0000 7f31bf3ed640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T08:50:31.047 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:31.136 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.140+0000 7ff85f101640 1 Processor -- start 2024-03-04T08:50:31.137 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.140+0000 7ff85f101640 1 -- start start 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85f101640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d08e0 0x7ff8580d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85f101640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8580d1950 0x7ff8581611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85f101640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580d2810 con 0x7ff8580d0cc0 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85f101640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580cf210 con 0x7ff8580d1950 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85f101640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580d2a90 con 0x7ff8580d08e0 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85d69e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8580d1950 0x7ff8581611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff857fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff8580d0cc0 0x7ff8580cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56676/0 (socket says 172.21.15.19:56676) 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff857fff640 1 -- 172.21.15.19:0/2940344317 learned_addr learned my addr 172.21.15.19:0/2940344317 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:31.138 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85ce9d640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d08e0 0x7ff8580d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.139 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85d69e640 1 -- 172.21.15.19:0/2940344317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d08e0 msgr2=0x7ff8580d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:31.139 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.141+0000 7ff85d69e640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d08e0 0x7ff8580d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.139 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff85d69e640 1 -- 172.21.15.19:0/2940344317 >> v1:172.21.15.19:6789/0 conn(0x7ff8580d0cc0 legacy=0x7ff8580cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.139 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff8577fe640 1 -- 172.21.15.19:0/2940344317 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918669401 0 0) 0x7ff84c001110 con 0x7ff8580d0cc0 2024-03-04T08:50:31.139 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff85d69e640 1 -- 172.21.15.19:0/2940344317 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580cebc0 con 0x7ff8580d1950 2024-03-04T08:50:31.140 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff85d69e640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8581611a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b3f9a574c82e01 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.140 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff8577fe640 1 -- 172.21.15.19:0/2940344317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480315a0 con 0x7ff8580d1950 2024-03-04T08:50:31.140 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff8577fe640 1 -- 172.21.15.19:0/2940344317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8580d1950 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.142+0000 7ff8577fe640 1 -- 172.21.15.19:0/2940344317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848031960 con 0x7ff8580d1950 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 -- 172.21.15.19:0/2940344317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 msgr2=0x7ff8581611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8581611a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff84802b840 comp rx=0 tx=0).stop 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 -- 172.21.15.19:0/2940344317 shutdown_connections 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8581611a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 --2- 172.21.15.19:0/2940344317 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d08e0 0x7ff8580d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 -- 172.21.15.19:0/2940344317 >> 172.21.15.19:0/2940344317 conn(0x7ff85809d050 msgr2=0x7ff8580d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 -- 172.21.15.19:0/2940344317 shutdown_connections 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.143+0000 7ff85f101640 1 -- 172.21.15.19:0/2940344317 wait complete. 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.144+0000 7ff85f101640 1 Processor -- start 2024-03-04T08:50:31.141 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.144+0000 7ff85f101640 1 -- start start 2024-03-04T08:50:31.143 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8580d08e0 0x7ff85814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.143 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d0cc0 0x7ff8580c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.143 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.143 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580ce9a0 con 0x7ff8580d1950 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580ce820 con 0x7ff8580d08e0 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85f101640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581616e0 con 0x7ff8580d0cc0 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59942/0 (socket says 172.21.15.19:59942) 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 -- 172.21.15.19:0/3076582585 learned_addr learned my addr 172.21.15.19:0/3076582585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85ce9d640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8580d08e0 0x7ff85814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff857fff640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d0cc0 0x7ff8580c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 -- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d0cc0 msgr2=0x7ff8580c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d0cc0 0x7ff8580c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 -- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8580d08e0 msgr2=0x7ff85814a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8580d08e0 0x7ff85814a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.145+0000 7ff85d69e640 1 -- 172.21.15.19:0/3076582585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580c9380 con 0x7ff8580d1950 2024-03-04T08:50:31.144 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff85d69e640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848032840 con 0x7ff8580d1950 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848032a00 con 0x7ff8580d1950 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8580c9660 con 0x7ff8580d1950 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848032df0 con 0x7ff8580d1950 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.146+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8580c9c20 con 0x7ff8580d1950 2024-03-04T08:50:31.145 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.147+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85804f330 con 0x7ff8580d1950 2024-03-04T08:50:31.146 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.148+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7ff84803b3f0 con 0x7ff8580d1950 2024-03-04T08:50:31.146 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.148+0000 7ff8557fa640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 0x7ff84406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.146 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.148+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3166+0+0 (secure 0 0 0) 0x7ff84802f030 con 0x7ff8580d1950 2024-03-04T08:50:31.146 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.148+0000 7ff85ce9d640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 0x7ff84406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.146 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.148+0000 7ff85ce9d640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 0x7ff84406d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff858159870 tx=0x7ff8500077b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.149 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.153+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff848040070 con 0x7ff8580d1950 2024-03-04T08:50:31.335 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.339+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8580d12c0 con 0x7ff8580d1950 2024-03-04T08:50:31.336 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.340+0000 7ff8557fa640 1 -- 172.21.15.19:0/3076582585 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12746 (secure 0 0 0) 0x7ff84807a800 con 0x7ff8580d1950 2024-03-04T08:50:31.336 INFO:teuthology.misc.health.smithi019.stdout: 2024-03-04T08:50:31.336 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":15,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:31.191638+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:31.338 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 msgr2=0x7ff84406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.338 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 0x7ff84406d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff858159870 tx=0x7ff8500077b0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 msgr2=0x7ff8580b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8480097a0 tx=0x7ff8480046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 shutdown_connections 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8580d1950 0x7ff8580b2010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff8580d0cc0 0x7ff8580c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff84406b440 0x7ff84406d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 --2- 172.21.15.19:0/3076582585 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff8580d08e0 0x7ff85814a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 >> 172.21.15.19:0/3076582585 conn(0x7ff85809d050 msgr2=0x7ff858162560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 shutdown_connections 2024-03-04T08:50:31.339 INFO:teuthology.misc.health.smithi019.stderr:2024-03-04T08:50:31.342+0000 7ff85f101640 1 -- 172.21.15.19:0/3076582585 wait complete. 2024-03-04T08:50:31.348 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-04T08:50:31.348 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-04T08:50:31.348 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-04T08:50:31.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-04T08:50:31.350 INFO:tasks.ceph.mds.a:Started 2024-03-04T08:50:31.351 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-04T08:50:31.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-04T08:50:31.353 INFO:tasks.ceph.mds.c:Started 2024-03-04T08:50:31.353 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-04T08:50:31.353 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-04T08:50:31.355 INFO:tasks.ceph.mds.b:Started 2024-03-04T08:50:31.355 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-04T08:50:31.355 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-04T08:50:31.357 INFO:tasks.ceph.mds.d:Started 2024-03-04T08:50:31.357 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-04T08:50:31.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:31.428 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-04T08:50:31.428 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-04T08:50:31.429 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-03-04T08:50:31.433+0000 7f6bdc562640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-03-04T08:50:31.432 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-04T08:50:31.433 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-04T08:50:31.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.469+0000 7fe176ea4640 1 Processor -- start 2024-03-04T08:50:31.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.469+0000 7fe176ea4640 1 -- start start 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe176ea4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 0x7fe1700d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe176ea4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1700cf850 0x7fe1700cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe176ea4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1700d09e0 con 0x7fe1700ce1b0 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe176ea4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17006ca90 con 0x7fe1700cf850 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe176ea4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17006df30 con 0x7fe1700d00c0 2024-03-04T08:50:31.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1700cf850 0x7fe1700cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1700cf850 0x7fe1700cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59988/0 (socket says 172.21.15.19:59988) 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 -- 172.21.15.19:0/1073001233 learned_addr learned my addr 172.21.15.19:0/1073001233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 -- 172.21.15.19:0/1073001233 >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 msgr2=0x7fe1700d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe174c40640 1 --2- 172.21.15.19:0/1073001233 >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 0x7fe1700d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 --2- 172.21.15.19:0/1073001233 >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 0x7fe1700d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 -- 172.21.15.19:0/1073001233 >> v1:172.21.15.204:6789/0 conn(0x7fe1700ce1b0 legacy=0x7fe1700ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe16ffff640 1 -- 172.21.15.19:0/1073001233 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17015e380 con 0x7fe1700cf850 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.470+0000 7fe174c40640 1 --2- 172.21.15.19:0/1073001233 >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 0x7fe1700d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.471+0000 7fe16ffff640 1 --2- 172.21.15.19:0/1073001233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700cf850 0x7fe1700cd3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1700d1a40 tx=0x7fe16402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d23eeb0ef894a5c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.471+0000 7fe16f7fe640 1 -- 172.21.15.19:0/1073001233 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164035020 con 0x7fe1700cf850 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.471+0000 7fe16f7fe640 1 -- 172.21.15.19:0/1073001233 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164031870 con 0x7fe1700cf850 2024-03-04T08:50:31.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.471+0000 7fe16f7fe640 1 -- 172.21.15.19:0/1073001233 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164031c40 con 0x7fe1700cf850 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 -- 172.21.15.19:0/1073001233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700cf850 msgr2=0x7fe1700cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 --2- 172.21.15.19:0/1073001233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700cf850 0x7fe1700cd3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1700d1a40 tx=0x7fe16402b910 comp rx=0 tx=0).stop 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 -- 172.21.15.19:0/1073001233 shutdown_connections 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 --2- 172.21.15.19:0/1073001233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700cf850 0x7fe1700cd3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 --2- 172.21.15.19:0/1073001233 >> v2:172.21.15.204:3300/0 conn(0x7fe1700d00c0 0x7fe1700d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 -- 172.21.15.19:0/1073001233 >> 172.21.15.19:0/1073001233 conn(0x7fe1700b35a0 msgr2=0x7fe1700b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 -- 172.21.15.19:0/1073001233 shutdown_connections 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.472+0000 7fe176ea4640 1 -- 172.21.15.19:0/1073001233 wait complete. 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.473+0000 7fe176ea4640 1 Processor -- start 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.473+0000 7fe176ea4640 1 -- start start 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1700ce1b0 0x7fe1700b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1700cf850 0x7fe1700b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17006c440 con 0x7fe1700d00c0 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17006c160 con 0x7fe1700ce1b0 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17006c720 con 0x7fe1700cf850 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59998/0 (socket says 172.21.15.19:59998) 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 -- 172.21.15.19:0/3336682206 learned_addr learned my addr 172.21.15.19:0/3336682206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe174c40640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1700ce1b0 0x7fe1700b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe16ffff640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1700cf850 0x7fe1700b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 -- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1700cf850 msgr2=0x7fe1700b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1700cf850 0x7fe1700b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 -- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1700ce1b0 msgr2=0x7fe1700b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1700ce1b0 0x7fe1700b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 -- 172.21.15.19:0/3336682206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700c5740 con 0x7fe1700d00c0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe175441640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c7b0 tx=0x7fe16800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168004b60 con 0x7fe1700d00c0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168004d00 con 0x7fe1700d00c0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800aa90 con 0x7fe1700d00c0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1700c5a20 con 0x7fe1700d00c0 2024-03-04T08:50:31.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.474+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1700c5fe0 con 0x7fe1700d00c0 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.475+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17004f330 con 0x7fe1700d00c0 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.476+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fe16800ac30 con 0x7fe1700d00c0 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.476+0000 7fe16d7fa640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 0x7fe15c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.476+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe16808a010 con 0x7fe1700d00c0 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.476+0000 7fe174c40640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 0x7fe15c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.477+0000 7fe174c40640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 0x7fe15c06d900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe16000a950 tx=0x7fe160008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.480+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe168020070 con 0x7fe1700d00c0 2024-03-04T08:50:31.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.662+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1700d15c0 con 0x7fe1700d00c0 2024-03-04T08:50:31.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.663+0000 7fe16d7fa640 1 -- 172.21.15.19:0/3336682206 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12746 (secure 0 0 0) 0x7fe1680592c0 con 0x7fe1700d00c0 2024-03-04T08:50:31.659 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:31.660 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:31.191638+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:31.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 msgr2=0x7fe15c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 0x7fe15c06d900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe16000a950 tx=0x7fe160008040 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 msgr2=0x7fe1700c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c7b0 tx=0x7fe16800cc70 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 shutdown_connections 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1700d00c0 0x7fe1700c7520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe1700cf850 0x7fe1700b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe15c06b440 0x7fe15c06d900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 --2- 172.21.15.19:0/3336682206 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe1700ce1b0 0x7fe1700b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 >> 172.21.15.19:0/3336682206 conn(0x7fe1700b35a0 msgr2=0x7fe1700b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 shutdown_connections 2024-03-04T08:50:31.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.665+0000 7fe176ea4640 1 -- 172.21.15.19:0/3336682206 wait complete. 2024-03-04T08:50:31.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:31.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:31.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.781+0000 7fd0c5b2c640 1 Processor -- start 2024-03-04T08:50:31.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.781+0000 7fd0c5b2c640 1 -- start start 2024-03-04T08:50:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0c5b2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c00b4970 0x7fd0c006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0c5b2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0c006d5c0 0x7fd0c00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0c5b2c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c015ff90 con 0x7fd0c015bb40 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0c5b2c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00b4dd0 con 0x7fd0c006d5c0 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0c5b2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c006c910 con 0x7fd0c00b4970 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0c006d5c0 0x7fd0c00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0c006d5c0 0x7fd0c00cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60012/0 (socket says 172.21.15.19:60012) 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 -- 172.21.15.19:0/1449462218 learned_addr learned my addr 172.21.15.19:0/1449462218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0beffd640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c00b4970 0x7fd0c006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 -- 172.21.15.19:0/1449462218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c00b4970 msgr2=0x7fd0c006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c00b4970 0x7fd0c006d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 -- 172.21.15.19:0/1449462218 >> v1:172.21.15.204:6789/0 conn(0x7fd0c015bb40 legacy=0x7fd0c015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.782+0000 7fd0bffff640 1 -- 172.21.15.19:0/1449462218 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0160270 con 0x7fd0c006d5c0 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.783+0000 7fd0bffff640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c00cfa90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e50 tx=0x7fd0b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e00e33ac08950e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.783+0000 7fd0be7fc640 1 -- 172.21.15.19:0/1449462218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802ca70 con 0x7fd0c006d5c0 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.783+0000 7fd0be7fc640 1 -- 172.21.15.19:0/1449462218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b802cc10 con 0x7fd0c006d5c0 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.783+0000 7fd0be7fc640 1 -- 172.21.15.19:0/1449462218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80343f0 con 0x7fd0c006d5c0 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/1449462218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 msgr2=0x7fd0c00cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c00cfa90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e50 tx=0x7fd0b802bed0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/1449462218 shutdown_connections 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c00cfa90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/1449462218 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c00b4970 0x7fd0c006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/1449462218 >> 172.21.15.19:0/1449462218 conn(0x7fd0c006b190 msgr2=0x7fd0c006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/1449462218 shutdown_connections 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.784+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/1449462218 wait complete. 2024-03-04T08:50:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.785+0000 7fd0c5b2c640 1 Processor -- start 2024-03-04T08:50:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.785+0000 7fd0c5b2c640 1 -- start start 2024-03-04T08:50:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 0x7fd0c0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c015bb40 0x7fd0c00b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c015bf20 con 0x7fd0c006d5c0 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c006cb60 con 0x7fd0c00b4970 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c015c0a0 con 0x7fd0c015bb40 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60026/0 (socket says 172.21.15.19:60026) 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 -- 172.21.15.19:0/4194763974 learned_addr learned my addr 172.21.15.19:0/4194763974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0beffd640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 0x7fd0c0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bffff640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c015bb40 0x7fd0c00b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 -- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c015bb40 msgr2=0x7fd0c00b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c015bb40 0x7fd0c00b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 -- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 msgr2=0x7fd0c0157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 0x7fd0c0157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 -- 172.21.15.19:0/4194763974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0139160 con 0x7fd0c006d5c0 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0beffd640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 0x7fd0c0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0bf7fe640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c430 tx=0x7fd0b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011790 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0017070 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c0139440 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011bb0 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.786+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c0139a00 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.787+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0139c00 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.788+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fd0b001c460 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.788+0000 7fd0a7fff640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 0x7fd0ac06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.788+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0b0089bc0 con 0x7fd0c006d5c0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.788+0000 7fd0beffd640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 0x7fd0ac06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.789+0000 7fd0beffd640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 0x7fd0ac06d930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0c013c180 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.793+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd0c0139c00 con 0x7fd0c006d5c0 2024-03-04T08:50:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.973+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0c00732b0 con 0x7fd0c006d5c0 2024-03-04T08:50:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.973+0000 7fd0a7fff640 1 -- 172.21.15.19:0/4194763974 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0b0058f00 con 0x7fd0c006d5c0 2024-03-04T08:50:31.970 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 msgr2=0x7fd0ac06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 0x7fd0ac06d930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0c013c180 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 msgr2=0x7fd0c0156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c430 tx=0x7fd0b000c8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 shutdown_connections 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd0c015bb40 0x7fd0c00b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0ac06b470 0x7fd0ac06d930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd0c00b4970 0x7fd0c0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 --2- 172.21.15.19:0/4194763974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c006d5c0 0x7fd0c0156570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 >> 172.21.15.19:0/4194763974 conn(0x7fd0c006b190 msgr2=0x7fd0c015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 shutdown_connections 2024-03-04T08:50:31.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:31.975+0000 7fd0c5b2c640 1 -- 172.21.15.19:0/4194763974 wait complete. 2024-03-04T08:50:31.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.087+0000 7f0c88c9d640 1 Processor -- start 2024-03-04T08:50:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.087+0000 7f0c88c9d640 1 -- start start 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c841621c0 0x7f0c840cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0c840d4920 0x7f0c840d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c840d2bf0 0x7f0c8415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840cf690 con 0x7f0c840d2bf0 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840ceac0 con 0x7f0c840d4920 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c88c9d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840ced60 con 0x7f0c841621c0 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c840d2bf0 0x7f0c8415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c840d2bf0 0x7f0c8415dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60032/0 (socket says 172.21.15.19:60032) 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 -- 172.21.15.19:0/2895192959 learned_addr learned my addr 172.21.15.19:0/2895192959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c81d9b640 1 --2- 172.21.15.19:0/2895192959 >> v2:172.21.15.204:3300/0 conn(0x7f0c840d4920 0x7f0c840d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c8259c640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c841621c0 0x7f0c840cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 -- 172.21.15.19:0/2895192959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c841621c0 msgr2=0x7f0c840cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:32.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c841621c0 0x7f0c840cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 -- 172.21.15.19:0/2895192959 >> v2:172.21.15.204:3300/0 conn(0x7f0c840d4920 msgr2=0x7f0c840d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:32.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/2895192959 >> v2:172.21.15.204:3300/0 conn(0x7f0c840d4920 0x7f0c840d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.088+0000 7f0c82d9d640 1 -- 172.21.15.19:0/2895192959 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840cf040 con 0x7f0c840d2bf0 2024-03-04T08:50:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.089+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415dd40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c8408c1b0 tx=0x7f0c7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46b2cc79ee86222 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.089+0000 7f0c8159a640 1 -- 172.21.15.19:0/2895192959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7402ca70 con 0x7f0c840d2bf0 2024-03-04T08:50:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.089+0000 7f0c8159a640 1 -- 172.21.15.19:0/2895192959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7402cc10 con 0x7f0c840d2bf0 2024-03-04T08:50:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.089+0000 7f0c8159a640 1 -- 172.21.15.19:0/2895192959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740343f0 con 0x7f0c840d2bf0 2024-03-04T08:50:32.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 -- 172.21.15.19:0/2895192959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c840d2bf0 msgr2=0x7f0c8415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415dd40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c8408c1b0 tx=0x7f0c7402bed0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 -- 172.21.15.19:0/2895192959 shutdown_connections 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415dd40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/2895192959 >> v2:172.21.15.204:3300/0 conn(0x7f0c840d4920 0x7f0c840d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/2895192959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c841621c0 0x7f0c840cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 -- 172.21.15.19:0/2895192959 >> 172.21.15.19:0/2895192959 conn(0x7f0c840d3d10 msgr2=0x7f0c840d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 -- 172.21.15.19:0/2895192959 shutdown_connections 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.090+0000 7f0c88c9d640 1 -- 172.21.15.19:0/2895192959 wait complete. 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.091+0000 7f0c88c9d640 1 Processor -- start 2024-03-04T08:50:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.091+0000 7f0c88c9d640 1 -- start start 2024-03-04T08:50:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c840d4920 0x7f0c8415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84162720 con 0x7f0c841621c0 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841625a0 con 0x7f0c840d2bf0 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841628a0 con 0x7f0c840d4920 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60034/0 (socket says 172.21.15.19:60034) 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 -- 172.21.15.19:0/146790590 learned_addr learned my addr 172.21.15.19:0/146790590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c8259c640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 -- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c840d4920 msgr2=0x7f0c8415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c840d4920 0x7f0c8415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 -- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 msgr2=0x7f0c8415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 -- 172.21.15.19:0/146790590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8406c540 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c8259c640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c82d9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c7402c4e0 tx=0x7f0c74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74043020 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7403e450 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c841f46a0 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7403e840 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.093+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c841f4c60 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.094+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8404f330 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.094+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f0c74046020 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.094+0000 7f0c7affd640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 0x7f0c6406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.094+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c740ac6e0 con 0x7f0c841621c0 2024-03-04T08:50:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.094+0000 7f0c8259c640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 0x7f0c6406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:32.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.095+0000 7f0c8259c640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 0x7f0c6406d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b820 tx=0x7f0c7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.100+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0c7404d030 con 0x7f0c841621c0 2024-03-04T08:50:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.320+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c840b50b0 con 0x7f0c841621c0 2024-03-04T08:50:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.321+0000 7f0c7affd640 1 -- 172.21.15.19:0/146790590 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f0c8406c540 con 0x7f0c841621c0 2024-03-04T08:50:32.318 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:32.318 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T08:50:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-03-04T08:50:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 msgr2=0x7f0c6406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 0x7f0c6406d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b820 tx=0x7f0c7c008040 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 msgr2=0x7f0c8415dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c7402c4e0 tx=0x7f0c74004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 shutdown_connections 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c841621c0 0x7f0c8415dfb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c840d4920 0x7f0c8415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6406b440 0x7f0c6406d900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 --2- 172.21.15.19:0/146790590 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c840d2bf0 0x7f0c8415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 >> 172.21.15.19:0/146790590 conn(0x7f0c840d3d10 msgr2=0x7f0c8415bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 shutdown_connections 2024-03-04T08:50:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:32.323+0000 7f0c88c9d640 1 -- 172.21.15.19:0/146790590 wait complete. 2024-03-04T08:50:34.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.436+0000 7fd10ccf4640 1 Processor -- start 2024-03-04T08:50:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.436+0000 7fd10ccf4640 1 -- start start 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10ccf4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 0x7fd1080cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10ccf4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1080cf830 0x7fd1080d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10ccf4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080b3430 con 0x7fd1080d27f0 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10ccf4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080d2c50 con 0x7fd1080cf830 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10ccf4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b31e0 con 0x7fd10815dfe0 2024-03-04T08:50:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd105d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1080cf830 0x7fd1080d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd105d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1080cf830 0x7fd1080d22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60048/0 (socket says 172.21.15.19:60048) 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd105d9b640 1 -- 172.21.15.19:0/2096632297 learned_addr learned my addr 172.21.15.19:0/2096632297 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.437+0000 7fd10659c640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 0x7fd1080cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd105d9b640 1 -- 172.21.15.19:0/2096632297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 msgr2=0x7fd1080cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd105d9b640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 0x7fd1080cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd105d9b640 1 -- 172.21.15.19:0/2096632297 >> v1:172.21.15.204:6789/0 conn(0x7fd1080d27f0 legacy=0x7fd1080d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd105d9b640 1 -- 172.21.15.19:0/2096632297 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080b3710 con 0x7fd1080cf830 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd10659c640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 0x7fd1080cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd105d9b640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1080cf830 0x7fd1080d22b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009870 tx=0x7fd0f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0adb0e5f3c1b15 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd10559a640 1 -- 172.21.15.19:0/2096632297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0034070 con 0x7fd1080cf830 2024-03-04T08:50:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd10559a640 1 -- 172.21.15.19:0/2096632297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0030840 con 0x7fd1080cf830 2024-03-04T08:50:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.438+0000 7fd10559a640 1 -- 172.21.15.19:0/2096632297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0030c10 con 0x7fd1080cf830 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2096632297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1080cf830 msgr2=0x7fd1080d22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1080cf830 0x7fd1080d22b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009870 tx=0x7fd0f002b980 comp rx=0 tx=0).stop 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2096632297 shutdown_connections 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1080cf830 0x7fd1080d22b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2096632297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd10815dfe0 0x7fd1080cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2096632297 >> 172.21.15.19:0/2096632297 conn(0x7fd1080d3cd0 msgr2=0x7fd1080d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2096632297 shutdown_connections 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.439+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2096632297 wait complete. 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.440+0000 7fd10ccf4640 1 Processor -- start 2024-03-04T08:50:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.440+0000 7fd10ccf4640 1 -- start start 2024-03-04T08:50:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080cf830 0x7fd1081f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1080d27f0 0x7fd108155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080d1c70 con 0x7fd10815dfe0 2024-03-04T08:50:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b3d60 con 0x7fd1080cf830 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10ccf4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080d1df0 con 0x7fd1080d27f0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60052/0 (socket says 172.21.15.19:60052) 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 -- 172.21.15.19:0/2217022684 learned_addr learned my addr 172.21.15.19:0/2217022684 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd105d9b640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1080d27f0 0x7fd108155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd10659c640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080cf830 0x7fd1081f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 -- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1080d27f0 msgr2=0x7fd108155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1080d27f0 0x7fd108155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 -- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080cf830 msgr2=0x7fd1081f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.441+0000 7fd106d9d640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080cf830 0x7fd1081f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd106d9d640 1 -- 172.21.15.19:0/2217022684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1081f7e70 con 0x7fd10815dfe0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd106d9d640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c400 tx=0x7fd10000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100017070 con 0x7fd10815dfe0 2024-03-04T08:50:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1000052d0 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd108160620 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100003810 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.442+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1080b6ce0 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.443+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10804f330 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.443+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fd10001a070 con 0x7fd10815dfe0 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.444+0000 7fd0feffd640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 0x7fd0e806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.444+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd100088ff0 con 0x7fd10815dfe0 2024-03-04T08:50:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.444+0000 7fd10659c640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 0x7fd0e806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.444+0000 7fd10659c640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 0x7fd0e806d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009fd0 tx=0x7fd0f80097f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.448+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd1081f7e70 con 0x7fd10815dfe0 2024-03-04T08:50:34.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.664+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd108155750 con 0x7fd10815dfe0 2024-03-04T08:50:34.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.665+0000 7fd0feffd640 1 -- 172.21.15.19:0/2217022684 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fd100057ca0 con 0x7fd10815dfe0 2024-03-04T08:50:34.661 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:34.661 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-04T08:50:34.662 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-03-04T08:50:34.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 msgr2=0x7fd0e806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 0x7fd0e806d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009fd0 tx=0x7fd0f80097f0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 msgr2=0x7fd1080b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c400 tx=0x7fd10000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 shutdown_connections 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10815dfe0 0x7fd1080b2180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd1080d27f0 0x7fd108155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd0e806b440 0x7fd0e806d900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 --2- 172.21.15.19:0/2217022684 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd1080cf830 0x7fd1081f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 >> 172.21.15.19:0/2217022684 conn(0x7fd1080d3cd0 msgr2=0x7fd1080cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 shutdown_connections 2024-03-04T08:50:34.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.667+0000 7fd10ccf4640 1 -- 172.21.15.19:0/2217022684 wait complete. 2024-03-04T08:50:34.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.779+0000 7f6be737a640 1 Processor -- start 2024-03-04T08:50:34.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.779+0000 7f6be737a640 1 -- start start 2024-03-04T08:50:34.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be737a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6be01621c0 0x7f6be00cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be737a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be737a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be00ceac0 con 0x7f6be00d4920 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be737a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be00cf690 con 0x7f6be01621c0 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be737a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00d2dc0 con 0x7f6be01625a0 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be4915640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f6be00d4920 0x7f6be00d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:44236/0 (socket says 172.21.15.19:44236) 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be4915640 1 -- 172.21.15.19:0/3629075174 learned_addr learned my addr 172.21.15.19:0/3629075174 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be5116640 1 --2- 172.21.15.19:0/3629075174 >> v2:172.21.15.204:3300/0 conn(0x7f6be01621c0 0x7f6be00cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.780+0000 7f6be5917640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6bdffff640 1 -- 172.21.15.19:0/3629075174 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208132821 0 0) 0x7f6be00ceac0 con 0x7f6be00d4920 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6bdffff640 1 -- 172.21.15.19:0/3629075174 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc8003520 con 0x7f6be00d4920 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6be5116640 1 -- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 msgr2=0x7f6be015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6be5116640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6be5116640 1 -- 172.21.15.19:0/3629075174 >> v1:172.21.15.204:6789/0 conn(0x7f6be00d4920 legacy=0x7f6be00d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6be5116640 1 -- 172.21.15.19:0/3629075174 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00ced60 con 0x7f6be01621c0 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.781+0000 7f6be5116640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be00cfb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80097a0 tx=0x7f6bd802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6b0768c5bc45c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6bdffff640 1 -- 172.21.15.19:0/3629075174 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8035020 con 0x7f6be01621c0 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6bdffff640 1 -- 172.21.15.19:0/3629075174 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd8031830 con 0x7f6be01621c0 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6bdffff640 1 -- 172.21.15.19:0/3629075174 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8031be0 con 0x7f6be01621c0 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 -- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 msgr2=0x7f6be00cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be00cfb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80097a0 tx=0x7f6bd802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 -- 172.21.15.19:0/3629075174 shutdown_connections 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 --2- 172.21.15.19:0/3629075174 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be00cfb20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 -- 172.21.15.19:0/3629075174 >> 172.21.15.19:0/3629075174 conn(0x7f6be00d3d10 msgr2=0x7f6be00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 -- 172.21.15.19:0/3629075174 shutdown_connections 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.782+0000 7f6be737a640 1 -- 172.21.15.19:0/3629075174 wait complete. 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.783+0000 7f6be737a640 1 Processor -- start 2024-03-04T08:50:34.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.783+0000 7f6be737a640 1 -- start start 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be015e280 con 0x7f6be00d4920 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00cf320 con 0x7f6be01621c0 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be737a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be015e400 con 0x7f6be01625a0 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60066/0 (socket says 172.21.15.19:60066) 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 -- 172.21.15.19:0/3883955527 learned_addr learned my addr 172.21.15.19:0/3883955527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5917640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be4915640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 -- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 msgr2=0x7f6be014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 -- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 msgr2=0x7f6be014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.784+0000 7f6be5116640 1 -- 172.21.15.19:0/3883955527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be014ea40 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6be5116640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098c0 tx=0x7f6bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8035040 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd803b900 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be014d460 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd803bcf0 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.785+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be014da20 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.786+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be014e140 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.786+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f6bd8038020 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.787+0000 7f6bddffb640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 0x7f6bcc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.787+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6bd80abe20 con 0x7f6be00d4920 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.787+0000 7f6be4915640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 0x7f6bcc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.787+0000 7f6be4915640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 0x7f6bcc06d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6be00d38c0 tx=0x7f6bd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:34.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.791+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6bd807b0d0 con 0x7f6be00d4920 2024-03-04T08:50:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.973+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6be0161060 con 0x7f6be00d4920 2024-03-04T08:50:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.974+0000 7f6bddffb640 1 -- 172.21.15.19:0/3883955527 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12872 (secure 0 0 0) 0x7f6bd807a9d0 con 0x7f6be00d4920 2024-03-04T08:50:34.971 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:34.971 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:33.703914+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 msgr2=0x7f6bcc06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 0x7f6bcc06d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6be00d38c0 tx=0x7f6bd4009040 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 msgr2=0x7f6be014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098c0 tx=0x7f6bd80046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 shutdown_connections 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6be01625a0 0x7f6be014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6bcc06b440 0x7f6bcc06d900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6be01621c0 0x7f6be014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 --2- 172.21.15.19:0/3883955527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6be00d4920 0x7f6be014e500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 >> 172.21.15.19:0/3883955527 conn(0x7f6be00d3d10 msgr2=0x7f6be015ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 shutdown_connections 2024-03-04T08:50:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:34.976+0000 7f6be737a640 1 -- 172.21.15.19:0/3883955527 wait complete. 2024-03-04T08:50:34.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:34.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.091+0000 7f6295423640 1 Processor -- start 2024-03-04T08:50:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.091+0000 7f6295423640 1 -- start start 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f6295423640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f62901614d0 0x7f62900d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f6295423640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f62900d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f6295423640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900d2740 con 0x7f62900d22b0 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f6295423640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62901618b0 con 0x7f62901614d0 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f6295423640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cf400 con 0x7f62900d1910 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f62900d22b0 0x7f62900d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56694/0 (socket says 172.21.15.19:56694) 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628f7fe640 1 -- 172.21.15.19:0/2304227284 learned_addr learned my addr 172.21.15.19:0/2304227284 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628effd640 1 --2- 172.21.15.19:0/2304227284 >> v2:172.21.15.204:3300/0 conn(0x7f62901614d0 0x7f62900d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371586603 0 0) 0x7f6280001490 con 0x7f62900d22b0 2024-03-04T08:50:35.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f62900d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c003520 con 0x7f62900d22b0 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1242260390 0 0) 0x7f627c003520 con 0x7f62900d22b0 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 msgr2=0x7f62900d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f62900d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 >> v2:172.21.15.204:3300/0 conn(0x7f62901614d0 msgr2=0x7f62900d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 --2- 172.21.15.19:0/2304227284 >> v2:172.21.15.204:3300/0 conn(0x7f62901614d0 0x7f62900d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900cf6a0 con 0x7f62900d22b0 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f6280001bc0 con 0x7f62900d22b0 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.092+0000 7f628effd640 1 --2- 172.21.15.19:0/2304227284 >> v2:172.21.15.204:3300/0 conn(0x7f62901614d0 0x7f62900d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 >> v1:172.21.15.19:6789/0 conn(0x7f62900d22b0 legacy=0x7f62900d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f627c004800 0x7f627c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f627c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62901618b0 con 0x7f627c004800 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cf400 con 0x7f627c0039b0 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00b9c0 con 0x7f62900d1910 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f627c004800 0x7f627c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628effd640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628f7fe640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f627c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 -- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 msgr2=0x7f627c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62900d1910 0x7f627c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 -- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c0039b0 msgr2=0x7f627c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c0039b0 0x7f627c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.093+0000 7f628e7fc640 1 -- 172.21.15.19:0/2304227284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c003520 con 0x7f627c004800 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f627c004800 0x7f627c004c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6278009ac0 tx=0x7f627c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d92ec8ddb86c3b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278039070 con 0x7f627c004800 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627802c6b0 con 0x7f627c004800 2024-03-04T08:50:35.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f628dffb640 1 -- 172.21.15.19:0/2304227284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278009690 con 0x7f627c004800 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 -- 172.21.15.19:0/2304227284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f627c004800 msgr2=0x7f627c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 --2- 172.21.15.19:0/2304227284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f627c004800 0x7f627c004c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6278009ac0 tx=0x7f627c005830 comp rx=0 tx=0).stop 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f628f7fe640 1 -- 172.21.15.19:0/2304227284 reap_dead start 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 -- 172.21.15.19:0/2304227284 shutdown_connections 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 -- 172.21.15.19:0/2304227284 >> 172.21.15.19:0/2304227284 conn(0x7f62900d3d40 msgr2=0x7f62900d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 -- 172.21.15.19:0/2304227284 shutdown_connections 2024-03-04T08:50:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.094+0000 7f6295423640 1 -- 172.21.15.19:0/2304227284 wait complete. 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 Processor -- start 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 -- start start 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c004800 0x7f62900b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62901f7820 0x7f62901f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b0910 con 0x7f62900cae10 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cfc60 con 0x7f627c004800 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f6295423640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b1e40 con 0x7f62901f7820 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f628e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f628e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60086/0 (socket says 172.21.15.19:60086) 2024-03-04T08:50:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.096+0000 7f628e7fc640 1 -- 172.21.15.19:0/2250925965 learned_addr learned my addr 172.21.15.19:0/2250925965 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628f7fe640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62901f7820 0x7f62901f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628effd640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c004800 0x7f62900b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 -- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62901f7820 msgr2=0x7f62901f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62901f7820 0x7f62901f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 -- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c004800 msgr2=0x7f62900b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c004800 0x7f62900b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 -- 172.21.15.19:0/2250925965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62901f81e0 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f628e7fc640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6278037040 tx=0x7f6278004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278042020 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627803a040 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900ccef0 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278039070 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.097+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900cd4b0 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.098+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6290068ff0 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.099+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f6278045020 con 0x7f62900cae10 2024-03-04T08:50:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.099+0000 7f62877fe640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 0x7f627006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.099+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f62780aaf40 con 0x7f62900cae10 2024-03-04T08:50:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.099+0000 7f628effd640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 0x7f627006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.100+0000 7f628effd640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 0x7f627006d930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62880093d0 tx=0x7f6288009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.103+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f627804c070 con 0x7f62900cae10 2024-03-04T08:50:35.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.283+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62900d0cc0 con 0x7f62900cae10 2024-03-04T08:50:35.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.284+0000 7f62877fe640 1 -- 172.21.15.19:0/2250925965 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6278079ba0 con 0x7f62900cae10 2024-03-04T08:50:35.280 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 msgr2=0x7f627006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 0x7f627006d930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62880093d0 tx=0x7f6288009190 comp rx=0 tx=0).stop 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 msgr2=0x7f62900cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6278037040 tx=0x7f6278004730 comp rx=0 tx=0).stop 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 shutdown_connections 2024-03-04T08:50:35.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f62901f7820 0x7f62901f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62900cae10 0x7f62900cb290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f627006b470 0x7f627006d930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 --2- 172.21.15.19:0/2250925965 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f627c004800 0x7f62900b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.285+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 >> 172.21.15.19:0/2250925965 conn(0x7f62900d3d40 msgr2=0x7f62900b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.286+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 shutdown_connections 2024-03-04T08:50:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.286+0000 7f6295423640 1 -- 172.21.15.19:0/2250925965 wait complete. 2024-03-04T08:50:35.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T08:50:35.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 Processor -- start 2024-03-04T08:50:35.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 -- start start 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fac300d4920 0x7fac300cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac301625a0 0x7fac3015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300ceac0 con 0x7fac301621c0 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300cf690 con 0x7fac301625a0 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac36ac9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300d2dc0 con 0x7fac300d4920 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.400+0000 7fac35066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac301625a0 0x7fac3015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac34865640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fac301621c0 0x7fac300d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56710/0 (socket says 172.21.15.19:56710) 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac34865640 1 -- 172.21.15.19:0/3912437719 learned_addr learned my addr 172.21.15.19:0/3912437719 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac35066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac301625a0 0x7fac3015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60098/0 (socket says 172.21.15.19:60098) 2024-03-04T08:50:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac35066640 1 -- 172.21.15.19:0/3912437719 >> v2:172.21.15.204:3300/0 conn(0x7fac300d4920 msgr2=0x7fac300cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac2ffff640 1 --2- 172.21.15.19:0/3912437719 >> v2:172.21.15.204:3300/0 conn(0x7fac300d4920 0x7fac300cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac2f7fe640 1 -- 172.21.15.19:0/3912437719 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638166731 0 0) 0x7fac300ceac0 con 0x7fac301621c0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac35066640 1 --2- 172.21.15.19:0/3912437719 >> v2:172.21.15.204:3300/0 conn(0x7fac300d4920 0x7fac300cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac35066640 1 -- 172.21.15.19:0/3912437719 >> v1:172.21.15.19:6789/0 conn(0x7fac301621c0 legacy=0x7fac300d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.401+0000 7fac35066640 1 -- 172.21.15.19:0/3912437719 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300ced60 con 0x7fac301625a0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac35066640 1 --2- 172.21.15.19:0/3912437719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301625a0 0x7fac3015dd40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac300736c0 tx=0x7fac2802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f54a7ca607f903 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac2f7fe640 1 -- 172.21.15.19:0/3912437719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28039070 con 0x7fac301625a0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac2f7fe640 1 -- 172.21.15.19:0/3912437719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2802cbf0 con 0x7fac301625a0 2024-03-04T08:50:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac2f7fe640 1 -- 172.21.15.19:0/3912437719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28034440 con 0x7fac301625a0 2024-03-04T08:50:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 -- 172.21.15.19:0/3912437719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301625a0 msgr2=0x7fac3015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 --2- 172.21.15.19:0/3912437719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301625a0 0x7fac3015dd40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac300736c0 tx=0x7fac2802be40 comp rx=0 tx=0).stop 2024-03-04T08:50:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 -- 172.21.15.19:0/3912437719 shutdown_connections 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 --2- 172.21.15.19:0/3912437719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301625a0 0x7fac3015dd40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 --2- 172.21.15.19:0/3912437719 >> v2:172.21.15.204:3300/0 conn(0x7fac300d4920 0x7fac300cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 -- 172.21.15.19:0/3912437719 >> 172.21.15.19:0/3912437719 conn(0x7fac300d3d10 msgr2=0x7fac300d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 -- 172.21.15.19:0/3912437719 shutdown_connections 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.402+0000 7fac36ac9640 1 -- 172.21.15.19:0/3912437719 wait complete. 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.403+0000 7fac36ac9640 1 Processor -- start 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.403+0000 7fac36ac9640 1 -- start start 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 0x7fac301515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac301625a0 0x7fac3009f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015e280 con 0x7fac301621c0 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300cf320 con 0x7fac300d4920 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac36ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015e400 con 0x7fac301625a0 2024-03-04T08:50:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60102/0 (socket says 172.21.15.19:60102) 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac2ffff640 1 -- 172.21.15.19:0/2377887705 learned_addr learned my addr 172.21.15.19:0/2377887705 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac35066640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac301625a0 0x7fac3009f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.404+0000 7fac34865640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 0x7fac301515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 -- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac301625a0 msgr2=0x7fac3009f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac301625a0 0x7fac3009f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 -- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 msgr2=0x7fac301515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 0x7fac301515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 -- 172.21.15.19:0/2377887705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30151af0 con 0x7fac301621c0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac34865640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 0x7fac301515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2ffff640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7f0 tx=0x7fac1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c015070 con 0x7fac301621c0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c004240 con 0x7fac301621c0 2024-03-04T08:50:35.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac300b9430 con 0x7fac301621c0 2024-03-04T08:50:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007620 con 0x7fac301621c0 2024-03-04T08:50:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.405+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300b6a10 con 0x7fac301621c0 2024-03-04T08:50:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.406+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3004f330 con 0x7fac301621c0 2024-03-04T08:50:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.406+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac1c0079d0 con 0x7fac301621c0 2024-03-04T08:50:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.407+0000 7fac2d7fa640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.407+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac1c08a210 con 0x7fac301621c0 2024-03-04T08:50:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.407+0000 7fac34865640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.408+0000 7fac34865640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac24000f60 tx=0x7fac24007c30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.411+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fac30151af0 con 0x7fac301621c0 2024-03-04T08:50:35.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.593+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac300ca610 con 0x7fac301621c0 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.593+0000 7fac2d7fa640 1 -- 172.21.15.19:0/2377887705 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fac1c058d90 con 0x7fac301621c0 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:50:35.590 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 msgr2=0x7fac1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac24000f60 tx=0x7fac24007c30 comp rx=0 tx=0).stop 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 msgr2=0x7fac3009eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7f0 tx=0x7fac1c00ccb0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 shutdown_connections 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac301625a0 0x7fac3009f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac301621c0 0x7fac3009eb50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 --2- 172.21.15.19:0/2377887705 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac300d4920 0x7fac301515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.595+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 >> 172.21.15.19:0/2377887705 conn(0x7fac300d3d10 msgr2=0x7fac300d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:35.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.596+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 shutdown_connections 2024-03-04T08:50:35.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.596+0000 7fac36ac9640 1 -- 172.21.15.19:0/2377887705 wait complete. 2024-03-04T08:50:35.602 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T08:50:35.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T08:50:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.711+0000 7fb3560b5640 1 Processor -- start 2024-03-04T08:50:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.711+0000 7fb3560b5640 1 -- start start 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb3560b5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb3500708b0 0x7fb350070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb3560b5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35015afe0 con 0x7fb3500ce0a0 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb3560b5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500cd000 con 0x7fb35015ac00 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb3560b5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb350071250 con 0x7fb3500708b0 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb3500ce0a0 0x7fb3500ce550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56712/0 (socket says 172.21.15.19:56712) 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34ffff640 1 -- 172.21.15.19:0/1540838071 learned_addr learned my addr 172.21.15.19:0/1540838071 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34effd640 1 --2- 172.21.15.19:0/1540838071 >> v2:172.21.15.204:3300/0 conn(0x7fb3500708b0 0x7fb350070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528646035 0 0) 0x7fb35015afe0 con 0x7fb3500ce0a0 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb338003520 con 0x7fb3500ce0a0 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 651227103 0 0) 0x7fb338003520 con 0x7fb3500ce0a0 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 >> v2:172.21.15.204:3300/0 conn(0x7fb3500708b0 msgr2=0x7fb350070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 --2- 172.21.15.19:0/1540838071 >> v2:172.21.15.204:3300/0 conn(0x7fb3500708b0 0x7fb350070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 >> v1:172.21.15.204:6789/0 conn(0x7fb35015ac00 legacy=0x7fb35006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500cd2e0 con 0x7fb3500ce0a0 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fb3480019f0 con 0x7fb3500ce0a0 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.712+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 >> v1:172.21.15.19:6789/0 conn(0x7fb3500ce0a0 legacy=0x7fb3500ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338003a00 0x7fb338003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 0x7fb338004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb338005210 0x7fb33800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33800c130 con 0x7fb338004800 2024-03-04T08:50:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33800c2e0 con 0x7fb338005210 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33800c4e0 con 0x7fb338003a00 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 0x7fb338004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34ffff640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb338005210 0x7fb33800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338003a00 0x7fb338003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 -- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338003a00 msgr2=0x7fb338003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338003a00 0x7fb338003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 -- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb338005210 msgr2=0x7fb33800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb338005210 0x7fb33800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34ffff640 1 -- 172.21.15.19:0/1540838071 reap_dead start 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34effd640 1 -- 172.21.15.19:0/1540838071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338003520 con 0x7fb338004800 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.713+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338003a00 0x7fb338003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb34effd640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 0x7fb338004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb350072d60 tx=0x7fb338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b08ad9c8187686 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344039070 con 0x7fb338004800 2024-03-04T08:50:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34402c660 con 0x7fb338004800 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb34e7fc640 1 -- 172.21.15.19:0/1540838071 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344009690 con 0x7fb338004800 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 -- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 msgr2=0x7fb338004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 0x7fb338004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb350072d60 tx=0x7fb338005830 comp rx=0 tx=0).stop 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 -- 172.21.15.19:0/1540838071 shutdown_connections 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 --2- 172.21.15.19:0/1540838071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb338004800 0x7fb338004c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 -- 172.21.15.19:0/1540838071 >> 172.21.15.19:0/1540838071 conn(0x7fb3500b1650 msgr2=0x7fb3500b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 -- 172.21.15.19:0/1540838071 shutdown_connections 2024-03-04T08:50:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.714+0000 7fb3560b5640 1 -- 172.21.15.19:0/1540838071 wait complete. 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 Processor -- start 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 -- start start 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 0x7fb350151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb350159680 0x7fb350159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500cd8a0 con 0x7fb350156e20 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500cdc10 con 0x7fb350159680 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb3560b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500cf5d0 con 0x7fb338004800 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.716+0000 7fb34ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60116/0 (socket says 172.21.15.19:60116) 2024-03-04T08:50:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 -- 172.21.15.19:0/666368211 learned_addr learned my addr 172.21.15.19:0/666368211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 0x7fb350151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34effd640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb350159680 0x7fb350159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 -- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 msgr2=0x7fb350151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 0x7fb350151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 -- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb350159680 msgr2=0x7fb350159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb350159680 0x7fb350159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 -- 172.21.15.19:0/666368211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350157b90 con 0x7fb350156e20 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 0x7fb350151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb34ffff640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3500cbb30 tx=0x7fb348007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348017020 con 0x7fb350156e20 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800aab0 con 0x7fb350156e20 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480133f0 con 0x7fb350156e20 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb350157e70 con 0x7fb350156e20 2024-03-04T08:50:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.717+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb350158430 con 0x7fb350156e20 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.718+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3500687d0 con 0x7fb350156e20 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.719+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb34801a020 con 0x7fb350156e20 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.719+0000 7fb337fff640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 0x7fb33c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.719+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb34808a450 con 0x7fb350156e20 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.719+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 0x7fb33c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.720+0000 7fb34f7fe640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 0x7fb33c06d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb350151d10 tx=0x7fb340009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.723+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb348021020 con 0x7fb350156e20 2024-03-04T08:50:35.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:35.907+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb35015d8b0 con 0x7fb350156e20 2024-03-04T08:50:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.329+0000 7fb337fff640 1 -- 172.21.15.19:0/666368211 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb3480596b0 con 0x7fb350156e20 2024-03-04T08:50:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 msgr2=0x7fb33c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 0x7fb33c06d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb350151d10 tx=0x7fb340009040 comp rx=0 tx=0).stop 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 msgr2=0x7fb3501572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3500cbb30 tx=0x7fb348007bd0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 shutdown_connections 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb350156e20 0x7fb3501572a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb33c06b500 0x7fb33c06d9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb350159680 0x7fb350159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 --2- 172.21.15.19:0/666368211 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb338004800 0x7fb350151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 >> 172.21.15.19:0/666368211 conn(0x7fb3500b1650 msgr2=0x7fb3500ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 shutdown_connections 2024-03-04T08:50:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.333+0000 7fb3560b5640 1 -- 172.21.15.19:0/666368211 wait complete. 2024-03-04T08:50:36.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T08:50:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.460+0000 7f99b64df640 1 Processor -- start 2024-03-04T08:50:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.460+0000 7f99b64df640 1 -- start start 2024-03-04T08:50:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99b64df640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f99b00b1e40 0x7f99b0168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99b64df640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00d2730 con 0x7f99b00d4860 2024-03-04T08:50:36.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99b64df640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b01618b0 con 0x7f99b01614d0 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99b64df640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00d4cf0 con 0x7f99b00b1e40 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99af7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99b00d4860 0x7f99b00d2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56722/0 (socket says 172.21.15.19:56722) 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99af7fe640 1 -- 172.21.15.19:0/2064799260 learned_addr learned my addr 172.21.15.19:0/2064799260 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/2064799260 >> v2:172.21.15.204:3300/0 conn(0x7f99b00b1e40 0x7f99b0168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304907791 0 0) 0x7f99b00d2730 con 0x7f99b00d4860 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9998003520 con 0x7f99b00d4860 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428073126 0 0) 0x7f9998003520 con 0x7f99b00d4860 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 >> v2:172.21.15.204:3300/0 conn(0x7f99b00b1e40 msgr2=0x7f99b0168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 --2- 172.21.15.19:0/2064799260 >> v2:172.21.15.204:3300/0 conn(0x7f99b00b1e40 0x7f99b0168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 >> v1:172.21.15.204:6789/0 conn(0x7f99b01614d0 legacy=0x7f99b00d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00cf400 con 0x7f99b00d4860 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f99a0001670 con 0x7f99b00d4860 2024-03-04T08:50:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 >> v1:172.21.15.19:6789/0 conn(0x7f99b00d4860 legacy=0x7f99b00d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99980039b0 0x7f9998003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9998004800 0x7f9998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f999800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00d4cf0 con 0x7f9998005210 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999800c140 con 0x7f9998004800 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.461+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999800c340 con 0x7f99980039b0 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99af7fe640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9998004800 0x7f9998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99affff640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99980039b0 0x7f9998003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f999800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 -- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99980039b0 msgr2=0x7f9998003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99980039b0 0x7f9998003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 -- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9998004800 msgr2=0x7f9998004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9998004800 0x7f9998004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 -- 172.21.15.19:0/2064799260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998003520 con 0x7f9998005210 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.462+0000 7f99b4a7c640 1 -- 172.21.15.19:0/2064799260 reap_dead start 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f999800b9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009fc0 tx=0x7f9998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918ee5eeb2f9e34a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8009c10 con 0x7f9998005210 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a802cca0 con 0x7f9998005210 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99aeffd640 1 -- 172.21.15.19:0/2064799260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8003bd0 con 0x7f9998005210 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 -- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 msgr2=0x7f999800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f999800b9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009fc0 tx=0x7f9998005830 comp rx=0 tx=0).stop 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 -- 172.21.15.19:0/2064799260 shutdown_connections 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 --2- 172.21.15.19:0/2064799260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f999800b9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 -- 172.21.15.19:0/2064799260 >> 172.21.15.19:0/2064799260 conn(0x7f99b00d3d40 msgr2=0x7f99b00d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 -- 172.21.15.19:0/2064799260 shutdown_connections 2024-03-04T08:50:36.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.463+0000 7f99b64df640 1 -- 172.21.15.19:0/2064799260 wait complete. 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.464+0000 7f99b64df640 1 Processor -- start 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 -- start start 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b00cbc70 0x7f99b00cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b006c280 0x7f99b006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00cfc60 con 0x7f9998005210 2024-03-04T08:50:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00cf980 con 0x7f99b006c280 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b64df640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00b0910 con 0x7f99b00cbc70 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60132/0 (socket says 172.21.15.19:60132) 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99affff640 1 -- 172.21.15.19:0/3211254390 learned_addr learned my addr 172.21.15.19:0/3211254390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99af7fe640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b00cbc70 0x7f99b00cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.465+0000 7f99b4a7c640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b006c280 0x7f99b006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 -- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b00cbc70 msgr2=0x7f99b00cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b00cbc70 0x7f99b00cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 -- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b006c280 msgr2=0x7f99b006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b006c280 0x7f99b006c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 -- 172.21.15.19:0/3211254390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00c98d0 con 0x7f9998005210 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99affff640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99a400f5f0 tx=0x7f99a400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40052e0 con 0x7f9998005210 2024-03-04T08:50:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4018070 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b00caeb0 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4003810 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.466+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b00cb470 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.467+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b006cc40 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.467+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99a40039b0 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.468+0000 7f99acff9640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 0x7f999c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.468+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f99a4089c50 con 0x7f9998005210 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.468+0000 7f99af7fe640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 0x7f999c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.468+0000 7f99af7fe640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 0x7f999c06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b00d0490 tx=0x7f99a0001c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:36.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.472+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f99a408f020 con 0x7f9998005210 2024-03-04T08:50:36.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:36.653+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99b0068ff0 con 0x7f9998005210 2024-03-04T08:50:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.336+0000 7f99acff9640 1 -- 172.21.15.19:0/3211254390 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f99a40586f0 con 0x7f9998005210 2024-03-04T08:50:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-03-04T08:50:37.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 msgr2=0x7f999c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 0x7f999c06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b00d0490 tx=0x7f99a0001c60 comp rx=0 tx=0).stop 2024-03-04T08:50:37.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 msgr2=0x7f99b01574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99a400f5f0 tx=0x7f99a400fab0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 shutdown_connections 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f999c06b4d0 0x7f999c06d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99b006c280 0x7f99b006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99b00cbc70 0x7f99b00cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 --2- 172.21.15.19:0/3211254390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9998005210 0x7f99b01574c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.340+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 >> 172.21.15.19:0/3211254390 conn(0x7f99b00d3d40 msgr2=0x7f99b0160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.341+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 shutdown_connections 2024-03-04T08:50:37.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.341+0000 7f99b64df640 1 -- 172.21.15.19:0/3211254390 wait complete. 2024-03-04T08:50:37.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T08:50:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.475+0000 7fd6582b8640 1 Processor -- start 2024-03-04T08:50:37.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.475+0000 7fd6582b8640 1 -- start start 2024-03-04T08:50:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd6582b8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd6582b8640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd6500b3cd0 0x7fd65015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd6582b8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65015bdf0 con 0x7fd650158420 2024-03-04T08:50:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd6582b8640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65015e650 con 0x7fd6500b3cd0 2024-03-04T08:50:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd6582b8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015e8a0 con 0x7fd650158800 2024-03-04T08:50:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd655853640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd656855640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd6500b3cd0 0x7fd65015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd655853640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:38912/0 (socket says 172.21.15.19:38912) 2024-03-04T08:50:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd655853640 1 -- 172.21.15.19:0/1277331011 learned_addr learned my addr 172.21.15.19:0/1277331011 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.476+0000 7fd656054640 1 --1- 172.21.15.19:0/1277331011 >> v1:172.21.15.204:6789/0 conn(0x7fd650158420 0x7fd6500b35c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:53634/0 (socket says 172.21.15.19:53634) 2024-03-04T08:50:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.477+0000 7fd655853640 1 -- 172.21.15.19:0/1277331011 >> v2:172.21.15.204:3300/0 conn(0x7fd6500b3cd0 msgr2=0x7fd65015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.477+0000 7fd655853640 1 --2- 172.21.15.19:0/1277331011 >> v2:172.21.15.204:3300/0 conn(0x7fd6500b3cd0 0x7fd65015b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.477+0000 7fd655853640 1 -- 172.21.15.19:0/1277331011 >> v1:172.21.15.204:6789/0 conn(0x7fd650158420 legacy=0x7fd6500b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.477+0000 7fd655853640 1 -- 172.21.15.19:0/1277331011 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65015eb80 con 0x7fd650158800 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.477+0000 7fd655853640 1 --2- 172.21.15.19:0/1277331011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd64402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d19e0ad277520c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd655052640 1 -- 172.21.15.19:0/1277331011 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644035020 con 0x7fd650158800 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd655052640 1 -- 172.21.15.19:0/1277331011 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644031640 con 0x7fd650158800 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd655052640 1 -- 172.21.15.19:0/1277331011 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64402d040 con 0x7fd650158800 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 -- 172.21.15.19:0/1277331011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 msgr2=0x7fd65015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1277331011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd64402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 -- 172.21.15.19:0/1277331011 shutdown_connections 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1277331011 >> v2:172.21.15.204:3300/0 conn(0x7fd6500b3cd0 0x7fd65015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1277331011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158800 0x7fd65015b370 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 -- 172.21.15.19:0/1277331011 >> 172.21.15.19:0/1277331011 conn(0x7fd65006afb0 msgr2=0x7fd65006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:37.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 -- 172.21.15.19:0/1277331011 shutdown_connections 2024-03-04T08:50:37.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.478+0000 7fd6582b8640 1 -- 172.21.15.19:0/1277331011 wait complete. 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.479+0000 7fd6582b8640 1 Processor -- start 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.479+0000 7fd6582b8640 1 -- start start 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 0x7fd6501e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6501e59c0 0x7fd65006da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650071a20 con 0x7fd6500b3cd0 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015f140 con 0x7fd6501e59c0 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd6582b8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd650071ba0 con 0x7fd650158420 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd656054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd656054640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45850/0 (socket says 172.21.15.19:45850) 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd656054640 1 -- 172.21.15.19:0/1251404439 learned_addr learned my addr 172.21.15.19:0/1251404439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd655853640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 0x7fd6501e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.480+0000 7fd656855640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6501e59c0 0x7fd65006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 -- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6501e59c0 msgr2=0x7fd65006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6501e59c0 0x7fd65006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 -- 172.21.15.19:0/1251404439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 msgr2=0x7fd650148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 -- 172.21.15.19:0/1251404439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6501f3120 con 0x7fd650158420 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd656054640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd655853640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 0x7fd6501e5480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd644033000 tx=0x7fd6440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644040070 con 0x7fd650158420 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440399f0 con 0x7fd650158420 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644035040 con 0x7fd650158420 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd650149420 con 0x7fd650158420 2024-03-04T08:50:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.481+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6501f2640 con 0x7fd650158420 2024-03-04T08:50:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.482+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65004f330 con 0x7fd650158420 2024-03-04T08:50:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.483+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd64404b060 con 0x7fd650158420 2024-03-04T08:50:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.483+0000 7fd64effd640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 0x7fd63c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.483+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd6440abc10 con 0x7fd650158420 2024-03-04T08:50:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.483+0000 7fd656054640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 0x7fd63c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.484+0000 7fd656054640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 0x7fd63c06d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd640007fd0 tx=0x7fd640001740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.487+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd64407a4d0 con 0x7fd650158420 2024-03-04T08:50:37.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:37.706+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd6500b2a30 con 0x7fd650158420 2024-03-04T08:50:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-03-04T08:50:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.346+0000 7fd64effd640 1 -- 172.21.15.19:0/1251404439 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd64407e570 con 0x7fd650158420 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.356+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 msgr2=0x7fd63c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.356+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 0x7fd63c06d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd640007fd0 tx=0x7fd640001740 comp rx=0 tx=0).stop 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.356+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 msgr2=0x7fd6501e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.356+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 0x7fd6501e5480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd644033000 tx=0x7fd6440046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 shutdown_connections 2024-03-04T08:50:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd63c06b4d0 0x7fd63c06d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd6501e59c0 0x7fd65006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd650158420 0x7fd6501e5480 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 --2- 172.21.15.19:0/1251404439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6500b3cd0 0x7fd650148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.357+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 >> 172.21.15.19:0/1251404439 conn(0x7fd65006afb0 msgr2=0x7fd6500cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.358+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 shutdown_connections 2024-03-04T08:50:38.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.359+0000 7fd6582b8640 1 -- 172.21.15.19:0/1251404439 wait complete. 2024-03-04T08:50:38.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:38.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.485+0000 7f2b79a33640 1 Processor -- start 2024-03-04T08:50:38.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.485+0000 7f2b79a33640 1 -- start start 2024-03-04T08:50:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2b7415bdd0 0x7f2b740c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b740d16e0 0x7f2b740d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740cebe0 con 0x7f2b740d16e0 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740ceec0 con 0x7f2b7415bdd0 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b79a33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740cf1a0 con 0x7f2b7415fa10 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b740d16e0 0x7f2b740d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b740d16e0 0x7f2b740d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45862/0 (socket says 172.21.15.19:45862) 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 -- 172.21.15.19:0/1093505589 learned_addr learned my addr 172.21.15.19:0/1093505589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 -- 172.21.15.19:0/1093505589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 msgr2=0x7f2b740ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 --2- 172.21.15.19:0/1093505589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 -- 172.21.15.19:0/1093505589 >> v2:172.21.15.204:3300/0 conn(0x7f2b7415bdd0 msgr2=0x7f2b740c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 --2- 172.21.15.19:0/1093505589 >> v2:172.21.15.204:3300/0 conn(0x7f2b7415bdd0 0x7f2b740c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.486+0000 7f2b737fe640 1 -- 172.21.15.19:0/1093505589 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740cc8e0 con 0x7f2b740d16e0 2024-03-04T08:50:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.487+0000 7f2b737fe640 1 --2- 172.21.15.19:0/1093505589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b740d16e0 0x7f2b740d1b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406e3c0 tx=0x7f2b6c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8705c459fb27260f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.487+0000 7f2b71ffb640 1 -- 172.21.15.19:0/1093505589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c02e070 con 0x7f2b740d16e0 2024-03-04T08:50:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.487+0000 7f2b71ffb640 1 -- 172.21.15.19:0/1093505589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c037070 con 0x7f2b740d16e0 2024-03-04T08:50:38.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.487+0000 7f2b71ffb640 1 -- 172.21.15.19:0/1093505589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c031a00 con 0x7f2b740d16e0 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 -- 172.21.15.19:0/1093505589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b740d16e0 msgr2=0x7f2b740d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 --2- 172.21.15.19:0/1093505589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b740d16e0 0x7f2b740d1b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406e3c0 tx=0x7f2b6c02b880 comp rx=0 tx=0).stop 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 -- 172.21.15.19:0/1093505589 shutdown_connections 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 --2- 172.21.15.19:0/1093505589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b740d16e0 0x7f2b740d1b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 --2- 172.21.15.19:0/1093505589 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 --2- 172.21.15.19:0/1093505589 >> v2:172.21.15.204:3300/0 conn(0x7f2b7415bdd0 0x7f2b740c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 -- 172.21.15.19:0/1093505589 >> 172.21.15.19:0/1093505589 conn(0x7f2b7409a9f0 msgr2=0x7f2b7409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 -- 172.21.15.19:0/1093505589 shutdown_connections 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.488+0000 7f2b79a33640 1 -- 172.21.15.19:0/1093505589 wait complete. 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.489+0000 7f2b79a33640 1 Processor -- start 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.489+0000 7f2b79a33640 1 -- start start 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b740d16e0 0x7f2b740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740cc5d0 con 0x7f2b7415bdd0 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740d2070 con 0x7f2b740d16e0 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b79a33640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415c1b0 con 0x7f2b7415fa10 2024-03-04T08:50:38.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45864/0 (socket says 172.21.15.19:45864) 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 -- 172.21.15.19:0/735215431 learned_addr learned my addr 172.21.15.19:0/735215431 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b72ffd640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b740d16e0 0x7f2b740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b737fe640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 -- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 msgr2=0x7f2b740b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 -- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b740d16e0 msgr2=0x7f2b740b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b740d16e0 0x7f2b740b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.490+0000 7f2b727fc640 1 -- 172.21.15.19:0/735215431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740c9550 con 0x7f2b7415bdd0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b727fc640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00b440 tx=0x7f2b5c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c015020 con 0x7f2b7415bdd0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c011890 con 0x7f2b7415bdd0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b740c97f0 con 0x7f2b7415bdd0 2024-03-04T08:50:38.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c011c80 con 0x7f2b7415bdd0 2024-03-04T08:50:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.491+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b740c9db0 con 0x7f2b7415bdd0 2024-03-04T08:50:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.492+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7404f330 con 0x7f2b7415bdd0 2024-03-04T08:50:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.492+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b5c018020 con 0x7f2b7415bdd0 2024-03-04T08:50:38.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.493+0000 7f2b6bfff640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 0x7f2b5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.493+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b5c08a2c0 con 0x7f2b7415bdd0 2024-03-04T08:50:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.493+0000 7f2b72ffd640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 0x7f2b5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.493+0000 7f2b72ffd640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 0x7f2b5406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009f20 tx=0x7f2b640094f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.497+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2b5c01f020 con 0x7f2b7415bdd0 2024-03-04T08:50:38.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.678+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b740b7a40 con 0x7f2b7415bdd0 2024-03-04T08:50:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.679+0000 7f2b6bfff640 1 -- 172.21.15.19:0/735215431 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f2b5c00d040 con 0x7f2b7415bdd0 2024-03-04T08:50:38.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:38.675 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:37.708554+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:38.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 msgr2=0x7f2b5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 0x7f2b5406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009f20 tx=0x7f2b640094f0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 msgr2=0x7f2b740b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00b440 tx=0x7f2b5c00b900 comp rx=0 tx=0).stop 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 shutdown_connections 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2b7415fa10 0x7f2b740b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b7415bdd0 0x7f2b740b6890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2b5406b500 0x7f2b5406d9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 --2- 172.21.15.19:0/735215431 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b740d16e0 0x7f2b740b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 >> 172.21.15.19:0/735215431 conn(0x7f2b7409a9f0 msgr2=0x7f2b740701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 shutdown_connections 2024-03-04T08:50:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.681+0000 7f2b79a33640 1 -- 172.21.15.19:0/735215431 wait complete. 2024-03-04T08:50:38.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:38.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.793+0000 7fd4abd1e640 1 Processor -- start 2024-03-04T08:50:38.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.793+0000 7fd4abd1e640 1 -- start start 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4abd1e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4a41621c0 0x7fd4a40cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4abd1e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd4a41625a0 0x7fd4a415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4abd1e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40ceac0 con 0x7fd4a40d4920 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4abd1e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40cf690 con 0x7fd4a41621c0 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4abd1e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40d2dc0 con 0x7fd4a41625a0 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4a41621c0 0x7fd4a40cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4a41621c0 0x7fd4a40cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45872/0 (socket says 172.21.15.19:45872) 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 -- 172.21.15.19:0/993282445 learned_addr learned my addr 172.21.15.19:0/993282445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 -- 172.21.15.19:0/993282445 >> v2:172.21.15.204:3300/0 conn(0x7fd4a41625a0 msgr2=0x7fd4a415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 --2- 172.21.15.19:0/993282445 >> v2:172.21.15.204:3300/0 conn(0x7fd4a41625a0 0x7fd4a415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 -- 172.21.15.19:0/993282445 >> v1:172.21.15.204:6789/0 conn(0x7fd4a40d4920 legacy=0x7fd4a40d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.794+0000 7fd4a9aba640 1 -- 172.21.15.19:0/993282445 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40ced60 con 0x7fd4a41621c0 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.795+0000 7fd4a9aba640 1 --2- 172.21.15.19:0/993282445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41621c0 0x7fd4a40cfb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40d3be0 tx=0x7fd4a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37703ad2f48bb628 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.795+0000 7fd4a8ab8640 1 -- 172.21.15.19:0/993282445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a002e070 con 0x7fd4a41621c0 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.795+0000 7fd4a8ab8640 1 -- 172.21.15.19:0/993282445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0037070 con 0x7fd4a41621c0 2024-03-04T08:50:38.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.795+0000 7fd4a8ab8640 1 -- 172.21.15.19:0/993282445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0031a00 con 0x7fd4a41621c0 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 -- 172.21.15.19:0/993282445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41621c0 msgr2=0x7fd4a40cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/993282445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41621c0 0x7fd4a40cfb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40d3be0 tx=0x7fd4a002b880 comp rx=0 tx=0).stop 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 -- 172.21.15.19:0/993282445 shutdown_connections 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/993282445 >> v2:172.21.15.204:3300/0 conn(0x7fd4a41625a0 0x7fd4a415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/993282445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41621c0 0x7fd4a40cfb20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 -- 172.21.15.19:0/993282445 >> 172.21.15.19:0/993282445 conn(0x7fd4a40d3d10 msgr2=0x7fd4a40d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 -- 172.21.15.19:0/993282445 shutdown_connections 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.796+0000 7fd4abd1e640 1 -- 172.21.15.19:0/993282445 wait complete. 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 Processor -- start 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 -- start start 2024-03-04T08:50:38.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a40d4920 0x7fd4a40a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a41621c0 0x7fd4a40b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415e280 con 0x7fd4a41625a0 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40cf320 con 0x7fd4a40d4920 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.797+0000 7fd4abd1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415e400 con 0x7fd4a41621c0 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45874/0 (socket says 172.21.15.19:45874) 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 -- 172.21.15.19:0/706183147 learned_addr learned my addr 172.21.15.19:0/706183147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4a9aba640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a40d4920 0x7fd4a40a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4a92b9640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a41621c0 0x7fd4a40b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 -- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a41621c0 msgr2=0x7fd4a40b90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a41621c0 0x7fd4a40b90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 -- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a40d4920 msgr2=0x7fd4a40a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a40d4920 0x7fd4a40a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 -- 172.21.15.19:0/706183147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40cc270 con 0x7fd4a41625a0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4aa2bb640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b970 tx=0x7fd49c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c019070 con 0x7fd4a41625a0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00cb60 con 0x7fd4a41625a0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a40a0e40 con 0x7fd4a41625a0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c014440 con 0x7fd4a41625a0 2024-03-04T08:50:38.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.798+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a40a1400 con 0x7fd4a41625a0 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.799+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a40a15d0 con 0x7fd4a41625a0 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.800+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd49c01c070 con 0x7fd4a41625a0 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.800+0000 7fd49a7fc640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 0x7fd48806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.800+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd49c089e00 con 0x7fd4a41625a0 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.800+0000 7fd4a9aba640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 0x7fd48806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.801+0000 7fd4a9aba640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 0x7fd48806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0036000 tx=0x7fd4a003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:38.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.804+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd4a40a15d0 con 0x7fd4a41625a0 2024-03-04T08:50:38.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.987+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4a4073380 con 0x7fd4a41625a0 2024-03-04T08:50:38.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.988+0000 7fd49a7fc640 1 -- 172.21.15.19:0/706183147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fd49c0586c0 con 0x7fd4a41625a0 2024-03-04T08:50:38.989 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:38.989 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:37.708554+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 msgr2=0x7fd48806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 0x7fd48806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0036000 tx=0x7fd4a003d040 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 msgr2=0x7fd4a4159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b970 tx=0x7fd49c00be30 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 shutdown_connections 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4a41625a0 0x7fd4a4159fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4a41621c0 0x7fd4a40b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd48806b4d0 0x7fd48806d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 --2- 172.21.15.19:0/706183147 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4a40d4920 0x7fd4a40a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 >> 172.21.15.19:0/706183147 conn(0x7fd4a40d3d10 msgr2=0x7fd4a415e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 shutdown_connections 2024-03-04T08:50:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:38.990+0000 7fd4abd1e640 1 -- 172.21.15.19:0/706183147 wait complete. 2024-03-04T08:50:38.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T08:50:39.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.105+0000 7fd83a439640 1 Processor -- start 2024-03-04T08:50:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.105+0000 7fd83a439640 1 -- start start 2024-03-04T08:50:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd83a439640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8341455d0 0x7fd834072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd83a439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd83406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd83a439640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8341459b0 con 0x7fd83406afb0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd83a439640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340cfdf0 con 0x7fd8341455d0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd83a439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340cf1e0 con 0x7fd83406b3f0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd8337fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd83406afb0 0x7fd83406ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37628/0 (socket says 172.21.15.19:37628) 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd8337fe640 1 -- 172.21.15.19:0/1429488854 learned_addr learned my addr 172.21.15.19:0/1429488854 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd8389d6640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd83406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd833fff640 1 --2- 172.21.15.19:0/1429488854 >> v2:172.21.15.204:3300/0 conn(0x7fd8341455d0 0x7fd834072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.106+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098794260 0 0) 0x7fd8341459b0 con 0x7fd83406afb0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81c003520 con 0x7fd83406afb0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183180499 0 0) 0x7fd81c003520 con 0x7fd83406afb0 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 msgr2=0x7fd83406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd83406e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 >> v2:172.21.15.204:3300/0 conn(0x7fd8341455d0 msgr2=0x7fd834072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 --2- 172.21.15.19:0/1429488854 >> v2:172.21.15.204:3300/0 conn(0x7fd8341455d0 0x7fd834072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340cf4c0 con 0x7fd83406afb0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fd828001670 con 0x7fd83406afb0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 >> v1:172.21.15.19:6789/0 conn(0x7fd83406afb0 legacy=0x7fd83406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd81c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd81c003f80 0x7fd81c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd81c004d40 0x7fd81c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340cfdf0 con 0x7fd81c003f80 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340cf1e0 con 0x7fd81c004d40 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c00b9c0 con 0x7fd83406b3f0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd81c003f80 0x7fd81c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd833fff640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd81c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8389d6640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd81c004d40 0x7fd81c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 -- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 msgr2=0x7fd81c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd83406b3f0 0x7fd81c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 -- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd81c004d40 msgr2=0x7fd81c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd81c004d40 0x7fd81c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.107+0000 7fd8337fe640 1 -- 172.21.15.19:0/1429488854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c003520 con 0x7fd81c003f80 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.108+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd81c003f80 0x7fd81c004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c1c0 tx=0x7fd81c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad75c7556922dd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.108+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828007c60 con 0x7fd81c003f80 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.108+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828030070 con 0x7fd81c003f80 2024-03-04T08:50:39.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.108+0000 7fd832ffd640 1 -- 172.21.15.19:0/1429488854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828005d30 con 0x7fd81c003f80 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 -- 172.21.15.19:0/1429488854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd81c003f80 msgr2=0x7fd81c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 --2- 172.21.15.19:0/1429488854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd81c003f80 0x7fd81c004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c1c0 tx=0x7fd81c005830 comp rx=0 tx=0).stop 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd8389d6640 1 -- 172.21.15.19:0/1429488854 reap_dead start 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 -- 172.21.15.19:0/1429488854 shutdown_connections 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 -- 172.21.15.19:0/1429488854 >> 172.21.15.19:0/1429488854 conn(0x7fd8340b2660 msgr2=0x7fd8340b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:39.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 -- 172.21.15.19:0/1429488854 shutdown_connections 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.109+0000 7fd83a439640 1 -- 172.21.15.19:0/1429488854 wait complete. 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.110+0000 7fd83a439640 1 Processor -- start 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.110+0000 7fd83a439640 1 -- start start 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd81c003f80 0x7fd8341413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8341449e0 0x7fd8341532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340729c0 con 0x7fd8341444b0 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340cfa80 con 0x7fd8341449e0 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd83a439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83406b860 con 0x7fd81c003f80 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45894/0 (socket says 172.21.15.19:45894) 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 -- 172.21.15.19:0/1170004060 learned_addr learned my addr 172.21.15.19:0/1170004060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd833fff640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd81c003f80 0x7fd8341413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8389d6640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8341449e0 0x7fd8341532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 -- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd81c003f80 msgr2=0x7fd8341413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd81c003f80 0x7fd8341413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 -- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8341449e0 msgr2=0x7fd8341532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8341449e0 0x7fd8341532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 -- 172.21.15.19:0/1170004060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83413d950 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd8337fe640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c160 tx=0x7fd8340cf690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.111+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828001ba0 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.112+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828004bf0 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.112+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340b1830 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.112+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828007070 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.112+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834141930 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.112+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd834073390 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.113+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd828007210 con 0x7fd8341444b0 2024-03-04T08:50:39.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.113+0000 7fd830ff9640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 0x7fd82006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.113+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8280ab220 con 0x7fd8341444b0 2024-03-04T08:50:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.113+0000 7fd833fff640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 0x7fd82006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.114+0000 7fd833fff640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 0x7fd82006d9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8341400d0 tx=0x7fd824014040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.117+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd82807a090 con 0x7fd8341444b0 2024-03-04T08:50:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.336+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd83406efd0 con 0x7fd8341444b0 2024-03-04T08:50:39.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.353+0000 7fd830ff9640 1 -- 172.21.15.19:0/1170004060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd828079990 con 0x7fd8341444b0 2024-03-04T08:50:39.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 msgr2=0x7fd82006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 0x7fd82006d9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8341400d0 tx=0x7fd824014040 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 msgr2=0x7fd83415c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c160 tx=0x7fd8340cf690 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 shutdown_connections 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd82006b500 0x7fd82006d9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8341449e0 0x7fd8341532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341444b0 0x7fd83415c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 --2- 172.21.15.19:0/1170004060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd81c003f80 0x7fd8341413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 >> 172.21.15.19:0/1170004060 conn(0x7fd8340b2660 msgr2=0x7fd834156690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 shutdown_connections 2024-03-04T08:50:39.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.355+0000 7fd83a439640 1 -- 172.21.15.19:0/1170004060 wait complete. 2024-03-04T08:50:39.362 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-04T08:50:39.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-04T08:50:39.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.471+0000 7f58dc13e640 1 Processor -- start 2024-03-04T08:50:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.471+0000 7f58dc13e640 1 -- start start 2024-03-04T08:50:39.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58dc13e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4165680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58dc13e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d415b260 con 0x7f58d4071a70 2024-03-04T08:50:39.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58dc13e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d415b540 con 0x7f58d415ad90 2024-03-04T08:50:39.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58dc13e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415c020 con 0x7f58d40b42e0 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58d9eda640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f58d4071a70 0x7f58d4071e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37640/0 (socket says 172.21.15.19:37640) 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58d9eda640 1 -- 172.21.15.19:0/2504732348 learned_addr learned my addr 172.21.15.19:0/2504732348 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.472+0000 7f58da6db640 1 --2- 172.21.15.19:0/2504732348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300584961 0 0) 0x7f58d415b260 con 0x7f58d4071a70 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58bc003520 con 0x7f58d4071a70 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524257225 0 0) 0x7f58d415b540 con 0x7f58d415ad90 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d415b260 con 0x7f58d415ad90 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58da6db640 1 -- 172.21.15.19:0/2504732348 >> v1:172.21.15.204:6789/0 conn(0x7f58d415ad90 legacy=0x7f58d40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58da6db640 1 -- 172.21.15.19:0/2504732348 >> v1:172.21.15.19:6789/0 conn(0x7f58d4071a70 legacy=0x7f58d4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.473+0000 7f58da6db640 1 -- 172.21.15.19:0/2504732348 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d415b820 con 0x7f58d40b42e0 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58da6db640 1 --2- 172.21.15.19:0/2504732348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4165680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4298a0c95d50dd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4039070 con 0x7f58d40b42e0 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c402cc40 con 0x7f58d40b42e0 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58d8ed8640 1 -- 172.21.15.19:0/2504732348 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4034440 con 0x7f58d40b42e0 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 -- 172.21.15.19:0/2504732348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 msgr2=0x7f58d4165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 --2- 172.21.15.19:0/2504732348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4165680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009dc0 tx=0x7f58c402be90 comp rx=0 tx=0).stop 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 -- 172.21.15.19:0/2504732348 shutdown_connections 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 --2- 172.21.15.19:0/2504732348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4165680 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 -- 172.21.15.19:0/2504732348 >> 172.21.15.19:0/2504732348 conn(0x7f58d40b2660 msgr2=0x7f58d40b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 -- 172.21.15.19:0/2504732348 shutdown_connections 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.474+0000 7f58dc13e640 1 -- 172.21.15.19:0/2504732348 wait complete. 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.475+0000 7f58dc13e640 1 Processor -- start 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.475+0000 7f58dc13e640 1 -- start start 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4071a70 0x7f58d4148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415d220 con 0x7f58d415ad90 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40b4750 con 0x7f58d4071a70 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58dc13e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415d3a0 con 0x7f58d40b42e0 2024-03-04T08:50:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58da6db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58da6db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45906/0 (socket says 172.21.15.19:45906) 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58da6db640 1 -- 172.21.15.19:0/572967685 learned_addr learned my addr 172.21.15.19:0/572967685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58d9eda640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4071a70 0x7f58d4148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.476+0000 7f58d96d9640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 -- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 msgr2=0x7f58d4148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 -- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4071a70 msgr2=0x7f58d4148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4071a70 0x7f58d4148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 -- 172.21.15.19:0/572967685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40b11d0 con 0x7f58d415ad90 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58da6db640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c4037040 tx=0x7f58c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4039050 con 0x7f58d415ad90 2024-03-04T08:50:39.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4045070 con 0x7f58d415ad90 2024-03-04T08:50:39.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d40b14b0 con 0x7f58d415ad90 2024-03-04T08:50:39.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4009450 con 0x7f58d415ad90 2024-03-04T08:50:39.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.477+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d40b1a70 con 0x7f58d415ad90 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.478+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d4073390 con 0x7f58d415ad90 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.478+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58c4040670 con 0x7f58d415ad90 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.479+0000 7f58d27fc640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 0x7f58c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.479+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58c40acb00 con 0x7f58d415ad90 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.479+0000 7f58d9eda640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 0x7f58c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.479+0000 7f58d9eda640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 0x7f58c006d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f60 tx=0x7f58cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.483+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f58c407b340 con 0x7f58d415ad90 2024-03-04T08:50:39.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:39.706+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58d40d07d0 con 0x7f58d415ad90 2024-03-04T08:50:40.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.359+0000 7f58d27fc640 1 -- 172.21.15.19:0/572967685 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58c407f3e0 con 0x7f58d415ad90 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 msgr2=0x7f58c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 0x7f58c006d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f60 tx=0x7f58cc009040 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 msgr2=0x7f58d41493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c4037040 tx=0x7f58c4004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 shutdown_connections 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d415ad90 0x7f58d41493e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d40b42e0 0x7f58d4148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58c006b4d0 0x7f58c006d990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 --2- 172.21.15.19:0/572967685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4071a70 0x7f58d4148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 >> 172.21.15.19:0/572967685 conn(0x7f58d40b2660 msgr2=0x7f58d406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:40.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 shutdown_connections 2024-03-04T08:50:40.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.362+0000 7f58dc13e640 1 -- 172.21.15.19:0/572967685 wait complete. 2024-03-04T08:50:40.371 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-04T08:50:40.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:40.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.480+0000 7f262ffae640 1 Processor -- start 2024-03-04T08:50:40.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 -- start start 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f262815bdd0 0x7f26280c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f262815fa10 0x7f26280ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f26280d16e0 0x7f26280d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cebe0 con 0x7f262815fa10 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280ceec0 con 0x7f26280d16e0 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262ffae640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280cf1a0 con 0x7f262815bdd0 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.481+0000 7f262d549640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f262815fa10 0x7f26280ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f262815fa10 0x7f26280ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45908/0 (socket says 172.21.15.19:45908) 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 -- 172.21.15.19:0/1080732117 learned_addr learned my addr 172.21.15.19:0/1080732117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262dd4a640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f262815bdd0 0x7f26280c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262e54b640 1 --2- 172.21.15.19:0/1080732117 >> v2:172.21.15.204:3300/0 conn(0x7f26280d16e0 0x7f26280d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 -- 172.21.15.19:0/1080732117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f262815bdd0 msgr2=0x7f26280c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f262815bdd0 0x7f26280c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 -- 172.21.15.19:0/1080732117 >> v2:172.21.15.204:3300/0 conn(0x7f26280d16e0 msgr2=0x7f26280d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 --2- 172.21.15.19:0/1080732117 >> v2:172.21.15.204:3300/0 conn(0x7f26280d16e0 0x7f26280d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 -- 172.21.15.19:0/1080732117 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280cc8e0 con 0x7f262815fa10 2024-03-04T08:50:40.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.482+0000 7f262d549640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f26280ce270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26280729e0 tx=0x7f261802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4758152cb4f60d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262cd48640 1 -- 172.21.15.19:0/1080732117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180317d0 con 0x7f262815fa10 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262cd48640 1 -- 172.21.15.19:0/1080732117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618037070 con 0x7f262815fa10 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262cd48640 1 -- 172.21.15.19:0/1080732117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618031b90 con 0x7f262815fa10 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 -- 172.21.15.19:0/1080732117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 msgr2=0x7f26280ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f26280ce270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26280729e0 tx=0x7f261802b870 comp rx=0 tx=0).stop 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 -- 172.21.15.19:0/1080732117 shutdown_connections 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 --2- 172.21.15.19:0/1080732117 >> v2:172.21.15.204:3300/0 conn(0x7f26280d16e0 0x7f26280d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f26280ce270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 --2- 172.21.15.19:0/1080732117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f262815bdd0 0x7f26280c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 -- 172.21.15.19:0/1080732117 >> 172.21.15.19:0/1080732117 conn(0x7f262809a9f0 msgr2=0x7f262809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 -- 172.21.15.19:0/1080732117 shutdown_connections 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.483+0000 7f262ffae640 1 -- 172.21.15.19:0/1080732117 wait complete. 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.484+0000 7f262ffae640 1 Processor -- start 2024-03-04T08:50:40.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.484+0000 7f262ffae640 1 -- start start 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 0x7f262809bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f262815bdd0 0x7f26280b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280cc5d0 con 0x7f262815fa10 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280d2070 con 0x7f262815bdd0 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262ffae640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262815c1b0 con 0x7f26280d16e0 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262e54b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262e54b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45912/0 (socket says 172.21.15.19:45912) 2024-03-04T08:50:40.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262e54b640 1 -- 172.21.15.19:0/2492470039 learned_addr learned my addr 172.21.15.19:0/2492470039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262dd4a640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 0x7f262809bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262d549640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f262815bdd0 0x7f26280b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.485+0000 7f262dd4a640 1 -- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f262815bdd0 msgr2=0x7f26280b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262dd4a640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f262815bdd0 0x7f26280b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262dd4a640 1 -- 172.21.15.19:0/2492470039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 msgr2=0x7f262809e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262dd4a640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262dd4a640 1 -- 172.21.15.19:0/2492470039 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280b58c0 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262e54b640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262dd4a640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 0x7f262809bb70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f262400e870 tx=0x7f262400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624017070 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400ee60 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280b5ba0 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400cb60 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.486+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280b6160 con 0x7f26280d16e0 2024-03-04T08:50:40.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.487+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262804f330 con 0x7f26280d16e0 2024-03-04T08:50:40.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.487+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f262401a070 con 0x7f26280d16e0 2024-03-04T08:50:40.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.488+0000 7f261e7fc640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 0x7f260c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.488+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f262408a210 con 0x7f26280d16e0 2024-03-04T08:50:40.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.488+0000 7f262d549640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 0x7f260c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.488+0000 7f262d549640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 0x7f260c06d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2618036000 tx=0x7f261803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.492+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2624058a50 con 0x7f26280d16e0 2024-03-04T08:50:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.713+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26280747a0 con 0x7f26280d16e0 2024-03-04T08:50:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.713+0000 7f261e7fc640 1 -- 172.21.15.19:0/2492470039 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7f262405caf0 con 0x7f26280d16e0 2024-03-04T08:50:40.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:40.710 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:50:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 msgr2=0x7f260c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 0x7f260c06d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2618036000 tx=0x7f261803d040 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 msgr2=0x7f262809bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 0x7f262809bb70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f262400e870 tx=0x7f262400ed30 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 shutdown_connections 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f262815fa10 0x7f262809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f260c06b500 0x7f260c06d9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f262815bdd0 0x7f26280b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 --2- 172.21.15.19:0/2492470039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f26280d16e0 0x7f262809bb70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 >> 172.21.15.19:0/2492470039 conn(0x7f262809a9f0 msgr2=0x7f2628160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 shutdown_connections 2024-03-04T08:50:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.715+0000 7f262ffae640 1 -- 172.21.15.19:0/2492470039 wait complete. 2024-03-04T08:50:40.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.827+0000 7f6696846640 1 Processor -- start 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.827+0000 7f6696846640 1 -- start start 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f6696846640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669013dc10 0x7f66900b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f6696846640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f669015bf30 0x7f66900b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f6696846640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669015f580 con 0x7f669015e850 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f6696846640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900cf3f0 con 0x7f669015bf30 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f6696846640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669015b210 con 0x7f669013dc10 2024-03-04T08:50:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f668f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f669015bf30 0x7f66900b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f668f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f669015bf30 0x7f66900b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45920/0 (socket says 172.21.15.19:45920) 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f668f7fe640 1 -- 172.21.15.19:0/1102418087 learned_addr learned my addr 172.21.15.19:0/1102418087 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.828+0000 7f668ffff640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669013dc10 0x7f66900b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.829+0000 7f668f7fe640 1 -- 172.21.15.19:0/1102418087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669013dc10 msgr2=0x7f66900b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.829+0000 7f668f7fe640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669013dc10 0x7f66900b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.829+0000 7f668f7fe640 1 -- 172.21.15.19:0/1102418087 >> v1:172.21.15.204:6789/0 conn(0x7f669015e850 legacy=0x7f669015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.829+0000 7f668f7fe640 1 -- 172.21.15.19:0/1102418087 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669015b450 con 0x7f669015bf30 2024-03-04T08:50:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.829+0000 7f668f7fe640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900b2e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6684009870 tx=0x7f668402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0867a263764796d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f668effd640 1 -- 172.21.15.19:0/1102418087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684035020 con 0x7f669015bf30 2024-03-04T08:50:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f668effd640 1 -- 172.21.15.19:0/1102418087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684031640 con 0x7f669015bf30 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f668effd640 1 -- 172.21.15.19:0/1102418087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668402d040 con 0x7f669015bf30 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 -- 172.21.15.19:0/1102418087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 msgr2=0x7f66900b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900b2e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6684009870 tx=0x7f668402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 -- 172.21.15.19:0/1102418087 shutdown_connections 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900b2e90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 --2- 172.21.15.19:0/1102418087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669013dc10 0x7f66900b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 -- 172.21.15.19:0/1102418087 >> 172.21.15.19:0/1102418087 conn(0x7f66900cf8a0 msgr2=0x7f66900cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 -- 172.21.15.19:0/1102418087 shutdown_connections 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.830+0000 7f6696846640 1 -- 172.21.15.19:0/1102418087 wait complete. 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.831+0000 7f6696846640 1 Processor -- start 2024-03-04T08:50:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.831+0000 7f6696846640 1 -- start start 2024-03-04T08:50:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 0x7f6690154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669015e850 0x7f66900aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900cd7a0 con 0x7f669015bf30 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669013dff0 con 0x7f669013dc10 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6696846640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900cd920 con 0x7f669015e850 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45932/0 (socket says 172.21.15.19:45932) 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f668f7fe640 1 -- 172.21.15.19:0/521393274 learned_addr learned my addr 172.21.15.19:0/521393274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f668ffff640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 0x7f6690154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.832+0000 7f6694de3640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669015e850 0x7f66900aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 -- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669015e850 msgr2=0x7f66900aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669015e850 0x7f66900aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 -- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 msgr2=0x7f6690154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 0x7f6690154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 -- 172.21.15.19:0/521393274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690155eb0 con 0x7f669015bf30 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668ffff640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 0x7f6690154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668f7fe640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f668402b930 tx=0x7f66840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684040070 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668403e070 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6690156190 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684035040 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.833+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6690156750 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.834+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669004f330 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.834+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6684038020 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.835+0000 7f668cff9640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 0x7f667c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.835+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66840ab910 con 0x7f669015bf30 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.835+0000 7f668ffff640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 0x7f667c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.835+0000 7f668ffff640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 0x7f667c06d9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f668000b6e0 tx=0x7f6680012040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:40.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:40.839+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f668407a1d0 con 0x7f669015bf30 2024-03-04T08:50:41.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.019+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f669006eb00 con 0x7f669015bf30 2024-03-04T08:50:41.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.020+0000 7f668cff9640 1 -- 172.21.15.19:0/521393274 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f668407e270 con 0x7f669015bf30 2024-03-04T08:50:41.016 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:41.016 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 msgr2=0x7f667c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 0x7f667c06d9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f668000b6e0 tx=0x7f6680012040 comp rx=0 tx=0).stop 2024-03-04T08:50:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 msgr2=0x7f66900ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f668402b930 tx=0x7f66840046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 shutdown_connections 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f669015e850 0x7f66900aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669015bf30 0x7f66900ae890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f667c06b500 0x7f667c06d9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 --2- 172.21.15.19:0/521393274 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f669013dc10 0x7f6690154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 >> 172.21.15.19:0/521393274 conn(0x7f66900cf8a0 msgr2=0x7f669013ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 shutdown_connections 2024-03-04T08:50:41.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.022+0000 7f6696846640 1 -- 172.21.15.19:0/521393274 wait complete. 2024-03-04T08:50:41.029 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T08:50:41.029 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:41.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.134+0000 7fd672b16640 1 Processor -- start 2024-03-04T08:50:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.134+0000 7fd672b16640 1 -- start start 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd672b16640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd66c0d4920 0x7fd66c0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd672b16640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 0x7fd66c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd672b16640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c0ceac0 con 0x7fd66c1621c0 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd672b16640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c0cf690 con 0x7fd66c0d4920 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd672b16640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0d2dc0 con 0x7fd66c1625a0 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd6708b2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd66c1621c0 0x7fd66c0d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37642/0 (socket says 172.21.15.19:37642) 2024-03-04T08:50:41.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd6708b2640 1 -- 172.21.15.19:0/410258113 learned_addr learned my addr 172.21.15.19:0/410258113 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd66bfff640 1 --2- 172.21.15.19:0/410258113 >> v2:172.21.15.204:3300/0 conn(0x7fd66c0d4920 0x7fd66c0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd6710b3640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 0x7fd66c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd66b7fe640 1 -- 172.21.15.19:0/410258113 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544402375 0 0) 0x7fd66c0ceac0 con 0x7fd66c1621c0 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.135+0000 7fd66b7fe640 1 -- 172.21.15.19:0/410258113 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd65c003520 con 0x7fd66c1621c0 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66bfff640 1 -- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 msgr2=0x7fd66c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66bfff640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 0x7fd66c15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66bfff640 1 -- 172.21.15.19:0/410258113 >> v1:172.21.15.19:6789/0 conn(0x7fd66c1621c0 legacy=0x7fd66c0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66bfff640 1 -- 172.21.15.19:0/410258113 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0ced60 con 0x7fd66c0d4920 2024-03-04T08:50:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd6710b3640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 0x7fd66c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66bfff640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c0d4920 0x7fd66c0cfb20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097a0 tx=0x7fd65802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bdd50d3ce563784 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.136+0000 7fd66b7fe640 1 -- 172.21.15.19:0/410258113 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658035020 con 0x7fd66c0d4920 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd66b7fe640 1 -- 172.21.15.19:0/410258113 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd658031830 con 0x7fd66c0d4920 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd66b7fe640 1 -- 172.21.15.19:0/410258113 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658031c00 con 0x7fd66c0d4920 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 -- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c0d4920 msgr2=0x7fd66c0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c0d4920 0x7fd66c0cfb20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097a0 tx=0x7fd65802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 -- 172.21.15.19:0/410258113 shutdown_connections 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c1625a0 0x7fd66c15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 --2- 172.21.15.19:0/410258113 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c0d4920 0x7fd66c0cfb20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 -- 172.21.15.19:0/410258113 >> 172.21.15.19:0/410258113 conn(0x7fd66c0d3d10 msgr2=0x7fd66c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 -- 172.21.15.19:0/410258113 shutdown_connections 2024-03-04T08:50:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.137+0000 7fd672b16640 1 -- 172.21.15.19:0/410258113 wait complete. 2024-03-04T08:50:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.138+0000 7fd672b16640 1 Processor -- start 2024-03-04T08:50:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.138+0000 7fd672b16640 1 -- start start 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c0d4920 0x7fd66c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c1625a0 0x7fd66c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15e280 con 0x7fd66c1621c0 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0cf320 con 0x7fd66c1625a0 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd672b16640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15e400 con 0x7fd66c0d4920 2024-03-04T08:50:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd66bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd66bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45946/0 (socket says 172.21.15.19:45946) 2024-03-04T08:50:41.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd66bfff640 1 -- 172.21.15.19:0/2864379057 learned_addr learned my addr 172.21.15.19:0/2864379057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:41.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd6708b2640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c0d4920 0x7fd66c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.139+0000 7fd6710b3640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c1625a0 0x7fd66c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 -- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c0d4920 msgr2=0x7fd66c0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c0d4920 0x7fd66c0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 -- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c1625a0 msgr2=0x7fd66c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c1625a0 0x7fd66c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 -- 172.21.15.19:0/2864379057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c15c770 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd66bfff640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd65802bee0 tx=0x7fd6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658035040 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65803b860 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65803bc50 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c0b6740 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.140+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c0b6d00 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.141+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c04f330 con 0x7fd66c1621c0 2024-03-04T08:50:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.141+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd658038020 con 0x7fd66c1621c0 2024-03-04T08:50:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.142+0000 7fd6697fa640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 0x7fd65006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.142+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6580ac160 con 0x7fd66c1621c0 2024-03-04T08:50:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.142+0000 7fd6708b2640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 0x7fd65006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.142+0000 7fd6708b2640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 0x7fd65006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd660005880 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.146+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd65807afe0 con 0x7fd66c1621c0 2024-03-04T08:50:41.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.323+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd66c073380 con 0x7fd65006b4d0 2024-03-04T08:50:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.330+0000 7fd6697fa640 1 -- 172.21.15.19:0/2864379057 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242363 (secure 0 0 0) 0x7fd66c073380 con 0x7fd65006b4d0 2024-03-04T08:50:41.329 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 msgr2=0x7fd65006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 0x7fd65006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd660005880 tx=0x7fd660009040 comp rx=0 tx=0).stop 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 msgr2=0x7fd66c0a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd65802bee0 tx=0x7fd6580046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 shutdown_connections 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd65006b4d0 0x7fd65006d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd66c1625a0 0x7fd66c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd66c1621c0 0x7fd66c0a16d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 --2- 172.21.15.19:0/2864379057 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd66c0d4920 0x7fd66c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 >> 172.21.15.19:0/2864379057 conn(0x7fd66c0d3d10 msgr2=0x7fd66c0b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 shutdown_connections 2024-03-04T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.333+0000 7fd672b16640 1 -- 172.21.15.19:0/2864379057 wait complete. 2024-03-04T08:50:41.340 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-04T08:50:41.139848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219324,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755396,"statfs":{"total":773094113280,"available":772869525504,"internally_reserved":0,"allocated":2596864,"data_stored":1620418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.801142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369176+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:38.369176+0000","last_peered":"2024-03-04T08:50:38.369176+0000","last_clean":"2024-03-04T08:50:38.369176+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:38.369176+0000","last_undegraded":"2024-03-04T08:50:38.369176+0000","last_fullsized":"2024-03-04T08:50:38.369176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:32.683374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356971+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:38.356971+0000","last_peered":"2024-03-04T08:50:38.356971+0000","last_clean":"2024-03-04T08:50:38.356971+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:38.356971+0000","last_undegraded":"2024-03-04T08:50:38.356971+0000","last_fullsized":"2024-03-04T08:50:38.356971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:09.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335930+0000","last_change":"2024-03-04T08:50:36.335930+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335930+0000","last_undegraded":"2024-03-04T08:50:36.335930+0000","last_fullsized":"2024-03-04T08:50:36.335930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339012+0000","last_change":"2024-03-04T08:50:36.339012+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339012+0000","last_undegraded":"2024-03-04T08:50:36.339012+0000","last_fullsized":"2024-03-04T08:50:36.339012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339667+0000","last_change":"2024-03-04T08:50:36.339667+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339667+0000","last_undegraded":"2024-03-04T08:50:36.339667+0000","last_fullsized":"2024-03-04T08:50:36.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369200+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:38.369200+0000","last_peered":"2024-03-04T08:50:38.369200+0000","last_clean":"2024-03-04T08:50:38.369200+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:38.369200+0000","last_undegraded":"2024-03-04T08:50:38.369200+0000","last_fullsized":"2024-03-04T08:50:38.369200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:20.740104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335959+0000","last_change":"2024-03-04T08:50:36.335959+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335959+0000","last_undegraded":"2024-03-04T08:50:36.335959+0000","last_fullsized":"2024-03-04T08:50:36.335959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335545+0000","last_change":"2024-03-04T08:50:36.335545+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335545+0000","last_undegraded":"2024-03-04T08:50:36.335545+0000","last_fullsized":"2024-03-04T08:50:36.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339715+0000","last_change":"2024-03-04T08:50:36.339715+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339715+0000","last_undegraded":"2024-03-04T08:50:36.339715+0000","last_fullsized":"2024-03-04T08:50:36.339715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335694+0000","last_change":"2024-03-04T08:50:36.335694+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335694+0000","last_undegraded":"2024-03-04T08:50:36.335694+0000","last_fullsized":"2024-03-04T08:50:36.335694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342130+0000","last_change":"2024-03-04T08:50:36.342130+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342130+0000","last_undegraded":"2024-03-04T08:50:36.342130+0000","last_fullsized":"2024-03-04T08:50:36.342130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356714+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:38.356714+0000","last_peered":"2024-03-04T08:50:38.356714+0000","last_clean":"2024-03-04T08:50:38.356714+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:38.356714+0000","last_undegraded":"2024-03-04T08:50:38.356714+0000","last_fullsized":"2024-03-04T08:50:38.356714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342075+0000","last_change":"2024-03-04T08:50:36.342075+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342075+0000","last_undegraded":"2024-03-04T08:50:36.342075+0000","last_fullsized":"2024-03-04T08:50:36.342075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342072+0000","last_change":"2024-03-04T08:50:36.342072+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342072+0000","last_undegraded":"2024-03-04T08:50:36.342072+0000","last_fullsized":"2024-03-04T08:50:36.342072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T08:50:36.337779+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:36.337779+0000","last_peered":"2024-03-04T08:50:36.337779+0000","last_clean":"2024-03-04T08:50:36.337779+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:36.337779+0000","last_undegraded":"2024-03-04T08:50:36.337779+0000","last_fullsized":"2024-03-04T08:50:36.337779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339243+0000","last_change":"2024-03-04T08:50:36.339243+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339243+0000","last_undegraded":"2024-03-04T08:50:36.339243+0000","last_fullsized":"2024-03-04T08:50:36.339243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335595+0000","last_change":"2024-03-04T08:50:36.335595+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335595+0000","last_undegraded":"2024-03-04T08:50:36.335595+0000","last_fullsized":"2024-03-04T08:50:36.335595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342154+0000","last_change":"2024-03-04T08:50:36.342154+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342154+0000","last_undegraded":"2024-03-04T08:50:36.342154+0000","last_fullsized":"2024-03-04T08:50:36.342154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339013+0000","last_change":"2024-03-04T08:50:36.339013+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339013+0000","last_undegraded":"2024-03-04T08:50:36.339013+0000","last_fullsized":"2024-03-04T08:50:36.339013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357631+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:38.357631+0000","last_peered":"2024-03-04T08:50:38.357631+0000","last_clean":"2024-03-04T08:50:38.357631+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:38.357631+0000","last_undegraded":"2024-03-04T08:50:38.357631+0000","last_fullsized":"2024-03-04T08:50:38.357631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:52.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336193+0000","last_change":"2024-03-04T08:50:36.336193+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336193+0000","last_undegraded":"2024-03-04T08:50:36.336193+0000","last_fullsized":"2024-03-04T08:50:36.336193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356034+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:39.356034+0000","last_peered":"2024-03-04T08:50:39.356034+0000","last_clean":"2024-03-04T08:50:39.356034+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:39.356034+0000","last_undegraded":"2024-03-04T08:50:39.356034+0000","last_fullsized":"2024-03-04T08:50:39.356034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335753+0000","last_change":"2024-03-04T08:50:36.335753+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335753+0000","last_undegraded":"2024-03-04T08:50:36.335753+0000","last_fullsized":"2024-03-04T08:50:36.335753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357553+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:38.357553+0000","last_peered":"2024-03-04T08:50:38.357553+0000","last_clean":"2024-03-04T08:50:38.357553+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:38.357553+0000","last_undegraded":"2024-03-04T08:50:38.357553+0000","last_fullsized":"2024-03-04T08:50:38.357553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:49.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335645+0000","last_change":"2024-03-04T08:50:36.335645+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335645+0000","last_undegraded":"2024-03-04T08:50:36.335645+0000","last_fullsized":"2024-03-04T08:50:36.335645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335651+0000","last_change":"2024-03-04T08:50:36.335651+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335651+0000","last_undegraded":"2024-03-04T08:50:36.335651+0000","last_fullsized":"2024-03-04T08:50:36.335651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337129+0000","last_change":"2024-03-04T08:50:36.337129+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337129+0000","last_undegraded":"2024-03-04T08:50:36.337129+0000","last_fullsized":"2024-03-04T08:50:36.337129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333515+0000","last_change":"2024-03-04T08:50:36.333515+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333515+0000","last_undegraded":"2024-03-04T08:50:36.333515+0000","last_fullsized":"2024-03-04T08:50:36.333515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336057+0000","last_change":"2024-03-04T08:50:36.336057+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336057+0000","last_undegraded":"2024-03-04T08:50:36.336057+0000","last_fullsized":"2024-03-04T08:50:36.336057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":765952,"data_stored":644151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:41.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:41.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.485+0000 7faab418a640 1 Processor -- start 2024-03-04T08:50:41.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.485+0000 7faab418a640 1 -- start start 2024-03-04T08:50:41.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab418a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faaac0d4920 0x7faaac0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab418a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faaac1625a0 0x7faaac15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab418a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0ceac0 con 0x7faaac1621c0 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab418a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0cf690 con 0x7faaac0d4920 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab418a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0d2dc0 con 0x7faaac1625a0 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faaac0d4920 0x7faaac0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faaac0d4920 0x7faaac0cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45948/0 (socket says 172.21.15.19:45948) 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 -- 172.21.15.19:0/4028113787 learned_addr learned my addr 172.21.15.19:0/4028113787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab2727640 1 --2- 172.21.15.19:0/4028113787 >> v2:172.21.15.204:3300/0 conn(0x7faaac1625a0 0x7faaac15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 -- 172.21.15.19:0/4028113787 >> v2:172.21.15.204:3300/0 conn(0x7faaac1625a0 msgr2=0x7faaac15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 --2- 172.21.15.19:0/4028113787 >> v2:172.21.15.204:3300/0 conn(0x7faaac1625a0 0x7faaac15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 -- 172.21.15.19:0/4028113787 >> v1:172.21.15.204:6789/0 conn(0x7faaac1621c0 legacy=0x7faaac0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.486+0000 7faab1725640 1 -- 172.21.15.19:0/4028113787 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0ced60 con 0x7faaac0d4920 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.487+0000 7faab1725640 1 --2- 172.21.15.19:0/4028113787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac0d4920 0x7faaac0cfb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faaac0d3be0 tx=0x7faa9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3500774692bb69 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.487+0000 7faab0f24640 1 -- 172.21.15.19:0/4028113787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c035020 con 0x7faaac0d4920 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.487+0000 7faab0f24640 1 -- 172.21.15.19:0/4028113787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c031870 con 0x7faaac0d4920 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.487+0000 7faab0f24640 1 -- 172.21.15.19:0/4028113787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c031c40 con 0x7faaac0d4920 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 -- 172.21.15.19:0/4028113787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac0d4920 msgr2=0x7faaac0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 --2- 172.21.15.19:0/4028113787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac0d4920 0x7faaac0cfb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faaac0d3be0 tx=0x7faa9c02b910 comp rx=0 tx=0).stop 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 -- 172.21.15.19:0/4028113787 shutdown_connections 2024-03-04T08:50:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 --2- 172.21.15.19:0/4028113787 >> v2:172.21.15.204:3300/0 conn(0x7faaac1625a0 0x7faaac15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 --2- 172.21.15.19:0/4028113787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac0d4920 0x7faaac0cfb20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 -- 172.21.15.19:0/4028113787 >> 172.21.15.19:0/4028113787 conn(0x7faaac0d3d10 msgr2=0x7faaac0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 -- 172.21.15.19:0/4028113787 shutdown_connections 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.488+0000 7faab418a640 1 -- 172.21.15.19:0/4028113787 wait complete. 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 Processor -- start 2024-03-04T08:50:41.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 -- start start 2024-03-04T08:50:41.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaac0d4920 0x7faaac09ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaac1621c0 0x7faaac0b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac15e280 con 0x7faaac1625a0 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0cf320 con 0x7faaac1621c0 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.489+0000 7faab418a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac15e400 con 0x7faaac0d4920 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab1f26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaac0d4920 0x7faaac09ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45964/0 (socket says 172.21.15.19:45964) 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 -- 172.21.15.19:0/3286317017 learned_addr learned my addr 172.21.15.19:0/3286317017 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab1725640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaac1621c0 0x7faaac0b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 -- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaac0d4920 msgr2=0x7faaac09ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaac0d4920 0x7faaac09ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 -- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaac1621c0 msgr2=0x7faaac0b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaac1621c0 0x7faaac0b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 -- 172.21.15.19:0/3286317017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0b7d40 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab2727640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faaa400efc0 tx=0x7faaa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4018020 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4014480 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac0b6de0 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4014870 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.490+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0b7680 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.491+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac04f330 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.492+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaa4005d10 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.492+0000 7faaa27fc640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.492+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaa408ab50 con 0x7faaac1625a0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.492+0000 7faab1f26640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.493+0000 7faab1f26640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 0x7faa9006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001780 tx=0x7faaa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.497+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faaa4022070 con 0x7faaac1625a0 2024-03-04T08:50:41.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.673+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faaac073380 con 0x7faa9006b4d0 2024-03-04T08:50:41.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.679+0000 7faaa27fc640 1 -- 172.21.15.19:0/3286317017 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242363 (secure 0 0 0) 0x7faaac073380 con 0x7faa9006b4d0 2024-03-04T08:50:41.677 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:41.678 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 msgr2=0x7faa9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 0x7faa9006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001780 tx=0x7faaa8009040 comp rx=0 tx=0).stop 2024-03-04T08:50:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 msgr2=0x7faaac151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faaa400efc0 tx=0x7faaa400c490 comp rx=0 tx=0).stop 2024-03-04T08:50:41.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 shutdown_connections 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaac1625a0 0x7faaac151050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faaac1621c0 0x7faaac0b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 --2- 172.21.15.19:0/3286317017 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faaac0d4920 0x7faaac09ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 >> 172.21.15.19:0/3286317017 conn(0x7faaac0d3d10 msgr2=0x7faaac06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 shutdown_connections 2024-03-04T08:50:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.682+0000 7faab418a640 1 -- 172.21.15.19:0/3286317017 wait complete. 2024-03-04T08:50:41.689 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-04T08:50:41.139848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219324,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755396,"statfs":{"total":773094113280,"available":772869525504,"internally_reserved":0,"allocated":2596864,"data_stored":1620418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.801142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369176+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:38.369176+0000","last_peered":"2024-03-04T08:50:38.369176+0000","last_clean":"2024-03-04T08:50:38.369176+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:38.369176+0000","last_undegraded":"2024-03-04T08:50:38.369176+0000","last_fullsized":"2024-03-04T08:50:38.369176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:32.683374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356971+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:38.356971+0000","last_peered":"2024-03-04T08:50:38.356971+0000","last_clean":"2024-03-04T08:50:38.356971+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:38.356971+0000","last_undegraded":"2024-03-04T08:50:38.356971+0000","last_fullsized":"2024-03-04T08:50:38.356971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:09.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335930+0000","last_change":"2024-03-04T08:50:36.335930+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335930+0000","last_undegraded":"2024-03-04T08:50:36.335930+0000","last_fullsized":"2024-03-04T08:50:36.335930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339012+0000","last_change":"2024-03-04T08:50:36.339012+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339012+0000","last_undegraded":"2024-03-04T08:50:36.339012+0000","last_fullsized":"2024-03-04T08:50:36.339012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339667+0000","last_change":"2024-03-04T08:50:36.339667+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339667+0000","last_undegraded":"2024-03-04T08:50:36.339667+0000","last_fullsized":"2024-03-04T08:50:36.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369200+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:38.369200+0000","last_peered":"2024-03-04T08:50:38.369200+0000","last_clean":"2024-03-04T08:50:38.369200+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:38.369200+0000","last_undegraded":"2024-03-04T08:50:38.369200+0000","last_fullsized":"2024-03-04T08:50:38.369200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:20.740104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335959+0000","last_change":"2024-03-04T08:50:36.335959+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335959+0000","last_undegraded":"2024-03-04T08:50:36.335959+0000","last_fullsized":"2024-03-04T08:50:36.335959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335545+0000","last_change":"2024-03-04T08:50:36.335545+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335545+0000","last_undegraded":"2024-03-04T08:50:36.335545+0000","last_fullsized":"2024-03-04T08:50:36.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339715+0000","last_change":"2024-03-04T08:50:36.339715+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339715+0000","last_undegraded":"2024-03-04T08:50:36.339715+0000","last_fullsized":"2024-03-04T08:50:36.339715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335694+0000","last_change":"2024-03-04T08:50:36.335694+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335694+0000","last_undegraded":"2024-03-04T08:50:36.335694+0000","last_fullsized":"2024-03-04T08:50:36.335694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342130+0000","last_change":"2024-03-04T08:50:36.342130+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342130+0000","last_undegraded":"2024-03-04T08:50:36.342130+0000","last_fullsized":"2024-03-04T08:50:36.342130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356714+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:38.356714+0000","last_peered":"2024-03-04T08:50:38.356714+0000","last_clean":"2024-03-04T08:50:38.356714+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:38.356714+0000","last_undegraded":"2024-03-04T08:50:38.356714+0000","last_fullsized":"2024-03-04T08:50:38.356714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342075+0000","last_change":"2024-03-04T08:50:36.342075+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342075+0000","last_undegraded":"2024-03-04T08:50:36.342075+0000","last_fullsized":"2024-03-04T08:50:36.342075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342072+0000","last_change":"2024-03-04T08:50:36.342072+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342072+0000","last_undegraded":"2024-03-04T08:50:36.342072+0000","last_fullsized":"2024-03-04T08:50:36.342072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T08:50:36.337779+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:36.337779+0000","last_peered":"2024-03-04T08:50:36.337779+0000","last_clean":"2024-03-04T08:50:36.337779+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:36.337779+0000","last_undegraded":"2024-03-04T08:50:36.337779+0000","last_fullsized":"2024-03-04T08:50:36.337779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339243+0000","last_change":"2024-03-04T08:50:36.339243+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339243+0000","last_undegraded":"2024-03-04T08:50:36.339243+0000","last_fullsized":"2024-03-04T08:50:36.339243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335595+0000","last_change":"2024-03-04T08:50:36.335595+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335595+0000","last_undegraded":"2024-03-04T08:50:36.335595+0000","last_fullsized":"2024-03-04T08:50:36.335595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342154+0000","last_change":"2024-03-04T08:50:36.342154+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342154+0000","last_undegraded":"2024-03-04T08:50:36.342154+0000","last_fullsized":"2024-03-04T08:50:36.342154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339013+0000","last_change":"2024-03-04T08:50:36.339013+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339013+0000","last_undegraded":"2024-03-04T08:50:36.339013+0000","last_fullsized":"2024-03-04T08:50:36.339013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357631+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:38.357631+0000","last_peered":"2024-03-04T08:50:38.357631+0000","last_clean":"2024-03-04T08:50:38.357631+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:38.357631+0000","last_undegraded":"2024-03-04T08:50:38.357631+0000","last_fullsized":"2024-03-04T08:50:38.357631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:52.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336193+0000","last_change":"2024-03-04T08:50:36.336193+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336193+0000","last_undegraded":"2024-03-04T08:50:36.336193+0000","last_fullsized":"2024-03-04T08:50:36.336193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356034+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:39.356034+0000","last_peered":"2024-03-04T08:50:39.356034+0000","last_clean":"2024-03-04T08:50:39.356034+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:39.356034+0000","last_undegraded":"2024-03-04T08:50:39.356034+0000","last_fullsized":"2024-03-04T08:50:39.356034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335753+0000","last_change":"2024-03-04T08:50:36.335753+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335753+0000","last_undegraded":"2024-03-04T08:50:36.335753+0000","last_fullsized":"2024-03-04T08:50:36.335753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357553+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:38.357553+0000","last_peered":"2024-03-04T08:50:38.357553+0000","last_clean":"2024-03-04T08:50:38.357553+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:38.357553+0000","last_undegraded":"2024-03-04T08:50:38.357553+0000","last_fullsized":"2024-03-04T08:50:38.357553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:49.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335645+0000","last_change":"2024-03-04T08:50:36.335645+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335645+0000","last_undegraded":"2024-03-04T08:50:36.335645+0000","last_fullsized":"2024-03-04T08:50:36.335645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335651+0000","last_change":"2024-03-04T08:50:36.335651+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335651+0000","last_undegraded":"2024-03-04T08:50:36.335651+0000","last_fullsized":"2024-03-04T08:50:36.335651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337129+0000","last_change":"2024-03-04T08:50:36.337129+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337129+0000","last_undegraded":"2024-03-04T08:50:36.337129+0000","last_fullsized":"2024-03-04T08:50:36.337129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333515+0000","last_change":"2024-03-04T08:50:36.333515+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333515+0000","last_undegraded":"2024-03-04T08:50:36.333515+0000","last_fullsized":"2024-03-04T08:50:36.333515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336057+0000","last_change":"2024-03-04T08:50:36.336057+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336057+0000","last_undegraded":"2024-03-04T08:50:36.336057+0000","last_fullsized":"2024-03-04T08:50:36.336057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":765952,"data_stored":644151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:41.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:41.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.834+0000 7f882373e640 1 Processor -- start 2024-03-04T08:50:41.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.834+0000 7f882373e640 1 -- start start 2024-03-04T08:50:41.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f882373e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f881c1649b0 0x7f881c166da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f882373e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c0d0a70 con 0x7f881c0b4420 2024-03-04T08:50:41.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f882373e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c0d0d10 con 0x7f881c06afb0 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f882373e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0d0850 con 0x7f881c1649b0 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8820cd9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f881c0b4420 0x7f881c0cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37650/0 (socket says 172.21.15.19:37650) 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8820cd9640 1 -- 172.21.15.19:0/1186061001 learned_addr learned my addr 172.21.15.19:0/1186061001 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8821cdb640 1 --2- 172.21.15.19:0/1186061001 >> v2:172.21.15.204:3300/0 conn(0x7f881c1649b0 0x7f881c166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407770772 0 0) 0x7f881c0d0a70 con 0x7f881c0b4420 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8808003520 con 0x7f881c0b4420 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8821cdb640 1 -- 172.21.15.19:0/1186061001 >> v1:172.21.15.204:6789/0 conn(0x7f881c06afb0 legacy=0x7f881c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358392096 0 0) 0x7f881c0d0d10 con 0x7f881c06afb0 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8821cdb640 1 -- 172.21.15.19:0/1186061001 >> v1:172.21.15.19:6789/0 conn(0x7f881c0b4420 legacy=0x7f881c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.835+0000 7f8821cdb640 1 -- 172.21.15.19:0/1186061001 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0d0ff0 con 0x7f881c1649b0 2024-03-04T08:50:41.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.836+0000 7f8821cdb640 1 --2- 172.21.15.19:0/1186061001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c166da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c634d5a055866c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.836+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814039070 con 0x7f881c1649b0 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.836+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881402cbd0 con 0x7f881c1649b0 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.836+0000 7f8813fff640 1 -- 172.21.15.19:0/1186061001 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814034440 con 0x7f881c1649b0 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 -- 172.21.15.19:0/1186061001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 msgr2=0x7f881c166da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 --2- 172.21.15.19:0/1186061001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c166da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881402be20 comp rx=0 tx=0).stop 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 -- 172.21.15.19:0/1186061001 shutdown_connections 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 --2- 172.21.15.19:0/1186061001 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c166da0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 -- 172.21.15.19:0/1186061001 >> 172.21.15.19:0/1186061001 conn(0x7f881c06c0c0 msgr2=0x7f881c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 -- 172.21.15.19:0/1186061001 shutdown_connections 2024-03-04T08:50:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.837+0000 7f882373e640 1 -- 172.21.15.19:0/1186061001 wait complete. 2024-03-04T08:50:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 Processor -- start 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 -- start start 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 0x7f881c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0ceb90 con 0x7f881c06afb0 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c145840 con 0x7f881c1649b0 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.838+0000 7f882373e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0ce2a0 con 0x7f881c0b4420 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45970/0 (socket says 172.21.15.19:45970) 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 -- 172.21.15.19:0/54851067 learned_addr learned my addr 172.21.15.19:0/54851067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8820cd9640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 0x7f881c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8821cdb640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 -- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 msgr2=0x7f881c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 0x7f881c0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 -- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 msgr2=0x7f881c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 -- 172.21.15.19:0/54851067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c141130 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8821cdb640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8820cd9640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 0x7f881c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f88214da640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f881800c490 tx=0x7f881800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818005480 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88180035f0 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c141410 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180039c0 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.839+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c0b22a0 con 0x7f881c06afb0 2024-03-04T08:50:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.840+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c04f330 con 0x7f881c06afb0 2024-03-04T08:50:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.841+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8818003b60 con 0x7f881c06afb0 2024-03-04T08:50:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.841+0000 7f8811ffb640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 0x7f880006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.841+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8818089e00 con 0x7f881c06afb0 2024-03-04T08:50:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.841+0000 7f8820cd9640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 0x7f880006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.842+0000 7f8820cd9640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 0x7f880006db30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f880c007fd0 tx=0x7f880c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:41.845+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f88180182b0 con 0x7f881c06afb0 2024-03-04T08:50:42.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.024+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f881c156670 con 0x7f880006b670 2024-03-04T08:50:42.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.030+0000 7f8811ffb640 1 -- 172.21.15.19:0/54851067 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242363 (secure 0 0 0) 0x7f880c001470 con 0x7f880006b670 2024-03-04T08:50:42.028 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:42.029 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 msgr2=0x7f880006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 0x7f880006db30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f880c007fd0 tx=0x7f880c009040 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 msgr2=0x7f881c155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f881800c490 tx=0x7f881800c950 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 shutdown_connections 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f880006b670 0x7f880006db30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f881c1649b0 0x7f881c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f881c0b4420 0x7f881c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 --2- 172.21.15.19:0/54851067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c06afb0 0x7f881c155ae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.032+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 >> 172.21.15.19:0/54851067 conn(0x7f881c06c0c0 msgr2=0x7f881c15cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.033+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 shutdown_connections 2024-03-04T08:50:42.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.033+0000 7f882373e640 1 -- 172.21.15.19:0/54851067 wait complete. 2024-03-04T08:50:42.039 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-04T08:50:41.139848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219324,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755396,"statfs":{"total":773094113280,"available":772869525504,"internally_reserved":0,"allocated":2596864,"data_stored":1620418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.801142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369176+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:38.369176+0000","last_peered":"2024-03-04T08:50:38.369176+0000","last_clean":"2024-03-04T08:50:38.369176+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:38.369176+0000","last_undegraded":"2024-03-04T08:50:38.369176+0000","last_fullsized":"2024-03-04T08:50:38.369176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:32.683374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356971+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:38.356971+0000","last_peered":"2024-03-04T08:50:38.356971+0000","last_clean":"2024-03-04T08:50:38.356971+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:38.356971+0000","last_undegraded":"2024-03-04T08:50:38.356971+0000","last_fullsized":"2024-03-04T08:50:38.356971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:09.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335930+0000","last_change":"2024-03-04T08:50:36.335930+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335930+0000","last_undegraded":"2024-03-04T08:50:36.335930+0000","last_fullsized":"2024-03-04T08:50:36.335930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339012+0000","last_change":"2024-03-04T08:50:36.339012+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339012+0000","last_undegraded":"2024-03-04T08:50:36.339012+0000","last_fullsized":"2024-03-04T08:50:36.339012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339667+0000","last_change":"2024-03-04T08:50:36.339667+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339667+0000","last_undegraded":"2024-03-04T08:50:36.339667+0000","last_fullsized":"2024-03-04T08:50:36.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369200+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:38.369200+0000","last_peered":"2024-03-04T08:50:38.369200+0000","last_clean":"2024-03-04T08:50:38.369200+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:38.369200+0000","last_undegraded":"2024-03-04T08:50:38.369200+0000","last_fullsized":"2024-03-04T08:50:38.369200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:20.740104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335959+0000","last_change":"2024-03-04T08:50:36.335959+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335959+0000","last_undegraded":"2024-03-04T08:50:36.335959+0000","last_fullsized":"2024-03-04T08:50:36.335959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335545+0000","last_change":"2024-03-04T08:50:36.335545+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335545+0000","last_undegraded":"2024-03-04T08:50:36.335545+0000","last_fullsized":"2024-03-04T08:50:36.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339715+0000","last_change":"2024-03-04T08:50:36.339715+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339715+0000","last_undegraded":"2024-03-04T08:50:36.339715+0000","last_fullsized":"2024-03-04T08:50:36.339715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335694+0000","last_change":"2024-03-04T08:50:36.335694+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335694+0000","last_undegraded":"2024-03-04T08:50:36.335694+0000","last_fullsized":"2024-03-04T08:50:36.335694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342130+0000","last_change":"2024-03-04T08:50:36.342130+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342130+0000","last_undegraded":"2024-03-04T08:50:36.342130+0000","last_fullsized":"2024-03-04T08:50:36.342130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356714+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:38.356714+0000","last_peered":"2024-03-04T08:50:38.356714+0000","last_clean":"2024-03-04T08:50:38.356714+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:38.356714+0000","last_undegraded":"2024-03-04T08:50:38.356714+0000","last_fullsized":"2024-03-04T08:50:38.356714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342075+0000","last_change":"2024-03-04T08:50:36.342075+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342075+0000","last_undegraded":"2024-03-04T08:50:36.342075+0000","last_fullsized":"2024-03-04T08:50:36.342075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342072+0000","last_change":"2024-03-04T08:50:36.342072+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342072+0000","last_undegraded":"2024-03-04T08:50:36.342072+0000","last_fullsized":"2024-03-04T08:50:36.342072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T08:50:36.337779+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:36.337779+0000","last_peered":"2024-03-04T08:50:36.337779+0000","last_clean":"2024-03-04T08:50:36.337779+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:36.337779+0000","last_undegraded":"2024-03-04T08:50:36.337779+0000","last_fullsized":"2024-03-04T08:50:36.337779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339243+0000","last_change":"2024-03-04T08:50:36.339243+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339243+0000","last_undegraded":"2024-03-04T08:50:36.339243+0000","last_fullsized":"2024-03-04T08:50:36.339243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335595+0000","last_change":"2024-03-04T08:50:36.335595+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335595+0000","last_undegraded":"2024-03-04T08:50:36.335595+0000","last_fullsized":"2024-03-04T08:50:36.335595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342154+0000","last_change":"2024-03-04T08:50:36.342154+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342154+0000","last_undegraded":"2024-03-04T08:50:36.342154+0000","last_fullsized":"2024-03-04T08:50:36.342154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339013+0000","last_change":"2024-03-04T08:50:36.339013+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339013+0000","last_undegraded":"2024-03-04T08:50:36.339013+0000","last_fullsized":"2024-03-04T08:50:36.339013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357631+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:38.357631+0000","last_peered":"2024-03-04T08:50:38.357631+0000","last_clean":"2024-03-04T08:50:38.357631+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:38.357631+0000","last_undegraded":"2024-03-04T08:50:38.357631+0000","last_fullsized":"2024-03-04T08:50:38.357631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:52.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336193+0000","last_change":"2024-03-04T08:50:36.336193+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336193+0000","last_undegraded":"2024-03-04T08:50:36.336193+0000","last_fullsized":"2024-03-04T08:50:36.336193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356034+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:39.356034+0000","last_peered":"2024-03-04T08:50:39.356034+0000","last_clean":"2024-03-04T08:50:39.356034+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:39.356034+0000","last_undegraded":"2024-03-04T08:50:39.356034+0000","last_fullsized":"2024-03-04T08:50:39.356034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335753+0000","last_change":"2024-03-04T08:50:36.335753+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335753+0000","last_undegraded":"2024-03-04T08:50:36.335753+0000","last_fullsized":"2024-03-04T08:50:36.335753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357553+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:38.357553+0000","last_peered":"2024-03-04T08:50:38.357553+0000","last_clean":"2024-03-04T08:50:38.357553+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:38.357553+0000","last_undegraded":"2024-03-04T08:50:38.357553+0000","last_fullsized":"2024-03-04T08:50:38.357553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:49.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335645+0000","last_change":"2024-03-04T08:50:36.335645+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335645+0000","last_undegraded":"2024-03-04T08:50:36.335645+0000","last_fullsized":"2024-03-04T08:50:36.335645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335651+0000","last_change":"2024-03-04T08:50:36.335651+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335651+0000","last_undegraded":"2024-03-04T08:50:36.335651+0000","last_fullsized":"2024-03-04T08:50:36.335651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337129+0000","last_change":"2024-03-04T08:50:36.337129+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337129+0000","last_undegraded":"2024-03-04T08:50:36.337129+0000","last_fullsized":"2024-03-04T08:50:36.337129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333515+0000","last_change":"2024-03-04T08:50:36.333515+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333515+0000","last_undegraded":"2024-03-04T08:50:36.333515+0000","last_fullsized":"2024-03-04T08:50:36.333515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336057+0000","last_change":"2024-03-04T08:50:36.336057+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336057+0000","last_undegraded":"2024-03-04T08:50:36.336057+0000","last_fullsized":"2024-03-04T08:50:36.336057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":765952,"data_stored":644151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:42.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-03-04T08:50:42.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-03-04T08:50:42.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-03-04T08:50:42.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-03-04T08:50:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-03-04T08:50:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.333509+0000', 'last_change': '2024-03-04T08:50:36.333509+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.333509+0000', 'last_undegraded': '2024-03-04T08:50:36.333509+0000', 'last_fullsized': '2024-03-04T08:50:36.333509+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335930+0000', 'last_change': '2024-03-04T08:50:36.335930+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335930+0000', 'last_undegraded': '2024-03-04T08:50:36.335930+0000', 'last_fullsized': '2024-03-04T08:50:36.335930+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.333509+0000', 'last_change': '2024-03-04T08:50:36.333509+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.333509+0000', 'last_undegraded': '2024-03-04T08:50:36.333509+0000', 'last_fullsized': '2024-03-04T08:50:36.333509+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.339012+0000', 'last_change': '2024-03-04T08:50:36.339012+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.339012+0000', 'last_undegraded': '2024-03-04T08:50:36.339012+0000', 'last_fullsized': '2024-03-04T08:50:36.339012+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.337010+0000', 'last_change': '2024-03-04T08:50:36.337010+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.337010+0000', 'last_undegraded': '2024-03-04T08:50:36.337010+0000', 'last_fullsized': '2024-03-04T08:50:36.337010+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.339667+0000', 'last_change': '2024-03-04T08:50:36.339667+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.339667+0000', 'last_undegraded': '2024-03-04T08:50:36.339667+0000', 'last_fullsized': '2024-03-04T08:50:36.339667+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-03-04T08:50:42.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335959+0000', 'last_change': '2024-03-04T08:50:36.335959+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335959+0000', 'last_undegraded': '2024-03-04T08:50:36.335959+0000', 'last_fullsized': '2024-03-04T08:50:36.335959+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335545+0000', 'last_change': '2024-03-04T08:50:36.335545+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335545+0000', 'last_undegraded': '2024-03-04T08:50:36.335545+0000', 'last_fullsized': '2024-03-04T08:50:36.335545+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.339715+0000', 'last_change': '2024-03-04T08:50:36.339715+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.339715+0000', 'last_undegraded': '2024-03-04T08:50:36.339715+0000', 'last_fullsized': '2024-03-04T08:50:36.339715+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-03-04T08:50:42.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335694+0000', 'last_change': '2024-03-04T08:50:36.335694+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335694+0000', 'last_undegraded': '2024-03-04T08:50:36.335694+0000', 'last_fullsized': '2024-03-04T08:50:36.335694+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.342130+0000', 'last_change': '2024-03-04T08:50:36.342130+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.342130+0000', 'last_undegraded': '2024-03-04T08:50:36.342130+0000', 'last_fullsized': '2024-03-04T08:50:36.342130+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-03-04T08:50:42.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.342075+0000', 'last_change': '2024-03-04T08:50:36.342075+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.342075+0000', 'last_undegraded': '2024-03-04T08:50:36.342075+0000', 'last_fullsized': '2024-03-04T08:50:36.342075+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.342072+0000', 'last_change': '2024-03-04T08:50:36.342072+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.342072+0000', 'last_undegraded': '2024-03-04T08:50:36.342072+0000', 'last_fullsized': '2024-03-04T08:50:36.342072+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.339243+0000', 'last_change': '2024-03-04T08:50:36.339243+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.339243+0000', 'last_undegraded': '2024-03-04T08:50:36.339243+0000', 'last_fullsized': '2024-03-04T08:50:36.339243+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-03-04T08:50:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335595+0000', 'last_change': '2024-03-04T08:50:36.335595+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335595+0000', 'last_undegraded': '2024-03-04T08:50:36.335595+0000', 'last_fullsized': '2024-03-04T08:50:36.335595+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.342154+0000', 'last_change': '2024-03-04T08:50:36.342154+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.342154+0000', 'last_undegraded': '2024-03-04T08:50:36.342154+0000', 'last_fullsized': '2024-03-04T08:50:36.342154+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.339013+0000', 'last_change': '2024-03-04T08:50:36.339013+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.339013+0000', 'last_undegraded': '2024-03-04T08:50:36.339013+0000', 'last_fullsized': '2024-03-04T08:50:36.339013+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.336193+0000', 'last_change': '2024-03-04T08:50:36.336193+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.336193+0000', 'last_undegraded': '2024-03-04T08:50:36.336193+0000', 'last_fullsized': '2024-03-04T08:50:36.336193+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335753+0000', 'last_change': '2024-03-04T08:50:36.335753+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335753+0000', 'last_undegraded': '2024-03-04T08:50:36.335753+0000', 'last_fullsized': '2024-03-04T08:50:36.335753+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.337010+0000', 'last_change': '2024-03-04T08:50:36.337010+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.337010+0000', 'last_undegraded': '2024-03-04T08:50:36.337010+0000', 'last_fullsized': '2024-03-04T08:50:36.337010+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-03-04T08:50:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-03-04T08:50:42.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335645+0000', 'last_change': '2024-03-04T08:50:36.335645+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335645+0000', 'last_undegraded': '2024-03-04T08:50:36.335645+0000', 'last_fullsized': '2024-03-04T08:50:36.335645+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-03-04T08:50:42.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-03-04T08:50:42.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.335651+0000', 'last_change': '2024-03-04T08:50:36.335651+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.335651+0000', 'last_undegraded': '2024-03-04T08:50:36.335651+0000', 'last_fullsized': '2024-03-04T08:50:36.335651+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.337129+0000', 'last_change': '2024-03-04T08:50:36.337129+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.337129+0000', 'last_undegraded': '2024-03-04T08:50:36.337129+0000', 'last_fullsized': '2024-03-04T08:50:36.337129+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:50:42.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.333515+0000', 'last_change': '2024-03-04T08:50:36.333515+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.333515+0000', 'last_undegraded': '2024-03-04T08:50:36.333515+0000', 'last_fullsized': '2024-03-04T08:50:36.333515+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-04T08:50:37.331491+0000', 'last_change': '2024-03-04T08:50:37.331491+0000', 'last_active': '2024-03-04T08:50:37.331491+0000', 'last_peered': '2024-03-04T08:50:37.331491+0000', 'last_clean': '2024-03-04T08:50:37.331491+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:37.331491+0000', 'last_undegraded': '2024-03-04T08:50:37.331491+0000', 'last_fullsized': '2024-03-04T08:50:37.331491+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:37.331491+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-03-04T08:50:42.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:50:36.336057+0000', 'last_change': '2024-03-04T08:50:36.336057+0000', 'last_active': '2024-03-04T08:50:36.326065+0000', 'last_peered': '2024-03-04T08:50:36.326065+0000', 'last_clean': '2024-03-04T08:50:36.326065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:50:36.336057+0000', 'last_undegraded': '2024-03-04T08:50:36.336057+0000', 'last_fullsized': '2024-03-04T08:50:36.336057+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'last_clean_scrub_stamp': '2024-03-04T08:50:36.326065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:50:42.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-04T08:50:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.184+0000 7f67cdd3a640 1 Processor -- start 2024-03-04T08:50:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.184+0000 7f67cdd3a640 1 -- start start 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67cdd3a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f67c80d0d90 0x7f67c80ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67cdd3a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f67c80c90f0 0x7f67c80ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67cdd3a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c80d25e0 con 0x7f67c815e000 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67cdd3a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c80c7c50 con 0x7f67c80c90f0 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67cdd3a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c80d2880 con 0x7f67c80d0d90 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67c7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f67c80c90f0 0x7f67c80ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67c77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f67c815e000 0x7f67c80d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37666/0 (socket says 172.21.15.19:37666) 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67c77fe640 1 -- 172.21.15.19:0/2892636599 learned_addr learned my addr 172.21.15.19:0/2892636599 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.185+0000 7f67c6ffd640 1 --2- 172.21.15.19:0/2892636599 >> v2:172.21.15.204:3300/0 conn(0x7f67c80d0d90 0x7f67c80ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c7fff640 1 -- 172.21.15.19:0/2892636599 >> v2:172.21.15.204:3300/0 conn(0x7f67c80d0d90 msgr2=0x7f67c80ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c7fff640 1 --2- 172.21.15.19:0/2892636599 >> v2:172.21.15.204:3300/0 conn(0x7f67c80d0d90 0x7f67c80ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c7fff640 1 -- 172.21.15.19:0/2892636599 >> v1:172.21.15.19:6789/0 conn(0x7f67c815e000 legacy=0x7f67c80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c67fc640 1 -- 172.21.15.19:0/2892636599 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292324816 0 0) 0x7f67c80d25e0 con 0x7f67c815e000 2024-03-04T08:50:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c7fff640 1 -- 172.21.15.19:0/2892636599 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80d2b40 con 0x7f67c80c90f0 2024-03-04T08:50:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.186+0000 7f67c7fff640 1 --2- 172.21.15.19:0/2892636599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80ced00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67c806b7f0 tx=0x7f67c002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4479aee80fe3ead server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67c67fc640 1 -- 172.21.15.19:0/2892636599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0039070 con 0x7f67c80c90f0 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67c67fc640 1 -- 172.21.15.19:0/2892636599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c002cd00 con 0x7f67c80c90f0 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67c67fc640 1 -- 172.21.15.19:0/2892636599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0034660 con 0x7f67c80c90f0 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2892636599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 msgr2=0x7f67c80ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2892636599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80ced00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67c806b7f0 tx=0x7f67c002bf50 comp rx=0 tx=0).stop 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2892636599 shutdown_connections 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2892636599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80ced00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2892636599 >> v2:172.21.15.204:3300/0 conn(0x7f67c80d0d90 0x7f67c80ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2892636599 >> 172.21.15.19:0/2892636599 conn(0x7f67c80d3cf0 msgr2=0x7f67c80d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2892636599 shutdown_connections 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.187+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2892636599 wait complete. 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.188+0000 7f67cdd3a640 1 Processor -- start 2024-03-04T08:50:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.188+0000 7f67cdd3a640 1 -- start start 2024-03-04T08:50:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67c80d0d90 0x7f67c80cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67c815e000 0x7f67c80cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815e3e0 con 0x7f67c80c90f0 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80d22d0 con 0x7f67c80d0d90 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67cdd3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80d4810 con 0x7f67c815e000 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45998/0 (socket says 172.21.15.19:45998) 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67c77fe640 1 -- 172.21.15.19:0/2343555085 learned_addr learned my addr 172.21.15.19:0/2343555085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67c6ffd640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67c80d0d90 0x7f67c80cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.189+0000 7f67c7fff640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67c815e000 0x7f67c80cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 -- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67c815e000 msgr2=0x7f67c80cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67c815e000 0x7f67c80cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 -- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67c80d0d90 msgr2=0x7f67c80cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67c80d0d90 0x7f67c80cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 -- 172.21.15.19:0/2343555085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c809f1a0 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67c77fe640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c460 tx=0x7f67b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8018070 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8007500 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8004a20 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c809f480 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.190+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c809fa40 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.191+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c804f330 con 0x7f67c80c90f0 2024-03-04T08:50:42.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.191+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67b801b070 con 0x7f67c80c90f0 2024-03-04T08:50:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.192+0000 7f67affff640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 0x7f67b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.192+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67b80894c0 con 0x7f67c80c90f0 2024-03-04T08:50:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.192+0000 7f67c6ffd640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 0x7f67b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.192+0000 7f67c6ffd640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 0x7f67b406d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f67c81f6f90 tx=0x7f67bc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.196+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f67b8057c50 con 0x7f67c80c90f0 2024-03-04T08:50:42.443 INFO:tasks.ceph.mds.b.smithi204.stderr:2024-03-04T08:50:42.447+0000 7fdd9d682640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:50:42.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.450+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f67c806c110 con 0x7f67c80c90f0 2024-03-04T08:50:42.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.451+0000 7f67affff640 1 -- 172.21.15.19:0/2343555085 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1171 (secure 0 0 0) 0x7f67b805bcf0 con 0x7f67c80c90f0 2024-03-04T08:50:42.447 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:42.447 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1709542231,"num_in_osds":8,"osd_in_since":1709542223,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":53},{"state_name":"creating+peering","count":25},{"state_name":"active+clean","count":19}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590550,"bytes_used":224587776,"bytes_avail":772869525504,"bytes_total":773094113280,"unknown_pgs_ratio":0.54639172554016113,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":808,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-04T08:50:20.844912+0000","services":{}},"progress_events":{}} 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.452+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 msgr2=0x7f67b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.452+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 0x7f67b406d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f67c81f6f90 tx=0x7f67bc009190 comp rx=0 tx=0).stop 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.452+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 msgr2=0x7f67c80cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.452+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c460 tx=0x7f67b800c920 comp rx=0 tx=0).stop 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 shutdown_connections 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f67c815e000 0x7f67c80cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f67b406b4d0 0x7f67b406d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67c80d0d90 0x7f67c80cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 --2- 172.21.15.19:0/2343555085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67c80c90f0 0x7f67c80cd750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 >> 172.21.15.19:0/2343555085 conn(0x7f67c80d3cf0 msgr2=0x7f67c80b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:42.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 shutdown_connections 2024-03-04T08:50:42.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.453+0000 7f67cdd3a640 1 -- 172.21.15.19:0/2343555085 wait complete. 2024-03-04T08:50:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-04T08:50:42.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:42.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.564+0000 7f8bcb4fb640 1 Processor -- start 2024-03-04T08:50:42.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 -- start start 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 0x7f8bc40b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc40d25d0 con 0x7f8bc40b4dd0 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40d4bf0 con 0x7f8bc40d4760 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.565+0000 7f8bcb4fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40ce9e0 con 0x7f8bc40b4170 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc8a96640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9297640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 0x7f8bc40b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9a98640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f8bc40b4dd0 0x7f8bc40cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:53688/0 (socket says 172.21.15.19:53688) 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9a98640 1 -- 172.21.15.19:0/1462726193 learned_addr learned my addr 172.21.15.19:0/1462726193 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc8a96640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57056/0 (socket says 172.21.15.19:57056) 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9297640 1 -- 172.21.15.19:0/1462726193 >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 msgr2=0x7f8bc40d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1462726193 >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9297640 1 -- 172.21.15.19:0/1462726193 >> v1:172.21.15.204:6789/0 conn(0x7f8bc40b4dd0 legacy=0x7f8bc40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc9297640 1 -- 172.21.15.19:0/1462726193 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40d2870 con 0x7f8bc40b4170 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bbbfff640 1 -- 172.21.15.19:0/1462726193 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422086975 0 0) 0x7f8bc40d25d0 con 0x7f8bc40b4dd0 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.566+0000 7f8bc8a96640 1 --2- 172.21.15.19:0/1462726193 >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1462726193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 0x7f8bc40b6a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097a0 tx=0x7f8bc002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935f8996fd086d5c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bbbfff640 1 -- 172.21.15.19:0/1462726193 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0035020 con 0x7f8bc40b4170 2024-03-04T08:50:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bbbfff640 1 -- 172.21.15.19:0/1462726193 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0031830 con 0x7f8bc40b4170 2024-03-04T08:50:42.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bbbfff640 1 -- 172.21.15.19:0/1462726193 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0031c00 con 0x7f8bc40b4170 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1462726193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 msgr2=0x7f8bc40b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1462726193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 0x7f8bc40b6a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097a0 tx=0x7f8bc002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1462726193 shutdown_connections 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1462726193 >> v2:172.21.15.204:3300/0 conn(0x7f8bc40d4760 0x7f8bc40d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1462726193 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4170 0x7f8bc40b6a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1462726193 >> 172.21.15.19:0/1462726193 conn(0x7f8bc40d3c40 msgr2=0x7f8bc40d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1462726193 shutdown_connections 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.567+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1462726193 wait complete. 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 Processor -- start 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 -- start start 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 0x7f8bc40cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4dd0 0x7f8bc415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40b47d0 con 0x7f8bc41572b0 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40b4550 con 0x7f8bc40b4170 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bcb4fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40b4950 con 0x7f8bc40b4dd0 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bc9a98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.569+0000 7f8bc9a98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46006/0 (socket says 172.21.15.19:46006) 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 -- 172.21.15.19:0/1645841879 learned_addr learned my addr 172.21.15.19:0/1645841879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:42.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 0x7f8bc40cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc8a96640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4dd0 0x7f8bc415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 -- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4dd0 msgr2=0x7f8bc415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4dd0 0x7f8bc415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 -- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 msgr2=0x7f8bc40cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 0x7f8bc40cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 -- 172.21.15.19:0/1645841879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40ccb60 con 0x7f8bc41572b0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 0x7f8bc40cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bc9a98640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c7a0 tx=0x7f8bbc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc018070 con 0x7f8bc41572b0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00a640 con 0x7f8bc41572b0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc40cce40 con 0x7f8bc41572b0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00aab0 con 0x7f8bc41572b0 2024-03-04T08:50:42.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.570+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc40cd400 con 0x7f8bc41572b0 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.571+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc404f330 con 0x7f8bc41572b0 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.572+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8bbc01b070 con 0x7f8bc41572b0 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.572+0000 7f8bb9ffb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 0x7f8ba806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.572+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bbc0896e0 con 0x7f8bc41572b0 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.572+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 0x7f8ba806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.573+0000 7f8bc9297640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 0x7f8ba806d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0036000 tx=0x7f8bc0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:42.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.576+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8bbc057fa0 con 0x7f8bc41572b0 2024-03-04T08:50:42.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.753+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bc40733b0 con 0x7f8ba806b4d0 2024-03-04T08:50:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.759+0000 7f8bb9ffb640 1 -- 172.21.15.19:0/1645841879 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242363 (secure 0 0 0) 0x7f8bc00852d0 con 0x7f8ba806b4d0 2024-03-04T08:50:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:42.759 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:42.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.761+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 msgr2=0x7f8ba806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.761+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 0x7f8ba806d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0036000 tx=0x7f8bc0008030 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 msgr2=0x7f8bc415b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c7a0 tx=0x7f8bbc00cc60 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 shutdown_connections 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bc41572b0 0x7f8bc415b820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8bc40b4dd0 0x7f8bc415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ba806b4d0 0x7f8ba806d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 --2- 172.21.15.19:0/1645841879 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8bc40b4170 0x7f8bc40cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 >> 172.21.15.19:0/1645841879 conn(0x7f8bc40d3c40 msgr2=0x7f8bc40b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:42.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 shutdown_connections 2024-03-04T08:50:42.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:42.762+0000 7f8bcb4fb640 1 -- 172.21.15.19:0/1645841879 wait complete. 2024-03-04T08:50:42.768 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-04T08:50:41.139848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219324,"kb_used_data":2536,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755396,"statfs":{"total":773094113280,"available":772869525504,"internally_reserved":0,"allocated":2596864,"data_stored":1620418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.801142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369176+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:38.369176+0000","last_peered":"2024-03-04T08:50:38.369176+0000","last_clean":"2024-03-04T08:50:38.369176+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:38.369176+0000","last_undegraded":"2024-03-04T08:50:38.369176+0000","last_fullsized":"2024-03-04T08:50:38.369176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:32.683374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356971+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:38.356971+0000","last_peered":"2024-03-04T08:50:38.356971+0000","last_clean":"2024-03-04T08:50:38.356971+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:38.356971+0000","last_undegraded":"2024-03-04T08:50:38.356971+0000","last_fullsized":"2024-03-04T08:50:38.356971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:09.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335930+0000","last_change":"2024-03-04T08:50:36.335930+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335930+0000","last_undegraded":"2024-03-04T08:50:36.335930+0000","last_fullsized":"2024-03-04T08:50:36.335930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333509+0000","last_change":"2024-03-04T08:50:36.333509+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333509+0000","last_undegraded":"2024-03-04T08:50:36.333509+0000","last_fullsized":"2024-03-04T08:50:36.333509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339012+0000","last_change":"2024-03-04T08:50:36.339012+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339012+0000","last_undegraded":"2024-03-04T08:50:36.339012+0000","last_fullsized":"2024-03-04T08:50:36.339012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339667+0000","last_change":"2024-03-04T08:50:36.339667+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339667+0000","last_undegraded":"2024-03-04T08:50:36.339667+0000","last_fullsized":"2024-03-04T08:50:36.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369200+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:38.369200+0000","last_peered":"2024-03-04T08:50:38.369200+0000","last_clean":"2024-03-04T08:50:38.369200+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:38.369200+0000","last_undegraded":"2024-03-04T08:50:38.369200+0000","last_fullsized":"2024-03-04T08:50:38.369200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:20.740104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335959+0000","last_change":"2024-03-04T08:50:36.335959+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335959+0000","last_undegraded":"2024-03-04T08:50:36.335959+0000","last_fullsized":"2024-03-04T08:50:36.335959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335545+0000","last_change":"2024-03-04T08:50:36.335545+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335545+0000","last_undegraded":"2024-03-04T08:50:36.335545+0000","last_fullsized":"2024-03-04T08:50:36.335545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339715+0000","last_change":"2024-03-04T08:50:36.339715+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339715+0000","last_undegraded":"2024-03-04T08:50:36.339715+0000","last_fullsized":"2024-03-04T08:50:36.339715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335694+0000","last_change":"2024-03-04T08:50:36.335694+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335694+0000","last_undegraded":"2024-03-04T08:50:36.335694+0000","last_fullsized":"2024-03-04T08:50:36.335694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342130+0000","last_change":"2024-03-04T08:50:36.342130+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342130+0000","last_undegraded":"2024-03-04T08:50:36.342130+0000","last_fullsized":"2024-03-04T08:50:36.342130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356714+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:38.356714+0000","last_peered":"2024-03-04T08:50:38.356714+0000","last_clean":"2024-03-04T08:50:38.356714+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:38.356714+0000","last_undegraded":"2024-03-04T08:50:38.356714+0000","last_fullsized":"2024-03-04T08:50:38.356714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342075+0000","last_change":"2024-03-04T08:50:36.342075+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342075+0000","last_undegraded":"2024-03-04T08:50:36.342075+0000","last_fullsized":"2024-03-04T08:50:36.342075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342072+0000","last_change":"2024-03-04T08:50:36.342072+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342072+0000","last_undegraded":"2024-03-04T08:50:36.342072+0000","last_fullsized":"2024-03-04T08:50:36.342072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T08:50:36.337779+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:36.337779+0000","last_peered":"2024-03-04T08:50:36.337779+0000","last_clean":"2024-03-04T08:50:36.337779+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:36.337779+0000","last_undegraded":"2024-03-04T08:50:36.337779+0000","last_fullsized":"2024-03-04T08:50:36.337779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339243+0000","last_change":"2024-03-04T08:50:36.339243+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339243+0000","last_undegraded":"2024-03-04T08:50:36.339243+0000","last_fullsized":"2024-03-04T08:50:36.339243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335595+0000","last_change":"2024-03-04T08:50:36.335595+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335595+0000","last_undegraded":"2024-03-04T08:50:36.335595+0000","last_fullsized":"2024-03-04T08:50:36.335595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.342154+0000","last_change":"2024-03-04T08:50:36.342154+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.342154+0000","last_undegraded":"2024-03-04T08:50:36.342154+0000","last_fullsized":"2024-03-04T08:50:36.342154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.339013+0000","last_change":"2024-03-04T08:50:36.339013+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.339013+0000","last_undegraded":"2024-03-04T08:50:36.339013+0000","last_fullsized":"2024-03-04T08:50:36.339013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357631+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:38.357631+0000","last_peered":"2024-03-04T08:50:38.357631+0000","last_clean":"2024-03-04T08:50:38.357631+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:38.357631+0000","last_undegraded":"2024-03-04T08:50:38.357631+0000","last_fullsized":"2024-03-04T08:50:38.357631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:52.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336193+0000","last_change":"2024-03-04T08:50:36.336193+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336193+0000","last_undegraded":"2024-03-04T08:50:36.336193+0000","last_fullsized":"2024-03-04T08:50:36.336193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356034+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:39.356034+0000","last_peered":"2024-03-04T08:50:39.356034+0000","last_clean":"2024-03-04T08:50:39.356034+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:39.356034+0000","last_undegraded":"2024-03-04T08:50:39.356034+0000","last_fullsized":"2024-03-04T08:50:39.356034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335753+0000","last_change":"2024-03-04T08:50:36.335753+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335753+0000","last_undegraded":"2024-03-04T08:50:36.335753+0000","last_fullsized":"2024-03-04T08:50:36.335753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337010+0000","last_change":"2024-03-04T08:50:36.337010+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337010+0000","last_undegraded":"2024-03-04T08:50:36.337010+0000","last_fullsized":"2024-03-04T08:50:36.337010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357553+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:38.357553+0000","last_peered":"2024-03-04T08:50:38.357553+0000","last_clean":"2024-03-04T08:50:38.357553+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:38.357553+0000","last_undegraded":"2024-03-04T08:50:38.357553+0000","last_fullsized":"2024-03-04T08:50:38.357553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:49.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335645+0000","last_change":"2024-03-04T08:50:36.335645+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335645+0000","last_undegraded":"2024-03-04T08:50:36.335645+0000","last_fullsized":"2024-03-04T08:50:36.335645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.335651+0000","last_change":"2024-03-04T08:50:36.335651+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.335651+0000","last_undegraded":"2024-03-04T08:50:36.335651+0000","last_fullsized":"2024-03-04T08:50:36.335651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.337129+0000","last_change":"2024-03-04T08:50:36.337129+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.337129+0000","last_undegraded":"2024-03-04T08:50:36.337129+0000","last_fullsized":"2024-03-04T08:50:36.337129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.333515+0000","last_change":"2024-03-04T08:50:36.333515+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.333515+0000","last_undegraded":"2024-03-04T08:50:36.333515+0000","last_fullsized":"2024-03-04T08:50:36.333515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:50:37.331491+0000","last_change":"2024-03-04T08:50:37.331491+0000","last_active":"2024-03-04T08:50:37.331491+0000","last_peered":"2024-03-04T08:50:37.331491+0000","last_clean":"2024-03-04T08:50:37.331491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:37.331491+0000","last_undegraded":"2024-03-04T08:50:37.331491+0000","last_fullsized":"2024-03-04T08:50:37.331491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-03-04T08:50:36.336057+0000","last_change":"2024-03-04T08:50:36.336057+0000","last_active":"2024-03-04T08:50:36.326065+0000","last_peered":"2024-03-04T08:50:36.326065+0000","last_clean":"2024-03-04T08:50:36.326065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:50:36.336057+0000","last_undegraded":"2024-03-04T08:50:36.336057+0000","last_fullsized":"2024-03-04T08:50:36.336057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28392,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343448,"statfs":{"total":96636764160,"available":96607690752,"internally_reserved":0,"allocated":765952,"data_stored":644151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":638334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:44.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:44.349 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:50:45.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.890+0000 7f80c0422640 1 Processor -- start 2024-03-04T08:50:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.890+0000 7f80c0422640 1 -- start start 2024-03-04T08:50:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80c0422640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f80b8162a00 0x7f80b80d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80c0422640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f80b8162400 0x7f80b80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80c0422640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b80b1070 con 0x7f80b8162020 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80c0422640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80ce9d0 con 0x7f80b8162a00 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80c0422640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80d2da0 con 0x7f80b8162400 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd9bd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f80b8162a00 0x7f80b80d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80be1be640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f80b8162020 0x7f80b80b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37674/0 (socket says 172.21.15.19:37674) 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80be1be640 1 -- 172.21.15.19:0/2421940339 learned_addr learned my addr 172.21.15.19:0/2421940339 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80be9bf640 1 --2- 172.21.15.19:0/2421940339 >> v2:172.21.15.204:3300/0 conn(0x7f80b8162400 0x7f80b80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd9bd640 1 -- 172.21.15.19:0/2421940339 >> v2:172.21.15.204:3300/0 conn(0x7f80b8162400 msgr2=0x7f80b80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd9bd640 1 --2- 172.21.15.19:0/2421940339 >> v2:172.21.15.204:3300/0 conn(0x7f80b8162400 0x7f80b80cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd9bd640 1 -- 172.21.15.19:0/2421940339 >> v1:172.21.15.19:6789/0 conn(0x7f80b8162020 legacy=0x7f80b80b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd1bc640 1 -- 172.21.15.19:0/2421940339 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584926562 0 0) 0x7f80b80b1070 con 0x7f80b8162020 2024-03-04T08:50:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.891+0000 7f80bd9bd640 1 -- 172.21.15.19:0/2421940339 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80d2500 con 0x7f80b8162a00 2024-03-04T08:50:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.892+0000 7f80bd9bd640 1 --2- 172.21.15.19:0/2421940339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162a00 0x7f80b80d4830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80b80c77e0 tx=0x7f80ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f22a6885b3db733 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.892+0000 7f80bd1bc640 1 -- 172.21.15.19:0/2421940339 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac034070 con 0x7f80b8162a00 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.892+0000 7f80bd1bc640 1 -- 172.21.15.19:0/2421940339 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac030610 con 0x7f80b8162a00 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.892+0000 7f80bd1bc640 1 -- 172.21.15.19:0/2421940339 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0309e0 con 0x7f80b8162a00 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 -- 172.21.15.19:0/2421940339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162a00 msgr2=0x7f80b80d4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 --2- 172.21.15.19:0/2421940339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162a00 0x7f80b80d4830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80b80c77e0 tx=0x7f80ac02b960 comp rx=0 tx=0).stop 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 -- 172.21.15.19:0/2421940339 shutdown_connections 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 --2- 172.21.15.19:0/2421940339 >> v2:172.21.15.204:3300/0 conn(0x7f80b8162400 0x7f80b80cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 --2- 172.21.15.19:0/2421940339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162a00 0x7f80b80d4830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 -- 172.21.15.19:0/2421940339 >> 172.21.15.19:0/2421940339 conn(0x7f80b80d3d10 msgr2=0x7f80b80d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 -- 172.21.15.19:0/2421940339 shutdown_connections 2024-03-04T08:50:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.893+0000 7f80c0422640 1 -- 172.21.15.19:0/2421940339 wait complete. 2024-03-04T08:50:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.894+0000 7f80c0422640 1 Processor -- start 2024-03-04T08:50:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.894+0000 7f80c0422640 1 -- start start 2024-03-04T08:50:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80b8162400 0x7f80b80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80b8162a00 0x7f80b8152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80cec00 con 0x7f80b8162020 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80d2ac0 con 0x7f80b8162a00 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80c0422640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80cf940 con 0x7f80b8162400 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46024/0 (socket says 172.21.15.19:46024) 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 -- 172.21.15.19:0/4075936303 learned_addr learned my addr 172.21.15.19:0/4075936303 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80bd9bd640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80b8162400 0x7f80b80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be9bf640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80b8162a00 0x7f80b8152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 -- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80b8162400 msgr2=0x7f80b80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80b8162400 0x7f80b80cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 -- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80b8162a00 msgr2=0x7f80b8152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80b8162a00 0x7f80b8152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 -- 172.21.15.19:0/4075936303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80cd380 con 0x7f80b8162020 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.895+0000 7f80be1be640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c890 tx=0x7f80a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.896+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8018070 con 0x7f80b8162020 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.896+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a800a640 con 0x7f80b8162020 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.896+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80cd620 con 0x7f80b8162020 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.896+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800aa30 con 0x7f80b8162020 2024-03-04T08:50:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.896+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80cdbe0 con 0x7f80b8162020 2024-03-04T08:50:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.897+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b804f330 con 0x7f80b8162020 2024-03-04T08:50:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.897+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80a801b070 con 0x7f80b8162020 2024-03-04T08:50:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.897+0000 7f80b6ffd640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.898+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80a80897f0 con 0x7f80b8162020 2024-03-04T08:50:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.898+0000 7f80bd9bd640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.898+0000 7f80bd9bd640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 0x7f80a406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80ac036000 tx=0x7f80ac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:45.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:45.902+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f80a8058020 con 0x7f80b8162020 2024-03-04T08:50:46.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.080+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80b8073380 con 0x7f80a406b4d0 2024-03-04T08:50:46.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.087+0000 7f80b6ffd640 1 -- 172.21.15.19:0/4075936303 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251941 (secure 0 0 0) 0x7f80b8073380 con 0x7f80a406b4d0 2024-03-04T08:50:46.085 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:46.087 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 msgr2=0x7f80a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 0x7f80a406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80ac036000 tx=0x7f80ac008030 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 msgr2=0x7f80b80cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c890 tx=0x7f80a800cd50 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 shutdown_connections 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f80b8162a00 0x7f80b8152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f80b8162400 0x7f80b80cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 --2- 172.21.15.19:0/4075936303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80b8162020 0x7f80b80cbe30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 >> 172.21.15.19:0/4075936303 conn(0x7f80b80d3d10 msgr2=0x7f80b80d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 shutdown_connections 2024-03-04T08:50:46.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.089+0000 7f80c0422640 1 -- 172.21.15.19:0/4075936303 wait complete. 2024-03-04T08:50:46.096 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-04T08:50:45.140610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2844,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2912256,"data_stored":1764320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.801904"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762604+0000","last_change":"2024-03-04T08:50:38.374441+0000","last_active":"2024-03-04T08:50:41.762604+0000","last_peered":"2024-03-04T08:50:41.762604+0000","last_clean":"2024-03-04T08:50:41.762604+0000","last_became_active":"2024-03-04T08:50:38.373591+0000","last_became_peered":"2024-03-04T08:50:38.373591+0000","last_unstale":"2024-03-04T08:50:41.762604+0000","last_undegraded":"2024-03-04T08:50:41.762604+0000","last_fullsized":"2024-03-04T08:50:41.762604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855140+0000","last_change":"2024-03-04T08:50:38.358053+0000","last_active":"2024-03-04T08:50:39.855140+0000","last_peered":"2024-03-04T08:50:39.855140+0000","last_clean":"2024-03-04T08:50:39.855140+0000","last_became_active":"2024-03-04T08:50:38.357255+0000","last_became_peered":"2024-03-04T08:50:38.357255+0000","last_unstale":"2024-03-04T08:50:39.855140+0000","last_undegraded":"2024-03-04T08:50:39.855140+0000","last_fullsized":"2024-03-04T08:50:39.855140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361037+0000","last_change":"2024-03-04T08:50:38.366948+0000","last_active":"2024-03-04T08:50:39.361037+0000","last_peered":"2024-03-04T08:50:39.361037+0000","last_clean":"2024-03-04T08:50:39.361037+0000","last_became_active":"2024-03-04T08:50:38.366208+0000","last_became_peered":"2024-03-04T08:50:38.366208+0000","last_unstale":"2024-03-04T08:50:39.361037+0000","last_undegraded":"2024-03-04T08:50:39.361037+0000","last_fullsized":"2024-03-04T08:50:39.361037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762315+0000","last_change":"2024-03-04T08:50:38.368966+0000","last_active":"2024-03-04T08:50:41.762315+0000","last_peered":"2024-03-04T08:50:41.762315+0000","last_clean":"2024-03-04T08:50:41.762315+0000","last_became_active":"2024-03-04T08:50:38.368654+0000","last_became_peered":"2024-03-04T08:50:38.368654+0000","last_unstale":"2024-03-04T08:50:41.762315+0000","last_undegraded":"2024-03-04T08:50:41.762315+0000","last_fullsized":"2024-03-04T08:50:41.762315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360847+0000","last_change":"2024-03-04T08:50:38.367968+0000","last_active":"2024-03-04T08:50:39.360847+0000","last_peered":"2024-03-04T08:50:39.360847+0000","last_clean":"2024-03-04T08:50:39.360847+0000","last_became_active":"2024-03-04T08:50:38.367016+0000","last_became_peered":"2024-03-04T08:50:38.367016+0000","last_unstale":"2024-03-04T08:50:39.360847+0000","last_undegraded":"2024-03-04T08:50:39.360847+0000","last_fullsized":"2024-03-04T08:50:39.360847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762203+0000","last_change":"2024-03-04T08:50:38.369638+0000","last_active":"2024-03-04T08:50:41.762203+0000","last_peered":"2024-03-04T08:50:41.762203+0000","last_clean":"2024-03-04T08:50:41.762203+0000","last_became_active":"2024-03-04T08:50:38.369312+0000","last_became_peered":"2024-03-04T08:50:38.369312+0000","last_unstale":"2024-03-04T08:50:41.762203+0000","last_undegraded":"2024-03-04T08:50:41.762203+0000","last_fullsized":"2024-03-04T08:50:41.762203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358569+0000","last_change":"2024-03-04T08:50:38.366361+0000","last_active":"2024-03-04T08:50:39.358569+0000","last_peered":"2024-03-04T08:50:39.358569+0000","last_clean":"2024-03-04T08:50:39.358569+0000","last_became_active":"2024-03-04T08:50:38.366068+0000","last_became_peered":"2024-03-04T08:50:38.366068+0000","last_unstale":"2024-03-04T08:50:39.358569+0000","last_undegraded":"2024-03-04T08:50:39.358569+0000","last_fullsized":"2024-03-04T08:50:39.358569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762627+0000","last_change":"2024-03-04T08:50:38.374220+0000","last_active":"2024-03-04T08:50:41.762627+0000","last_peered":"2024-03-04T08:50:41.762627+0000","last_clean":"2024-03-04T08:50:41.762627+0000","last_became_active":"2024-03-04T08:50:38.373445+0000","last_became_peered":"2024-03-04T08:50:38.373445+0000","last_unstale":"2024-03-04T08:50:41.762627+0000","last_undegraded":"2024-03-04T08:50:41.762627+0000","last_fullsized":"2024-03-04T08:50:41.762627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:10.678854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346401+0000","last_change":"2024-03-04T08:50:38.367714+0000","last_active":"2024-03-04T08:50:40.346401+0000","last_peered":"2024-03-04T08:50:40.346401+0000","last_clean":"2024-03-04T08:50:40.346401+0000","last_became_active":"2024-03-04T08:50:38.366771+0000","last_became_peered":"2024-03-04T08:50:38.366771+0000","last_unstale":"2024-03-04T08:50:40.346401+0000","last_undegraded":"2024-03-04T08:50:40.346401+0000","last_fullsized":"2024-03-04T08:50:40.346401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346207+0000","last_change":"2024-03-04T08:50:38.368524+0000","last_active":"2024-03-04T08:50:40.346207+0000","last_peered":"2024-03-04T08:50:40.346207+0000","last_clean":"2024-03-04T08:50:40.346207+0000","last_became_active":"2024-03-04T08:50:38.368245+0000","last_became_peered":"2024-03-04T08:50:38.368245+0000","last_unstale":"2024-03-04T08:50:40.346207+0000","last_undegraded":"2024-03-04T08:50:40.346207+0000","last_fullsized":"2024-03-04T08:50:40.346207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369176+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:38.369176+0000","last_peered":"2024-03-04T08:50:38.369176+0000","last_clean":"2024-03-04T08:50:38.369176+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:38.369176+0000","last_undegraded":"2024-03-04T08:50:38.369176+0000","last_fullsized":"2024-03-04T08:50:38.369176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:32.683374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358986+0000","last_change":"2024-03-04T08:50:38.362814+0000","last_active":"2024-03-04T08:50:39.358986+0000","last_peered":"2024-03-04T08:50:39.358986+0000","last_clean":"2024-03-04T08:50:39.358986+0000","last_became_active":"2024-03-04T08:50:38.362485+0000","last_became_peered":"2024-03-04T08:50:38.362485+0000","last_unstale":"2024-03-04T08:50:39.358986+0000","last_undegraded":"2024-03-04T08:50:39.358986+0000","last_fullsized":"2024-03-04T08:50:39.358986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854913+0000","last_change":"2024-03-04T08:50:38.351189+0000","last_active":"2024-03-04T08:50:39.854913+0000","last_peered":"2024-03-04T08:50:39.854913+0000","last_clean":"2024-03-04T08:50:39.854913+0000","last_became_active":"2024-03-04T08:50:38.350891+0000","last_became_peered":"2024-03-04T08:50:38.350891+0000","last_unstale":"2024-03-04T08:50:39.854913+0000","last_undegraded":"2024-03-04T08:50:39.854913+0000","last_fullsized":"2024-03-04T08:50:39.854913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.937210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360695+0000","last_change":"2024-03-04T08:50:38.367551+0000","last_active":"2024-03-04T08:50:39.360695+0000","last_peered":"2024-03-04T08:50:39.360695+0000","last_clean":"2024-03-04T08:50:39.360695+0000","last_became_active":"2024-03-04T08:50:38.367313+0000","last_became_peered":"2024-03-04T08:50:38.367313+0000","last_unstale":"2024-03-04T08:50:39.360695+0000","last_undegraded":"2024-03-04T08:50:39.360695+0000","last_fullsized":"2024-03-04T08:50:39.360695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361629+0000","last_change":"2024-03-04T08:50:38.368986+0000","last_active":"2024-03-04T08:50:39.361629+0000","last_peered":"2024-03-04T08:50:39.361629+0000","last_clean":"2024-03-04T08:50:39.361629+0000","last_became_active":"2024-03-04T08:50:38.368733+0000","last_became_peered":"2024-03-04T08:50:38.368733+0000","last_unstale":"2024-03-04T08:50:39.361629+0000","last_undegraded":"2024-03-04T08:50:39.361629+0000","last_fullsized":"2024-03-04T08:50:39.361629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394395+0000","last_change":"2024-03-04T08:50:38.360761+0000","last_active":"2024-03-04T08:50:39.394395+0000","last_peered":"2024-03-04T08:50:39.394395+0000","last_clean":"2024-03-04T08:50:39.394395+0000","last_became_active":"2024-03-04T08:50:38.360455+0000","last_became_peered":"2024-03-04T08:50:38.360455+0000","last_unstale":"2024-03-04T08:50:39.394395+0000","last_undegraded":"2024-03-04T08:50:39.394395+0000","last_fullsized":"2024-03-04T08:50:39.394395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:12.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762612+0000","last_change":"2024-03-04T08:50:38.370011+0000","last_active":"2024-03-04T08:50:41.762612+0000","last_peered":"2024-03-04T08:50:41.762612+0000","last_clean":"2024-03-04T08:50:41.762612+0000","last_became_active":"2024-03-04T08:50:38.369378+0000","last_became_peered":"2024-03-04T08:50:38.369378+0000","last_unstale":"2024-03-04T08:50:41.762612+0000","last_undegraded":"2024-03-04T08:50:41.762612+0000","last_fullsized":"2024-03-04T08:50:41.762612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:31.681098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346113+0000","last_change":"2024-03-04T08:50:38.358855+0000","last_active":"2024-03-04T08:50:40.346113+0000","last_peered":"2024-03-04T08:50:40.346113+0000","last_clean":"2024-03-04T08:50:40.346113+0000","last_became_active":"2024-03-04T08:50:38.358588+0000","last_became_peered":"2024-03-04T08:50:38.358588+0000","last_unstale":"2024-03-04T08:50:40.346113+0000","last_undegraded":"2024-03-04T08:50:40.346113+0000","last_fullsized":"2024-03-04T08:50:40.346113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855044+0000","last_change":"2024-03-04T08:50:38.358718+0000","last_active":"2024-03-04T08:50:39.855044+0000","last_peered":"2024-03-04T08:50:39.855044+0000","last_clean":"2024-03-04T08:50:39.855044+0000","last_became_active":"2024-03-04T08:50:38.358117+0000","last_became_peered":"2024-03-04T08:50:38.358117+0000","last_unstale":"2024-03-04T08:50:39.855044+0000","last_undegraded":"2024-03-04T08:50:39.855044+0000","last_fullsized":"2024-03-04T08:50:39.855044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360927+0000","last_change":"2024-03-04T08:50:38.369801+0000","last_active":"2024-03-04T08:50:39.360927+0000","last_peered":"2024-03-04T08:50:39.360927+0000","last_clean":"2024-03-04T08:50:39.360927+0000","last_became_active":"2024-03-04T08:50:38.369294+0000","last_became_peered":"2024-03-04T08:50:38.369294+0000","last_unstale":"2024-03-04T08:50:39.360927+0000","last_undegraded":"2024-03-04T08:50:39.360927+0000","last_fullsized":"2024-03-04T08:50:39.360927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358684+0000","last_change":"2024-03-04T08:50:38.357671+0000","last_active":"2024-03-04T08:50:39.358684+0000","last_peered":"2024-03-04T08:50:39.358684+0000","last_clean":"2024-03-04T08:50:39.358684+0000","last_became_active":"2024-03-04T08:50:38.355946+0000","last_became_peered":"2024-03-04T08:50:38.355946+0000","last_unstale":"2024-03-04T08:50:39.358684+0000","last_undegraded":"2024-03-04T08:50:39.358684+0000","last_fullsized":"2024-03-04T08:50:39.358684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360776+0000","last_change":"2024-03-04T08:50:38.365190+0000","last_active":"2024-03-04T08:50:39.360776+0000","last_peered":"2024-03-04T08:50:39.360776+0000","last_clean":"2024-03-04T08:50:39.360776+0000","last_became_active":"2024-03-04T08:50:38.364935+0000","last_became_peered":"2024-03-04T08:50:38.364935+0000","last_unstale":"2024-03-04T08:50:39.360776+0000","last_undegraded":"2024-03-04T08:50:39.360776+0000","last_fullsized":"2024-03-04T08:50:39.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359096+0000","last_change":"2024-03-04T08:50:38.354934+0000","last_active":"2024-03-04T08:50:39.359096+0000","last_peered":"2024-03-04T08:50:39.359096+0000","last_clean":"2024-03-04T08:50:39.359096+0000","last_became_active":"2024-03-04T08:50:38.354640+0000","last_became_peered":"2024-03-04T08:50:38.354640+0000","last_unstale":"2024-03-04T08:50:39.359096+0000","last_undegraded":"2024-03-04T08:50:39.359096+0000","last_fullsized":"2024-03-04T08:50:39.359096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346441+0000","last_change":"2024-03-04T08:50:38.371561+0000","last_active":"2024-03-04T08:50:40.346441+0000","last_peered":"2024-03-04T08:50:40.346441+0000","last_clean":"2024-03-04T08:50:40.346441+0000","last_became_active":"2024-03-04T08:50:38.371294+0000","last_became_peered":"2024-03-04T08:50:38.371294+0000","last_unstale":"2024-03-04T08:50:40.346441+0000","last_undegraded":"2024-03-04T08:50:40.346441+0000","last_fullsized":"2024-03-04T08:50:40.346441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358972+0000","last_change":"2024-03-04T08:50:38.351562+0000","last_active":"2024-03-04T08:50:39.358972+0000","last_peered":"2024-03-04T08:50:39.358972+0000","last_clean":"2024-03-04T08:50:39.358972+0000","last_became_active":"2024-03-04T08:50:38.351257+0000","last_became_peered":"2024-03-04T08:50:38.351257+0000","last_unstale":"2024-03-04T08:50:39.358972+0000","last_undegraded":"2024-03-04T08:50:39.358972+0000","last_fullsized":"2024-03-04T08:50:39.358972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855063+0000","last_change":"2024-03-04T08:50:38.359297+0000","last_active":"2024-03-04T08:50:39.855063+0000","last_peered":"2024-03-04T08:50:39.855063+0000","last_clean":"2024-03-04T08:50:39.855063+0000","last_became_active":"2024-03-04T08:50:38.358979+0000","last_became_peered":"2024-03-04T08:50:38.358979+0000","last_unstale":"2024-03-04T08:50:39.855063+0000","last_undegraded":"2024-03-04T08:50:39.855063+0000","last_fullsized":"2024-03-04T08:50:39.855063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361039+0000","last_change":"2024-03-04T08:50:38.367261+0000","last_active":"2024-03-04T08:50:39.361039+0000","last_peered":"2024-03-04T08:50:39.361039+0000","last_clean":"2024-03-04T08:50:39.361039+0000","last_became_active":"2024-03-04T08:50:38.366669+0000","last_became_peered":"2024-03-04T08:50:38.366669+0000","last_unstale":"2024-03-04T08:50:39.361039+0000","last_undegraded":"2024-03-04T08:50:39.361039+0000","last_fullsized":"2024-03-04T08:50:39.361039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394336+0000","last_change":"2024-03-04T08:50:38.363033+0000","last_active":"2024-03-04T08:50:39.394336+0000","last_peered":"2024-03-04T08:50:39.394336+0000","last_clean":"2024-03-04T08:50:39.394336+0000","last_became_active":"2024-03-04T08:50:38.362766+0000","last_became_peered":"2024-03-04T08:50:38.362766+0000","last_unstale":"2024-03-04T08:50:39.394336+0000","last_undegraded":"2024-03-04T08:50:39.394336+0000","last_fullsized":"2024-03-04T08:50:39.394336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:58.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346206+0000","last_change":"2024-03-04T08:50:38.368924+0000","last_active":"2024-03-04T08:50:40.346206+0000","last_peered":"2024-03-04T08:50:40.346206+0000","last_clean":"2024-03-04T08:50:40.346206+0000","last_became_active":"2024-03-04T08:50:38.368637+0000","last_became_peered":"2024-03-04T08:50:38.368637+0000","last_unstale":"2024-03-04T08:50:40.346206+0000","last_undegraded":"2024-03-04T08:50:40.346206+0000","last_fullsized":"2024-03-04T08:50:40.346206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356971+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:38.356971+0000","last_peered":"2024-03-04T08:50:38.356971+0000","last_clean":"2024-03-04T08:50:38.356971+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:38.356971+0000","last_undegraded":"2024-03-04T08:50:38.356971+0000","last_fullsized":"2024-03-04T08:50:38.356971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:09.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359083+0000","last_change":"2024-03-04T08:50:37.354227+0000","last_active":"2024-03-04T08:50:39.359083+0000","last_peered":"2024-03-04T08:50:39.359083+0000","last_clean":"2024-03-04T08:50:39.359083+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.359083+0000","last_undegraded":"2024-03-04T08:50:39.359083+0000","last_fullsized":"2024-03-04T08:50:39.359083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855222+0000","last_change":"2024-03-04T08:50:38.349460+0000","last_active":"2024-03-04T08:50:39.855222+0000","last_peered":"2024-03-04T08:50:39.855222+0000","last_clean":"2024-03-04T08:50:39.855222+0000","last_became_active":"2024-03-04T08:50:38.349165+0000","last_became_peered":"2024-03-04T08:50:38.349165+0000","last_unstale":"2024-03-04T08:50:39.855222+0000","last_undegraded":"2024-03-04T08:50:39.855222+0000","last_fullsized":"2024-03-04T08:50:39.855222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345975+0000","last_change":"2024-03-04T08:50:37.357596+0000","last_active":"2024-03-04T08:50:40.345975+0000","last_peered":"2024-03-04T08:50:40.345975+0000","last_clean":"2024-03-04T08:50:40.345975+0000","last_became_active":"2024-03-04T08:50:37.357184+0000","last_became_peered":"2024-03-04T08:50:37.357184+0000","last_unstale":"2024-03-04T08:50:40.345975+0000","last_undegraded":"2024-03-04T08:50:40.345975+0000","last_fullsized":"2024-03-04T08:50:40.345975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358596+0000","last_change":"2024-03-04T08:50:37.360184+0000","last_active":"2024-03-04T08:50:39.358596+0000","last_peered":"2024-03-04T08:50:39.358596+0000","last_clean":"2024-03-04T08:50:39.358596+0000","last_became_active":"2024-03-04T08:50:37.359861+0000","last_became_peered":"2024-03-04T08:50:37.359861+0000","last_unstale":"2024-03-04T08:50:39.358596+0000","last_undegraded":"2024-03-04T08:50:39.358596+0000","last_fullsized":"2024-03-04T08:50:39.358596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358627+0000","last_change":"2024-03-04T08:50:38.357592+0000","last_active":"2024-03-04T08:50:39.358627+0000","last_peered":"2024-03-04T08:50:39.358627+0000","last_clean":"2024-03-04T08:50:39.358627+0000","last_became_active":"2024-03-04T08:50:38.357281+0000","last_became_peered":"2024-03-04T08:50:38.357281+0000","last_unstale":"2024-03-04T08:50:39.358627+0000","last_undegraded":"2024-03-04T08:50:39.358627+0000","last_fullsized":"2024-03-04T08:50:39.358627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360880+0000","last_change":"2024-03-04T08:50:37.354365+0000","last_active":"2024-03-04T08:50:39.360880+0000","last_peered":"2024-03-04T08:50:39.360880+0000","last_clean":"2024-03-04T08:50:39.360880+0000","last_became_active":"2024-03-04T08:50:37.354030+0000","last_became_peered":"2024-03-04T08:50:37.354030+0000","last_unstale":"2024-03-04T08:50:39.360880+0000","last_undegraded":"2024-03-04T08:50:39.360880+0000","last_fullsized":"2024-03-04T08:50:39.360880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346201+0000","last_change":"2024-03-04T08:50:37.360991+0000","last_active":"2024-03-04T08:50:40.346201+0000","last_peered":"2024-03-04T08:50:40.346201+0000","last_clean":"2024-03-04T08:50:40.346201+0000","last_became_active":"2024-03-04T08:50:37.360694+0000","last_became_peered":"2024-03-04T08:50:37.360694+0000","last_unstale":"2024-03-04T08:50:40.346201+0000","last_undegraded":"2024-03-04T08:50:40.346201+0000","last_fullsized":"2024-03-04T08:50:40.346201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361659+0000","last_change":"2024-03-04T08:50:38.369004+0000","last_active":"2024-03-04T08:50:39.361659+0000","last_peered":"2024-03-04T08:50:39.361659+0000","last_clean":"2024-03-04T08:50:39.361659+0000","last_became_active":"2024-03-04T08:50:38.368693+0000","last_became_peered":"2024-03-04T08:50:38.368693+0000","last_unstale":"2024-03-04T08:50:39.361659+0000","last_undegraded":"2024-03-04T08:50:39.361659+0000","last_fullsized":"2024-03-04T08:50:39.361659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361605+0000","last_change":"2024-03-04T08:50:37.362455+0000","last_active":"2024-03-04T08:50:39.361605+0000","last_peered":"2024-03-04T08:50:39.361605+0000","last_clean":"2024-03-04T08:50:39.361605+0000","last_became_active":"2024-03-04T08:50:37.362158+0000","last_became_peered":"2024-03-04T08:50:37.362158+0000","last_unstale":"2024-03-04T08:50:39.361605+0000","last_undegraded":"2024-03-04T08:50:39.361605+0000","last_fullsized":"2024-03-04T08:50:39.361605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855246+0000","last_change":"2024-03-04T08:50:38.365240+0000","last_active":"2024-03-04T08:50:39.855246+0000","last_peered":"2024-03-04T08:50:39.855246+0000","last_clean":"2024-03-04T08:50:39.855246+0000","last_became_active":"2024-03-04T08:50:38.364917+0000","last_became_peered":"2024-03-04T08:50:38.364917+0000","last_unstale":"2024-03-04T08:50:39.855246+0000","last_undegraded":"2024-03-04T08:50:39.855246+0000","last_fullsized":"2024-03-04T08:50:39.855246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.369200+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:38.369200+0000","last_peered":"2024-03-04T08:50:38.369200+0000","last_clean":"2024-03-04T08:50:38.369200+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:38.369200+0000","last_undegraded":"2024-03-04T08:50:38.369200+0000","last_fullsized":"2024-03-04T08:50:38.369200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:20.740104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346169+0000","last_change":"2024-03-04T08:50:37.359849+0000","last_active":"2024-03-04T08:50:40.346169+0000","last_peered":"2024-03-04T08:50:40.346169+0000","last_clean":"2024-03-04T08:50:40.346169+0000","last_became_active":"2024-03-04T08:50:37.359576+0000","last_became_peered":"2024-03-04T08:50:37.359576+0000","last_unstale":"2024-03-04T08:50:40.346169+0000","last_undegraded":"2024-03-04T08:50:40.346169+0000","last_fullsized":"2024-03-04T08:50:40.346169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762329+0000","last_change":"2024-03-04T08:50:38.369740+0000","last_active":"2024-03-04T08:50:41.762329+0000","last_peered":"2024-03-04T08:50:41.762329+0000","last_clean":"2024-03-04T08:50:41.762329+0000","last_became_active":"2024-03-04T08:50:38.369073+0000","last_became_peered":"2024-03-04T08:50:38.369073+0000","last_unstale":"2024-03-04T08:50:41.762329+0000","last_undegraded":"2024-03-04T08:50:41.762329+0000","last_fullsized":"2024-03-04T08:50:41.762329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855159+0000","last_change":"2024-03-04T08:50:37.354223+0000","last_active":"2024-03-04T08:50:39.855159+0000","last_peered":"2024-03-04T08:50:39.855159+0000","last_clean":"2024-03-04T08:50:39.855159+0000","last_became_active":"2024-03-04T08:50:37.353906+0000","last_became_peered":"2024-03-04T08:50:37.353906+0000","last_unstale":"2024-03-04T08:50:39.855159+0000","last_undegraded":"2024-03-04T08:50:39.855159+0000","last_fullsized":"2024-03-04T08:50:39.855159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854976+0000","last_change":"2024-03-04T08:50:38.360076+0000","last_active":"2024-03-04T08:50:39.854976+0000","last_peered":"2024-03-04T08:50:39.854976+0000","last_clean":"2024-03-04T08:50:39.854976+0000","last_became_active":"2024-03-04T08:50:38.359714+0000","last_became_peered":"2024-03-04T08:50:38.359714+0000","last_unstale":"2024-03-04T08:50:39.854976+0000","last_undegraded":"2024-03-04T08:50:39.854976+0000","last_fullsized":"2024-03-04T08:50:39.854976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360992+0000","last_change":"2024-03-04T08:50:37.353826+0000","last_active":"2024-03-04T08:50:39.360992+0000","last_peered":"2024-03-04T08:50:39.360992+0000","last_clean":"2024-03-04T08:50:39.360992+0000","last_became_active":"2024-03-04T08:50:37.353132+0000","last_became_peered":"2024-03-04T08:50:37.353132+0000","last_unstale":"2024-03-04T08:50:39.360992+0000","last_undegraded":"2024-03-04T08:50:39.360992+0000","last_fullsized":"2024-03-04T08:50:39.360992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762394+0000","last_change":"2024-03-04T08:50:38.373171+0000","last_active":"2024-03-04T08:50:41.762394+0000","last_peered":"2024-03-04T08:50:41.762394+0000","last_clean":"2024-03-04T08:50:41.762394+0000","last_became_active":"2024-03-04T08:50:38.370738+0000","last_became_peered":"2024-03-04T08:50:38.370738+0000","last_unstale":"2024-03-04T08:50:41.762394+0000","last_undegraded":"2024-03-04T08:50:41.762394+0000","last_fullsized":"2024-03-04T08:50:41.762394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345970+0000","last_change":"2024-03-04T08:50:37.359455+0000","last_active":"2024-03-04T08:50:40.345970+0000","last_peered":"2024-03-04T08:50:40.345970+0000","last_clean":"2024-03-04T08:50:40.345970+0000","last_became_active":"2024-03-04T08:50:37.359137+0000","last_became_peered":"2024-03-04T08:50:37.359137+0000","last_unstale":"2024-03-04T08:50:40.345970+0000","last_undegraded":"2024-03-04T08:50:40.345970+0000","last_fullsized":"2024-03-04T08:50:40.345970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346243+0000","last_change":"2024-03-04T08:50:38.367626+0000","last_active":"2024-03-04T08:50:40.346243+0000","last_peered":"2024-03-04T08:50:40.346243+0000","last_clean":"2024-03-04T08:50:40.346243+0000","last_became_active":"2024-03-04T08:50:38.367277+0000","last_became_peered":"2024-03-04T08:50:38.367277+0000","last_unstale":"2024-03-04T08:50:40.346243+0000","last_undegraded":"2024-03-04T08:50:40.346243+0000","last_fullsized":"2024-03-04T08:50:40.346243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394201+0000","last_change":"2024-03-04T08:50:37.356475+0000","last_active":"2024-03-04T08:50:39.394201+0000","last_peered":"2024-03-04T08:50:39.394201+0000","last_clean":"2024-03-04T08:50:39.394201+0000","last_became_active":"2024-03-04T08:50:37.356167+0000","last_became_peered":"2024-03-04T08:50:37.356167+0000","last_unstale":"2024-03-04T08:50:39.394201+0000","last_undegraded":"2024-03-04T08:50:39.394201+0000","last_fullsized":"2024-03-04T08:50:39.394201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762253+0000","last_change":"2024-03-04T08:50:38.372905+0000","last_active":"2024-03-04T08:50:41.762253+0000","last_peered":"2024-03-04T08:50:41.762253+0000","last_clean":"2024-03-04T08:50:41.762253+0000","last_became_active":"2024-03-04T08:50:38.371431+0000","last_became_peered":"2024-03-04T08:50:38.371431+0000","last_unstale":"2024-03-04T08:50:41.762253+0000","last_undegraded":"2024-03-04T08:50:41.762253+0000","last_fullsized":"2024-03-04T08:50:41.762253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.356714+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:38.356714+0000","last_peered":"2024-03-04T08:50:38.356714+0000","last_clean":"2024-03-04T08:50:38.356714+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:38.356714+0000","last_undegraded":"2024-03-04T08:50:38.356714+0000","last_fullsized":"2024-03-04T08:50:38.356714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762561+0000","last_change":"2024-03-04T08:50:38.372063+0000","last_active":"2024-03-04T08:50:41.762561+0000","last_peered":"2024-03-04T08:50:41.762561+0000","last_clean":"2024-03-04T08:50:41.762561+0000","last_became_active":"2024-03-04T08:50:38.371539+0000","last_became_peered":"2024-03-04T08:50:38.371539+0000","last_unstale":"2024-03-04T08:50:41.762561+0000","last_undegraded":"2024-03-04T08:50:41.762561+0000","last_fullsized":"2024-03-04T08:50:41.762561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394382+0000","last_change":"2024-03-04T08:50:37.350563+0000","last_active":"2024-03-04T08:50:39.394382+0000","last_peered":"2024-03-04T08:50:39.394382+0000","last_clean":"2024-03-04T08:50:39.394382+0000","last_became_active":"2024-03-04T08:50:37.350303+0000","last_became_peered":"2024-03-04T08:50:37.350303+0000","last_unstale":"2024-03-04T08:50:39.394382+0000","last_undegraded":"2024-03-04T08:50:39.394382+0000","last_fullsized":"2024-03-04T08:50:39.394382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762700+0000","last_change":"2024-03-04T08:50:38.373725+0000","last_active":"2024-03-04T08:50:41.762700+0000","last_peered":"2024-03-04T08:50:41.762700+0000","last_clean":"2024-03-04T08:50:41.762700+0000","last_became_active":"2024-03-04T08:50:38.372170+0000","last_became_peered":"2024-03-04T08:50:38.372170+0000","last_unstale":"2024-03-04T08:50:41.762700+0000","last_undegraded":"2024-03-04T08:50:41.762700+0000","last_fullsized":"2024-03-04T08:50:41.762700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:00.038272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361451+0000","last_change":"2024-03-04T08:50:38.365801+0000","last_active":"2024-03-04T08:50:39.361451+0000","last_peered":"2024-03-04T08:50:39.361451+0000","last_clean":"2024-03-04T08:50:39.361451+0000","last_became_active":"2024-03-04T08:50:38.365312+0000","last_became_peered":"2024-03-04T08:50:38.365312+0000","last_unstale":"2024-03-04T08:50:39.361451+0000","last_undegraded":"2024-03-04T08:50:39.361451+0000","last_fullsized":"2024-03-04T08:50:39.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394416+0000","last_change":"2024-03-04T08:50:37.357282+0000","last_active":"2024-03-04T08:50:39.394416+0000","last_peered":"2024-03-04T08:50:39.394416+0000","last_clean":"2024-03-04T08:50:39.394416+0000","last_became_active":"2024-03-04T08:50:37.356970+0000","last_became_peered":"2024-03-04T08:50:37.356970+0000","last_unstale":"2024-03-04T08:50:39.394416+0000","last_undegraded":"2024-03-04T08:50:39.394416+0000","last_fullsized":"2024-03-04T08:50:39.394416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762501+0000","last_change":"2024-03-04T08:50:38.373876+0000","last_active":"2024-03-04T08:50:41.762501+0000","last_peered":"2024-03-04T08:50:41.762501+0000","last_clean":"2024-03-04T08:50:41.762501+0000","last_became_active":"2024-03-04T08:50:38.373349+0000","last_became_peered":"2024-03-04T08:50:38.373349+0000","last_unstale":"2024-03-04T08:50:41.762501+0000","last_undegraded":"2024-03-04T08:50:41.762501+0000","last_fullsized":"2024-03-04T08:50:41.762501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762019+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:41.762019+0000","last_peered":"2024-03-04T08:50:41.762019+0000","last_clean":"2024-03-04T08:50:41.762019+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:41.762019+0000","last_undegraded":"2024-03-04T08:50:41.762019+0000","last_fullsized":"2024-03-04T08:50:41.762019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360752+0000","last_change":"2024-03-04T08:50:37.356373+0000","last_active":"2024-03-04T08:50:39.360752+0000","last_peered":"2024-03-04T08:50:39.360752+0000","last_clean":"2024-03-04T08:50:39.360752+0000","last_became_active":"2024-03-04T08:50:37.356102+0000","last_became_peered":"2024-03-04T08:50:37.356102+0000","last_unstale":"2024-03-04T08:50:39.360752+0000","last_undegraded":"2024-03-04T08:50:39.360752+0000","last_fullsized":"2024-03-04T08:50:39.360752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358993+0000","last_change":"2024-03-04T08:50:38.369654+0000","last_active":"2024-03-04T08:50:39.358993+0000","last_peered":"2024-03-04T08:50:39.358993+0000","last_clean":"2024-03-04T08:50:39.358993+0000","last_became_active":"2024-03-04T08:50:38.369253+0000","last_became_peered":"2024-03-04T08:50:38.369253+0000","last_unstale":"2024-03-04T08:50:39.358993+0000","last_undegraded":"2024-03-04T08:50:39.358993+0000","last_fullsized":"2024-03-04T08:50:39.358993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762136+0000","last_change":"2024-03-04T08:50:37.358364+0000","last_active":"2024-03-04T08:50:41.762136+0000","last_peered":"2024-03-04T08:50:41.762136+0000","last_clean":"2024-03-04T08:50:41.762136+0000","last_became_active":"2024-03-04T08:50:37.358020+0000","last_became_peered":"2024-03-04T08:50:37.358020+0000","last_unstale":"2024-03-04T08:50:41.762136+0000","last_undegraded":"2024-03-04T08:50:41.762136+0000","last_fullsized":"2024-03-04T08:50:41.762136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:49.927169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854875+0000","last_change":"2024-03-04T08:50:38.349604+0000","last_active":"2024-03-04T08:50:39.854875+0000","last_peered":"2024-03-04T08:50:39.854875+0000","last_clean":"2024-03-04T08:50:39.854875+0000","last_became_active":"2024-03-04T08:50:38.349258+0000","last_became_peered":"2024-03-04T08:50:38.349258+0000","last_unstale":"2024-03-04T08:50:39.854875+0000","last_undegraded":"2024-03-04T08:50:39.854875+0000","last_fullsized":"2024-03-04T08:50:39.854875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:24:43.330397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394293+0000","last_change":"2024-03-04T08:50:37.350362+0000","last_active":"2024-03-04T08:50:39.394293+0000","last_peered":"2024-03-04T08:50:39.394293+0000","last_clean":"2024-03-04T08:50:39.394293+0000","last_became_active":"2024-03-04T08:50:37.350066+0000","last_became_peered":"2024-03-04T08:50:37.350066+0000","last_unstale":"2024-03-04T08:50:39.394293+0000","last_undegraded":"2024-03-04T08:50:39.394293+0000","last_fullsized":"2024-03-04T08:50:39.394293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361102+0000","last_change":"2024-03-04T08:50:37.359035+0000","last_active":"2024-03-04T08:50:39.361102+0000","last_peered":"2024-03-04T08:50:39.361102+0000","last_clean":"2024-03-04T08:50:39.361102+0000","last_became_active":"2024-03-04T08:50:37.358433+0000","last_became_peered":"2024-03-04T08:50:37.358433+0000","last_unstale":"2024-03-04T08:50:39.361102+0000","last_undegraded":"2024-03-04T08:50:39.361102+0000","last_fullsized":"2024-03-04T08:50:39.361102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357631+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:38.357631+0000","last_peered":"2024-03-04T08:50:38.357631+0000","last_clean":"2024-03-04T08:50:38.357631+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:38.357631+0000","last_undegraded":"2024-03-04T08:50:38.357631+0000","last_fullsized":"2024-03-04T08:50:38.357631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:52.205440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361386+0000","last_change":"2024-03-04T08:50:38.366605+0000","last_active":"2024-03-04T08:50:39.361386+0000","last_peered":"2024-03-04T08:50:39.361386+0000","last_clean":"2024-03-04T08:50:39.361386+0000","last_became_active":"2024-03-04T08:50:38.366328+0000","last_became_peered":"2024-03-04T08:50:38.366328+0000","last_unstale":"2024-03-04T08:50:39.361386+0000","last_undegraded":"2024-03-04T08:50:39.361386+0000","last_fullsized":"2024-03-04T08:50:39.361386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762564+0000","last_change":"2024-03-04T08:50:37.360537+0000","last_active":"2024-03-04T08:50:41.762564+0000","last_peered":"2024-03-04T08:50:41.762564+0000","last_clean":"2024-03-04T08:50:41.762564+0000","last_became_active":"2024-03-04T08:50:37.360242+0000","last_became_peered":"2024-03-04T08:50:37.360242+0000","last_unstale":"2024-03-04T08:50:41.762564+0000","last_undegraded":"2024-03-04T08:50:41.762564+0000","last_fullsized":"2024-03-04T08:50:41.762564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:57.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356034+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:39.356034+0000","last_peered":"2024-03-04T08:50:39.356034+0000","last_clean":"2024-03-04T08:50:39.356034+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:39.356034+0000","last_undegraded":"2024-03-04T08:50:39.356034+0000","last_fullsized":"2024-03-04T08:50:39.356034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359145+0000","last_change":"2024-03-04T08:50:38.361565+0000","last_active":"2024-03-04T08:50:39.359145+0000","last_peered":"2024-03-04T08:50:39.359145+0000","last_clean":"2024-03-04T08:50:39.359145+0000","last_became_active":"2024-03-04T08:50:38.361273+0000","last_became_peered":"2024-03-04T08:50:38.361273+0000","last_unstale":"2024-03-04T08:50:39.359145+0000","last_undegraded":"2024-03-04T08:50:39.359145+0000","last_fullsized":"2024-03-04T08:50:39.359145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346274+0000","last_change":"2024-03-04T08:50:37.359717+0000","last_active":"2024-03-04T08:50:40.346274+0000","last_peered":"2024-03-04T08:50:40.346274+0000","last_clean":"2024-03-04T08:50:40.346274+0000","last_became_active":"2024-03-04T08:50:37.359245+0000","last_became_peered":"2024-03-04T08:50:37.359245+0000","last_unstale":"2024-03-04T08:50:40.346274+0000","last_undegraded":"2024-03-04T08:50:40.346274+0000","last_fullsized":"2024-03-04T08:50:40.346274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855169+0000","last_change":"2024-03-04T08:50:38.352594+0000","last_active":"2024-03-04T08:50:39.855169+0000","last_peered":"2024-03-04T08:50:39.855169+0000","last_clean":"2024-03-04T08:50:39.855169+0000","last_became_active":"2024-03-04T08:50:38.352332+0000","last_became_peered":"2024-03-04T08:50:38.352332+0000","last_unstale":"2024-03-04T08:50:39.855169+0000","last_undegraded":"2024-03-04T08:50:39.855169+0000","last_fullsized":"2024-03-04T08:50:39.855169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762053+0000","last_change":"2024-03-04T08:50:37.360157+0000","last_active":"2024-03-04T08:50:41.762053+0000","last_peered":"2024-03-04T08:50:41.762053+0000","last_clean":"2024-03-04T08:50:41.762053+0000","last_became_active":"2024-03-04T08:50:37.359874+0000","last_became_peered":"2024-03-04T08:50:37.359874+0000","last_unstale":"2024-03-04T08:50:41.762053+0000","last_undegraded":"2024-03-04T08:50:41.762053+0000","last_fullsized":"2024-03-04T08:50:41.762053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:11.606336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-04T08:50:38.357553+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:38.357553+0000","last_peered":"2024-03-04T08:50:38.357553+0000","last_clean":"2024-03-04T08:50:38.357553+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:38.357553+0000","last_undegraded":"2024-03-04T08:50:38.357553+0000","last_fullsized":"2024-03-04T08:50:38.357553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:49.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358708+0000","last_change":"2024-03-04T08:50:38.351791+0000","last_active":"2024-03-04T08:50:39.358708+0000","last_peered":"2024-03-04T08:50:39.358708+0000","last_clean":"2024-03-04T08:50:39.358708+0000","last_became_active":"2024-03-04T08:50:38.351453+0000","last_became_peered":"2024-03-04T08:50:38.351453+0000","last_unstale":"2024-03-04T08:50:39.358708+0000","last_undegraded":"2024-03-04T08:50:39.358708+0000","last_fullsized":"2024-03-04T08:50:39.358708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359031+0000","last_change":"2024-03-04T08:50:38.358946+0000","last_active":"2024-03-04T08:50:39.359031+0000","last_peered":"2024-03-04T08:50:39.359031+0000","last_clean":"2024-03-04T08:50:39.359031+0000","last_became_active":"2024-03-04T08:50:38.357473+0000","last_became_peered":"2024-03-04T08:50:38.357473+0000","last_unstale":"2024-03-04T08:50:39.359031+0000","last_undegraded":"2024-03-04T08:50:39.359031+0000","last_fullsized":"2024-03-04T08:50:39.359031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762489+0000","last_change":"2024-03-04T08:50:37.354833+0000","last_active":"2024-03-04T08:50:41.762489+0000","last_peered":"2024-03-04T08:50:41.762489+0000","last_clean":"2024-03-04T08:50:41.762489+0000","last_became_active":"2024-03-04T08:50:37.354239+0000","last_became_peered":"2024-03-04T08:50:37.354239+0000","last_unstale":"2024-03-04T08:50:41.762489+0000","last_undegraded":"2024-03-04T08:50:41.762489+0000","last_fullsized":"2024-03-04T08:50:41.762489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346287+0000","last_change":"2024-03-04T08:50:38.361714+0000","last_active":"2024-03-04T08:50:40.346287+0000","last_peered":"2024-03-04T08:50:40.346287+0000","last_clean":"2024-03-04T08:50:40.346287+0000","last_became_active":"2024-03-04T08:50:38.361376+0000","last_became_peered":"2024-03-04T08:50:38.361376+0000","last_unstale":"2024-03-04T08:50:40.346287+0000","last_undegraded":"2024-03-04T08:50:40.346287+0000","last_fullsized":"2024-03-04T08:50:40.346287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361371+0000","last_change":"2024-03-04T08:50:38.365933+0000","last_active":"2024-03-04T08:50:39.361371+0000","last_peered":"2024-03-04T08:50:39.361371+0000","last_clean":"2024-03-04T08:50:39.361371+0000","last_became_active":"2024-03-04T08:50:38.365628+0000","last_became_peered":"2024-03-04T08:50:38.365628+0000","last_unstale":"2024-03-04T08:50:39.361371+0000","last_undegraded":"2024-03-04T08:50:39.361371+0000","last_fullsized":"2024-03-04T08:50:39.361371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762331+0000","last_change":"2024-03-04T08:50:37.359532+0000","last_active":"2024-03-04T08:50:41.762331+0000","last_peered":"2024-03-04T08:50:41.762331+0000","last_clean":"2024-03-04T08:50:41.762331+0000","last_became_active":"2024-03-04T08:50:37.359226+0000","last_became_peered":"2024-03-04T08:50:37.359226+0000","last_unstale":"2024-03-04T08:50:41.762331+0000","last_undegraded":"2024-03-04T08:50:41.762331+0000","last_fullsized":"2024-03-04T08:50:41.762331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361119+0000","last_change":"2024-03-04T08:50:38.365556+0000","last_active":"2024-03-04T08:50:39.361119+0000","last_peered":"2024-03-04T08:50:39.361119+0000","last_clean":"2024-03-04T08:50:39.361119+0000","last_became_active":"2024-03-04T08:50:38.364736+0000","last_became_peered":"2024-03-04T08:50:38.364736+0000","last_unstale":"2024-03-04T08:50:39.361119+0000","last_undegraded":"2024-03-04T08:50:39.361119+0000","last_fullsized":"2024-03-04T08:50:39.361119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762390+0000","last_change":"2024-03-04T08:50:37.362398+0000","last_active":"2024-03-04T08:50:41.762390+0000","last_peered":"2024-03-04T08:50:41.762390+0000","last_clean":"2024-03-04T08:50:41.762390+0000","last_became_active":"2024-03-04T08:50:37.362117+0000","last_became_peered":"2024-03-04T08:50:37.362117+0000","last_unstale":"2024-03-04T08:50:41.762390+0000","last_undegraded":"2024-03-04T08:50:41.762390+0000","last_fullsized":"2024-03-04T08:50:41.762390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:13:00.335926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855227+0000","last_change":"2024-03-04T08:50:38.365989+0000","last_active":"2024-03-04T08:50:39.855227+0000","last_peered":"2024-03-04T08:50:39.855227+0000","last_clean":"2024-03-04T08:50:39.855227+0000","last_became_active":"2024-03-04T08:50:38.365578+0000","last_became_peered":"2024-03-04T08:50:38.365578+0000","last_unstale":"2024-03-04T08:50:39.855227+0000","last_undegraded":"2024-03-04T08:50:39.855227+0000","last_fullsized":"2024-03-04T08:50:39.855227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358915+0000","last_change":"2024-03-04T08:50:37.348349+0000","last_active":"2024-03-04T08:50:39.358915+0000","last_peered":"2024-03-04T08:50:39.358915+0000","last_clean":"2024-03-04T08:50:39.358915+0000","last_became_active":"2024-03-04T08:50:37.348047+0000","last_became_peered":"2024-03-04T08:50:37.348047+0000","last_unstale":"2024-03-04T08:50:39.358915+0000","last_undegraded":"2024-03-04T08:50:39.358915+0000","last_fullsized":"2024-03-04T08:50:39.358915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359023+0000","last_change":"2024-03-04T08:50:38.361937+0000","last_active":"2024-03-04T08:50:39.359023+0000","last_peered":"2024-03-04T08:50:39.359023+0000","last_clean":"2024-03-04T08:50:39.359023+0000","last_became_active":"2024-03-04T08:50:38.360865+0000","last_became_peered":"2024-03-04T08:50:38.360865+0000","last_unstale":"2024-03-04T08:50:39.359023+0000","last_undegraded":"2024-03-04T08:50:39.359023+0000","last_fullsized":"2024-03-04T08:50:39.359023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855261+0000","last_change":"2024-03-04T08:50:37.356168+0000","last_active":"2024-03-04T08:50:39.855261+0000","last_peered":"2024-03-04T08:50:39.855261+0000","last_clean":"2024-03-04T08:50:39.855261+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.855261+0000","last_undegraded":"2024-03-04T08:50:39.855261+0000","last_fullsized":"2024-03-04T08:50:39.855261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:46.059440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":664083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":664139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":66959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T08:50:46.101 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T08:50:46.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-04T08:50:46.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-04T08:50:46.101 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-04T08:50:46.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.242+0000 7f5c0d343640 1 Processor -- start 2024-03-04T08:50:46.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.242+0000 7f5c0d343640 1 -- start start 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c0d343640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c08166af0 0x7f5c08168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c0d343640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0815e380 con 0x7f5c080cf850 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c0d343640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c080cdc10 con 0x7f5c080d00c0 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c0d343640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0806ca90 con 0x7f5c08166af0 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c077fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c08166af0 0x7f5c08168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c067fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5c080cf850 0x7f5c080cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37682/0 (socket says 172.21.15.19:37682) 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c067fc640 1 -- 172.21.15.19:0/3243573273 learned_addr learned my addr 172.21.15.19:0/3243573273 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c077fe640 1 -- 172.21.15.19:0/3243573273 >> v1:172.21.15.204:6789/0 conn(0x7f5c080d00c0 legacy=0x7f5c080d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c077fe640 1 -- 172.21.15.19:0/3243573273 >> v1:172.21.15.19:6789/0 conn(0x7f5c080cf850 legacy=0x7f5c080cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c077fe640 1 -- 172.21.15.19:0/3243573273 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0806c160 con 0x7f5c08166af0 2024-03-04T08:50:46.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.243+0000 7f5c05ffb640 1 -- 172.21.15.19:0/3243573273 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589378006 0 0) 0x7f5c0815e380 con 0x7f5c080cf850 2024-03-04T08:50:46.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.244+0000 7f5c077fe640 1 --2- 172.21.15.19:0/3243573273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c08166af0 0x7f5c08168ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009d90 tx=0x7f5bf802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f065e5d7a2157f84 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.244+0000 7f5c05ffb640 1 -- 172.21.15.19:0/3243573273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8039070 con 0x7f5c08166af0 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.244+0000 7f5c05ffb640 1 -- 172.21.15.19:0/3243573273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf802cd00 con 0x7f5c08166af0 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.244+0000 7f5c05ffb640 1 -- 172.21.15.19:0/3243573273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8034660 con 0x7f5c08166af0 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 -- 172.21.15.19:0/3243573273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c08166af0 msgr2=0x7f5c08168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3243573273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c08166af0 0x7f5c08168ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009d90 tx=0x7f5bf802bf50 comp rx=0 tx=0).stop 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 -- 172.21.15.19:0/3243573273 shutdown_connections 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3243573273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c08166af0 0x7f5c08168ee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 -- 172.21.15.19:0/3243573273 >> 172.21.15.19:0/3243573273 conn(0x7f5c080b35a0 msgr2=0x7f5c080b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 -- 172.21.15.19:0/3243573273 shutdown_connections 2024-03-04T08:50:46.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.245+0000 7f5c0d343640 1 -- 172.21.15.19:0/3243573273 wait complete. 2024-03-04T08:50:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.246+0000 7f5c0d343640 1 Processor -- start 2024-03-04T08:50:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.246+0000 7f5c0d343640 1 -- start start 2024-03-04T08:50:46.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c080cf850 0x7f5c0815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c08166af0 0x7f5c080af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806c720 con 0x7f5c080d00c0 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806df30 con 0x7f5c080cf850 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c0d343640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080b1030 con 0x7f5c08166af0 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46042/0 (socket says 172.21.15.19:46042) 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c06ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c080cf850 0x7f5c0815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 -- 172.21.15.19:0/3643646087 learned_addr learned my addr 172.21.15.19:0/3643646087 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c077fe640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c08166af0 0x7f5c080af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 -- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c08166af0 msgr2=0x7f5c080af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c08166af0 0x7f5c080af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 -- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c080cf850 msgr2=0x7f5c0815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c080cf850 0x7f5c0815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 -- 172.21.15.19:0/3643646087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0815b1f0 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5c067fc640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c420 tx=0x7f5bf000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.247+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00074e0 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.248+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf00047e0 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.248+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0815b4d0 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.248+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004c10 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.248+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c081582d0 con 0x7f5c080d00c0 2024-03-04T08:50:46.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.248+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0804f330 con 0x7f5c080d00c0 2024-03-04T08:50:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.249+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5bf0011070 con 0x7f5c080d00c0 2024-03-04T08:50:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.249+0000 7f5bff7fe640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 0x7f5be806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.249+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0089cc0 con 0x7f5c080d00c0 2024-03-04T08:50:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.250+0000 7f5c06ffd640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 0x7f5be806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.250+0000 7f5c06ffd640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 0x7f5be806d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c00000f60 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.254+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5bf0090080 con 0x7f5c080d00c0 2024-03-04T08:50:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.485+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5c080cbf30 con 0x7f5c080d00c0 2024-03-04T08:50:46.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.488+0000 7f5bff7fe640 1 -- 172.21.15.19:0/3643646087 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171789 (secure 0 0 0) 0x7f5bf0058450 con 0x7f5c080d00c0 2024-03-04T08:50:46.487 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:46.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 msgr2=0x7f5be806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 0x7f5be806d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c00000f60 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2024-03-04T08:50:46.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 msgr2=0x7f5c080cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c420 tx=0x7f5bf000c8e0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 shutdown_connections 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c08166af0 0x7f5c080af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c080d00c0 0x7f5c080cb4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5be806b500 0x7f5be806d9c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 --2- 172.21.15.19:0/3643646087 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c080cf850 0x7f5c0815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 >> 172.21.15.19:0/3643646087 conn(0x7f5c080b35a0 msgr2=0x7f5c080cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 shutdown_connections 2024-03-04T08:50:46.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.490+0000 7f5c0d343640 1 -- 172.21.15.19:0/3643646087 wait complete. 2024-03-04T08:50:46.497 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":588123878},{"type":"v1","addr":"172.21.15.204:6833","nonce":588123878}]},"active_addr":"172.21.15.204:6833/588123878","active_change":"2024-03-04T08:50:25.130184+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1117101678}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":3891638323}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":3012718255}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2881994272}]}]} 2024-03-04T08:50:46.500 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-04T08:50:46.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-04T08:50:46.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 Processor -- start 2024-03-04T08:50:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 -- start start 2024-03-04T08:50:46.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80d0320 0x7f9fc80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fc80d0700 0x7f9fc80b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc815c270 con 0x7f9fc80ccae0 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc80b04e0 con 0x7f9fc80d0700 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.606+0000 7f9fce481640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80d0e90 con 0x7f9fc80d0320 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fc80d0700 0x7f9fc80b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fc80d0700 0x7f9fc80b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46056/0 (socket says 172.21.15.19:46056) 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 -- 172.21.15.19:0/4236181798 learned_addr learned my addr 172.21.15.19:0/4236181798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc7fff640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80d0320 0x7f9fc80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 -- 172.21.15.19:0/4236181798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80d0320 msgr2=0x7f9fc80b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80d0320 0x7f9fc80b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 -- 172.21.15.19:0/4236181798 >> v1:172.21.15.204:6789/0 conn(0x7f9fc80ccae0 legacy=0x7f9fc80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.607+0000 7f9fc77fe640 1 -- 172.21.15.19:0/4236181798 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80b5ae0 con 0x7f9fc80d0700 2024-03-04T08:50:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fc77fe640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc80b54b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009870 tx=0x7f9fbc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578701cb62f4500 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fc6ffd640 1 -- 172.21.15.19:0/4236181798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc034070 con 0x7f9fc80d0700 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fc6ffd640 1 -- 172.21.15.19:0/4236181798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc030840 con 0x7f9fc80d0700 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fc6ffd640 1 -- 172.21.15.19:0/4236181798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc030c10 con 0x7f9fc80d0700 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 -- 172.21.15.19:0/4236181798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 msgr2=0x7f9fc80b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc80b54b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009870 tx=0x7f9fbc02b980 comp rx=0 tx=0).stop 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 -- 172.21.15.19:0/4236181798 shutdown_connections 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc80b54b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 --2- 172.21.15.19:0/4236181798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80d0320 0x7f9fc80b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 -- 172.21.15.19:0/4236181798 >> 172.21.15.19:0/4236181798 conn(0x7f9fc80724d0 msgr2=0x7f9fc80728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 -- 172.21.15.19:0/4236181798 shutdown_connections 2024-03-04T08:50:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.608+0000 7f9fce481640 1 -- 172.21.15.19:0/4236181798 wait complete. 2024-03-04T08:50:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.609+0000 7f9fce481640 1 Processor -- start 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 -- start start 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80ccae0 0x7f9fc80c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc80d0320 0x7f9fc80c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80b60a0 con 0x7f9fc80d0700 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80b0170 con 0x7f9fc80d0320 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fce481640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80ca790 con 0x7f9fc80ccae0 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fcca1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fcca1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46064/0 (socket says 172.21.15.19:46064) 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fcca1e640 1 -- 172.21.15.19:0/2812521942 learned_addr learned my addr 172.21.15.19:0/2812521942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fc7fff640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80ccae0 0x7f9fc80c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.610+0000 7f9fc77fe640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc80d0320 0x7f9fc80c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 -- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80ccae0 msgr2=0x7f9fc80c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80ccae0 0x7f9fc80c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 -- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc80d0320 msgr2=0x7f9fc80c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc80d0320 0x7f9fc80c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 -- 172.21.15.19:0/2812521942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8159510 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fcca1e640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c7d0 tx=0x7f9fc000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003b70 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0003d30 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc81f4a00 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000aa30 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.611+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc81f77d0 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.612+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc804f330 con 0x7f9fc80d0700 2024-03-04T08:50:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.612+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9fc000abd0 con 0x7f9fc80d0700 2024-03-04T08:50:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.613+0000 7f9fc4ff9640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 0x7f9fb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.613+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fc0089f60 con 0x7f9fc80d0700 2024-03-04T08:50:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.613+0000 7f9fc7fff640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 0x7f9fb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.614+0000 7f9fc7fff640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 0x7f9fb406d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009b40 tx=0x7f9fb8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.618+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9fc0058790 con 0x7f9fc80d0700 2024-03-04T08:50:46.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.799+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fc8067040 con 0x7f9fc80d0700 2024-03-04T08:50:46.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.800+0000 7f9fc4ff9640 1 -- 172.21.15.19:0/2812521942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f9fc005c830 con 0x7f9fc80d0700 2024-03-04T08:50:46.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:46.797 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 msgr2=0x7f9fb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 0x7f9fb406d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009b40 tx=0x7f9fb8009190 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 msgr2=0x7f9fc81f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c7d0 tx=0x7f9fc000cc90 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 shutdown_connections 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fc80d0700 0x7f9fc81f3d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9fb406b4d0 0x7f9fb406d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9fc80d0320 0x7f9fc80c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 --2- 172.21.15.19:0/2812521942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9fc80ccae0 0x7f9fc80c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 >> 172.21.15.19:0/2812521942 conn(0x7f9fc80724d0 msgr2=0x7f9fc806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 shutdown_connections 2024-03-04T08:50:46.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.802+0000 7f9fce481640 1 -- 172.21.15.19:0/2812521942 wait complete. 2024-03-04T08:50:46.809 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-04T08:50:46.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.914+0000 7f9ef396b640 1 Processor -- start 2024-03-04T08:50:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.914+0000 7f9ef396b640 1 -- start start 2024-03-04T08:50:46.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef396b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9eec0b3060 0x7f9eec15e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef396b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9eec15bf30 0x7f9eec15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef396b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec15f2d0 con 0x7f9eec13dc10 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef396b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0cf3f0 con 0x7f9eec0b3060 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef396b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec15b210 con 0x7f9eec15bf30 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9eec0b3060 0x7f9eec15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9eec0b3060 0x7f9eec15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46068/0 (socket says 172.21.15.19:46068) 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 -- 172.21.15.19:0/743721484 learned_addr learned my addr 172.21.15.19:0/743721484 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef1f08640 1 --2- 172.21.15.19:0/743721484 >> v2:172.21.15.204:3300/0 conn(0x7f9eec15bf30 0x7f9eec15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 -- 172.21.15.19:0/743721484 >> v2:172.21.15.204:3300/0 conn(0x7f9eec15bf30 msgr2=0x7f9eec15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/743721484 >> v2:172.21.15.204:3300/0 conn(0x7f9eec15bf30 0x7f9eec15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 -- 172.21.15.19:0/743721484 >> v1:172.21.15.204:6789/0 conn(0x7f9eec13dc10 legacy=0x7f9eec0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.915+0000 7f9ef0f06640 1 -- 172.21.15.19:0/743721484 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec15f580 con 0x7f9eec0b3060 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.916+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/743721484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec15e850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b4e00 tx=0x7f9edc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea040851b5ace69 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.916+0000 7f9ee3fff640 1 -- 172.21.15.19:0/743721484 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc035020 con 0x7f9eec0b3060 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.916+0000 7f9ee3fff640 1 -- 172.21.15.19:0/743721484 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc031870 con 0x7f9eec0b3060 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.916+0000 7f9ee3fff640 1 -- 172.21.15.19:0/743721484 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc031c40 con 0x7f9eec0b3060 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 -- 172.21.15.19:0/743721484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 msgr2=0x7f9eec15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 --2- 172.21.15.19:0/743721484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec15e850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b4e00 tx=0x7f9edc02b910 comp rx=0 tx=0).stop 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 -- 172.21.15.19:0/743721484 shutdown_connections 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 --2- 172.21.15.19:0/743721484 >> v2:172.21.15.204:3300/0 conn(0x7f9eec15bf30 0x7f9eec15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 --2- 172.21.15.19:0/743721484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec15e850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 -- 172.21.15.19:0/743721484 >> 172.21.15.19:0/743721484 conn(0x7f9eec0cf8a0 msgr2=0x7f9eec0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 -- 172.21.15.19:0/743721484 shutdown_connections 2024-03-04T08:50:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.917+0000 7f9ef396b640 1 -- 172.21.15.19:0/743721484 wait complete. 2024-03-04T08:50:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.918+0000 7f9ef396b640 1 Processor -- start 2024-03-04T08:50:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.918+0000 7f9ef396b640 1 -- start start 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 0x7f9eec13c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 0x7f9eec0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec13dff0 con 0x7f9eec0b3060 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec15b730 con 0x7f9eec15bf30 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0708d0 con 0x7f9eec13dc10 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46074/0 (socket says 172.21.15.19:46074) 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 -- 172.21.15.19:0/2211860074 learned_addr learned my addr 172.21.15.19:0/2211860074 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 0x7f9eec13c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1f08640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 0x7f9eec0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 -- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 msgr2=0x7f9eec13c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 0x7f9eec13c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 -- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 msgr2=0x7f9eec0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 0x7f9eec0b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 -- 172.21.15.19:0/2211860074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec13d310 con 0x7f9eec0b3060 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 0x7f9eec13c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1f08640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 0x7f9eec0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef1707640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c400 tx=0x7f9ee800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80052d0 con 0x7f9eec0b3060 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee8005490 con 0x7f9eec0b3060 2024-03-04T08:50:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec1e46b0 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.919+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8007260 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.920+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1e4c70 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.920+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec04f330 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.921+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ee8007400 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.921+0000 7f9ee1ffb640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 0x7f9ed006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.921+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee8089610 con 0x7f9eec0b3060 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.921+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 0x7f9ed006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.922+0000 7f9ef0f06640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 0x7f9ed006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036000 tx=0x7f9edc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:46.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:46.926+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9eec13d310 con 0x7f9eec0b3060 2024-03-04T08:50:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.108+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9eec06eb00 con 0x7f9eec0b3060 2024-03-04T08:50:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.109+0000 7f9ee1ffb640 1 -- 172.21.15.19:0/2211860074 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f9ee8057ed0 con 0x7f9eec0b3060 2024-03-04T08:50:47.105 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:47.106 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 msgr2=0x7f9ed006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 0x7f9ed006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036000 tx=0x7f9edc03c040 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 msgr2=0x7f9eec1f1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c400 tx=0x7f9ee800c8c0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 shutdown_connections 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9ed006b4d0 0x7f9ed006d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9eec15bf30 0x7f9eec0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9eec13dc10 0x7f9eec13c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 --2- 172.21.15.19:0/2211860074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eec0b3060 0x7f9eec1f1a20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 >> 172.21.15.19:0/2211860074 conn(0x7f9eec0cf8a0 msgr2=0x7f9eec0cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 shutdown_connections 2024-03-04T08:50:47.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.111+0000 7f9ef396b640 1 -- 172.21.15.19:0/2211860074 wait complete. 2024-03-04T08:50:47.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-04T08:50:47.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-04T08:50:47.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-04T08:50:47.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-04T08:50:47.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-04T08:50:47.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-04T08:50:47.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-04T08:50:47.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-04T08:50:47.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.298+0000 7f7c07d43640 1 Processor -- start 2024-03-04T08:50:47.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.298+0000 7ff1c0abe640 1 Processor -- start 2024-03-04T08:50:47.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.298+0000 7ff1c0abe640 1 -- start start 2024-03-04T08:50:47.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.298+0000 7f7c07d43640 1 -- start start 2024-03-04T08:50:47.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7facdf59e640 1 Processor -- start 2024-03-04T08:50:47.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7facdf59e640 1 -- start start 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f54be14c640 1 Processor -- start 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f54be14c640 1 -- start start 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f7c07d43640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c00162970 0x7f7c000d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f7c07d43640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7c00161cf0 0x7f7c00162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f7c07d43640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000d22c0 con 0x7f7c000b4460 2024-03-04T08:50:47.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f7c07d43640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c00161b00 con 0x7f7c00162970 2024-03-04T08:50:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7f7c07d43640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000cecc0 con 0x7f7c00161cf0 2024-03-04T08:50:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7fad7d202640 1 Processor -- start 2024-03-04T08:50:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7ff1c0abe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff1b404f290 0x7ff1b4007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7ff1c0abe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1b4033990 0x7ff1b40543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7ff1c0abe640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b40069d0 con 0x7ff1b4037c40 2024-03-04T08:50:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7fad7d202640 1 -- start start 2024-03-04T08:50:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7facdf59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7facd80e6930 0x7facd8056380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7fd8a359e640 1 Processor -- start 2024-03-04T08:50:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7fd8a359e640 1 -- start start 2024-03-04T08:50:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7f7c05adf640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f7c000b4460 0x7f7c000b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:53714/0 (socket says 172.21.15.19:53714) 2024-03-04T08:50:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7f7c05adf640 1 -- 172.21.15.19:0/503545305 learned_addr learned my addr 172.21.15.19:0/503545305 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54be14c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54b80d2180 0x7f54b80d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54be14c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80b0870 con 0x7f54b815e150 2024-03-04T08:50:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54be14c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80cf170 con 0x7f54b80b1000 2024-03-04T08:50:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54be14c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80d2b20 con 0x7f54b80d2180 2024-03-04T08:50:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c052de640 1 --2- 172.21.15.19:0/503545305 >> v2:172.21.15.19:3300/0 conn(0x7f7c00162970 0x7f7c000d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7facdf59e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd8006b50 con 0x7facd80e6d10 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7facdf59e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd8006e30 con 0x7facd80552e0 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7facded9d640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7facd80552e0 0x7facd8007910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:53718/0 (socket says 172.21.15.19:53718) 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f3968b67640 1 Processor -- start 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f3968b67640 1 -- start start 2024-03-04T08:50:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54bd14a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f54b815e150 0x7f54b80d42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37692/0 (socket says 172.21.15.19:37692) 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f54bd14a640 1 -- 172.21.15.19:0/532592439 learned_addr learned my addr 172.21.15.19:0/532592439 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fd8a359e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd89c006220 0x7fd89c006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fd8a359e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c050150 con 0x7fd89c055d10 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fd8a359e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c006c30 con 0x7fd89c0df800 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fd8a359e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c006f10 con 0x7fd89c006220 2024-03-04T08:50:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c062e0640 1 --2- 172.21.15.19:0/503545305 >> v2:172.21.15.204:3300/0 conn(0x7f7c00161cf0 0x7f7c00162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c062e0640 1 -- 172.21.15.19:0/503545305 >> v2:172.21.15.19:3300/0 conn(0x7f7c00162970 msgr2=0x7f7c000d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7d202640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fad70007da0 0x7fad70056890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7d202640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7d202640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad70036df0 con 0x7fad700e3550 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7d202640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad70053250 con 0x7fad70007da0 2024-03-04T08:50:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7d202640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad70037630 con 0x7fad700093a0 2024-03-04T08:50:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a2d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd89c006220 0x7fd89c006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a1d9b640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fd89c0df800 0x7fd89c04fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:53738/0 (socket says 172.21.15.19:53738) 2024-03-04T08:50:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a1d9b640 1 -- 172.21.15.19:0/4074842547 learned_addr learned my addr 172.21.15.19:0/4074842547 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7fad7ca01640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:39194/0 (socket says 172.21.15.19:39194) 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 -- 172.21.15.19:0/1712264114 learned_addr learned my addr 172.21.15.19:0/1712264114 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7659c640 1 --2- 172.21.15.19:0/1712264114 >> v2:172.21.15.204:3300/0 conn(0x7fad70007da0 0x7fad70056890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a159a640 1 -- 172.21.15.19:0/4074842547 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250615625 0 0) 0x7fd89c006c30 con 0x7fd89c0df800 2024-03-04T08:50:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a159a640 1 -- 172.21.15.19:0/4074842547 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd88c003520 con 0x7fd89c0df800 2024-03-04T08:50:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7facded9d640 1 -- 172.21.15.19:0/582309942 learned_addr learned my addr 172.21.15.19:0/582309942 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd8007110 con 0x7facd80e6930 2024-03-04T08:50:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7facde59c640 1 --2- 172.21.15.19:0/582309942 >> v2:172.21.15.19:3300/0 conn(0x7facd80e6930 0x7facd8056380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629061545 0 0) 0x7f54b80b0870 con 0x7f54b815e150 2024-03-04T08:50:47.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a2d9d640 1 -- 172.21.15.19:0/4074842547 >> v1:172.21.15.204:6789/0 conn(0x7fd89c0df800 legacy=0x7fd89c04fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a2d9d640 1 -- 172.21.15.19:0/4074842547 >> v1:172.21.15.19:6789/0 conn(0x7fd89c055d10 legacy=0x7fd89c0366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a4003520 con 0x7f54b815e150 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7ff1c0abe640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b4053e00 con 0x7ff1b4033990 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.299+0000 7ff1c0abe640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40540e0 con 0x7ff1b404f290 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff1b404f290 0x7ff1b4007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff1b404f290 0x7ff1b4007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57134/0 (socket says 172.21.15.19:57134) 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 -- 172.21.15.19:0/248482477 learned_addr learned my addr 172.21.15.19:0/248482477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1baffd640 1 --2- 172.21.15.19:0/248482477 >> v2:172.21.15.19:3300/0 conn(0x7ff1b4033990 0x7ff1b40543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765458640 0 0) 0x7f54b80cf170 con 0x7f54b80b1000 2024-03-04T08:50:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 -- 172.21.15.19:0/248482477 >> v2:172.21.15.19:3300/0 conn(0x7ff1b4033990 msgr2=0x7ff1b40543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 --2- 172.21.15.19:0/248482477 >> v2:172.21.15.19:3300/0 conn(0x7ff1b4033990 0x7ff1b40543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b80b0870 con 0x7f54b80b1000 2024-03-04T08:50:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 -- 172.21.15.19:0/248482477 >> v1:172.21.15.204:6789/0 conn(0x7ff1b4037c40 legacy=0x7ff1b4038070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:50:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.300+0000 7ff1bb7fe640 1 -- 172.21.15.19:0/248482477 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4006c70 con 0x7ff1b404f290 2024-03-04T08:50:47.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fd8a2d9d640 1 -- 172.21.15.19:0/4074842547 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0071f0 con 0x7fd89c006220 2024-03-04T08:50:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c062e0640 1 --2- 172.21.15.19:0/503545305 >> v2:172.21.15.19:3300/0 conn(0x7f7c00162970 0x7f7c000d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c062e0640 1 -- 172.21.15.19:0/503545305 >> v1:172.21.15.204:6789/0 conn(0x7f7c000b4460 legacy=0x7f7c000b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.301+0000 7f7c062e0640 1 -- 172.21.15.19:0/503545305 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000d25a0 con 0x7f7c00161cf0 2024-03-04T08:50:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600935688 0 0) 0x7facd8006e30 con 0x7facd80552e0 2024-03-04T08:50:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8003520 con 0x7facd80552e0 2024-03-04T08:50:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> v2:172.21.15.19:3300/0 conn(0x7f54b80d2180 0x7f54b80d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3968b67640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f396415ab90 0x7f39640b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943586062 0 0) 0x7f54b80b0870 con 0x7f54b80b1000 2024-03-04T08:50:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 >> v2:172.21.15.19:3300/0 conn(0x7f54b80d2180 msgr2=0x7f54b80d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 --2- 172.21.15.19:0/532592439 >> v2:172.21.15.19:3300/0 conn(0x7f54b80d2180 0x7f54b80d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7ff1bb7fe640 1 --2- 172.21.15.19:0/248482477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b404f290 0x7ff1b4007190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b000 tx=0x7ff1b0034120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4270ca42ec1bc978 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 >> v1:172.21.15.19:6789/0 conn(0x7f54b815e150 legacy=0x7f54b80d42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801947944 0 0) 0x7facc8003520 con 0x7facd80552e0 2024-03-04T08:50:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 >> v2:172.21.15.19:3300/0 conn(0x7facd80e6930 msgr2=0x7facd8056380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80cf410 con 0x7f54b80b1000 2024-03-04T08:50:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 --2- 172.21.15.19:0/582309942 >> v2:172.21.15.19:3300/0 conn(0x7facd80e6930 0x7facd8056380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 >> v1:172.21.15.19:6789/0 conn(0x7facd80e6d10 legacy=0x7facd8054bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f566513a640 1 Processor -- start 2024-03-04T08:50:47.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7ff1ba7fc640 1 -- 172.21.15.19:0/248482477 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00110d0 con 0x7ff1b404f290 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7ff1ba7fc640 1 -- 172.21.15.19:0/248482477 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b0011270 con 0x7ff1b404f290 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7ff1ba7fc640 1 -- 172.21.15.19:0/248482477 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0011640 con 0x7ff1b404f290 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3968b67640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3964071e20 0x7f396406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f396415ab90 0x7f39640b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f396415ab90 0x7f39640b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57160/0 (socket says 172.21.15.19:57160) 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 -- 172.21.15.19:0/1927085670 learned_addr learned my addr 172.21.15.19:0/1927085670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f39637fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f39640b2020 0x7f396415a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37716/0 (socket says 172.21.15.19:37716) 2024-03-04T08:50:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f7c062e0640 1 --2- 172.21.15.19:0/503545305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c00162180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c0008c900 tx=0x7f7bf802bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd21cdcb98282a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3963fff640 1 --2- 172.21.15.19:0/1927085670 >> v2:172.21.15.19:3300/0 conn(0x7f3964071e20 0x7f396406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80073f0 con 0x7facd80552e0 2024-03-04T08:50:47.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3964072270 con 0x7f39640b2020 2024-03-04T08:50:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396415b1d0 con 0x7f3964071e20 2024-03-04T08:50:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640b3970 con 0x7f396415ab90 2024-03-04T08:50:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7face004f850 con 0x7facd80552e0 2024-03-04T08:50:47.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> v2:172.21.15.19:3300/0 conn(0x7f54b80d2180 0x7f54b80d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f54b0001a10 con 0x7f54b80b1000 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 >> v1:172.21.15.204:6789/0 conn(0x7f54b80b1000 legacy=0x7f54b80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54a4004c10 0x7f54a4004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 0x7f54a4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a4004230 0x7f54a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a400c1b0 con 0x7f54a4004230 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 -- 172.21.15.19:0/1712264114 >> v2:172.21.15.204:3300/0 conn(0x7fad70007da0 msgr2=0x7fad70056890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 --2- 172.21.15.19:0/1712264114 >> v2:172.21.15.204:3300/0 conn(0x7fad70007da0 0x7fad70056890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 -- 172.21.15.19:0/1712264114 >> v1:172.21.15.19:6789/0 conn(0x7fad700e3550 legacy=0x7fad70008c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.302+0000 7fad7ca01640 1 -- 172.21.15.19:0/1712264114 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700086f0 con 0x7fad700093a0 2024-03-04T08:50:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a400c360 con 0x7f54a4004c10 2024-03-04T08:50:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a400c560 con 0x7f54a40037a0 2024-03-04T08:50:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f7c04add640 1 -- 172.21.15.19:0/503545305 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8039070 con 0x7f7c00161cf0 2024-03-04T08:50:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f7c04add640 1 -- 172.21.15.19:0/503545305 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf802ca50 con 0x7f7c00161cf0 2024-03-04T08:50:47.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f7c04add640 1 -- 172.21.15.19:0/503545305 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf802ce60 con 0x7f7c00161cf0 2024-03-04T08:50:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 >> v1:172.21.15.204:6789/0 conn(0x7facd80552e0 legacy=0x7facd8007910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54bd14a640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54a4004c10 0x7f54a4004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7facdd59a640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc80039b0 0x7facc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 0x7f54a4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7fad7ca01640 1 --2- 172.21.15.19:0/1712264114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad7807aee0 tx=0x7fad780a6b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ea8f64932e37a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facdd59a640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004310 0x7facc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facdd59a640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 0x7facc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd8007110 con 0x7facc80039b0 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc800bf00 con 0x7facc8004f40 2024-03-04T08:50:47.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc800c080 con 0x7facc8004310 2024-03-04T08:50:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bd94b640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a4004230 0x7f54a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facde59c640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc80039b0 0x7facc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 0x7facc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facddd9b640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004310 0x7facc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bc949640 1 -- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54a4004c10 msgr2=0x7f54a4004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54a4004c10 0x7f54a4004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 -- 172.21.15.19:0/248482477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b404f290 msgr2=0x7ff1b4007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 --2- 172.21.15.19:0/248482477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b404f290 0x7ff1b4007190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b000 tx=0x7ff1b0034120 comp rx=0 tx=0).stop 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bc949640 1 -- 172.21.15.19:0/532592439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a4004230 msgr2=0x7f54a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a4004230 0x7f54a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 -- 172.21.15.19:0/1927085670 >> v2:172.21.15.19:3300/0 conn(0x7f3964071e20 msgr2=0x7f396406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 --2- 172.21.15.19:0/1927085670 >> v2:172.21.15.19:3300/0 conn(0x7f3964071e20 0x7f396406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 -- 172.21.15.19:0/1927085670 >> v1:172.21.15.19:6789/0 conn(0x7f39640b2020 legacy=0x7f396415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f3962ffd640 1 -- 172.21.15.19:0/1927085670 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640b3c50 con 0x7f396415ab90 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bc949640 1 -- 172.21.15.19:0/532592439 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80b0870 con 0x7f54a40037a0 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f54bd94b640 1 -- 172.21.15.19:0/532592439 reap_dead start 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 -- 172.21.15.19:0/248482477 shutdown_connections 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 --2- 172.21.15.19:0/248482477 >> v2:172.21.15.19:3300/0 conn(0x7ff1b4033990 0x7ff1b40543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 --2- 172.21.15.19:0/248482477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b404f290 0x7ff1b4007190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 -- 172.21.15.19:0/248482477 >> 172.21.15.19:0/248482477 conn(0x7ff1b4009fb0 msgr2=0x7ff1b400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 -- 172.21.15.19:0/248482477 shutdown_connections 2024-03-04T08:50:47.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7ff1c0abe640 1 -- 172.21.15.19:0/248482477 wait complete. 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 -- 172.21.15.19:0/503545305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 msgr2=0x7f7c00162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 --2- 172.21.15.19:0/503545305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c00162180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c0008c900 tx=0x7f7bf802bd20 comp rx=0 tx=0).stop 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 -- 172.21.15.19:0/503545305 shutdown_connections 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 --2- 172.21.15.19:0/503545305 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c00162180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 --2- 172.21.15.19:0/503545305 >> v2:172.21.15.19:3300/0 conn(0x7f7c00162970 0x7f7c000d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7f7c07d43640 1 -- 172.21.15.19:0/503545305 >> 172.21.15.19:0/503545305 conn(0x7f7c000d3ce0 msgr2=0x7f7c000d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 -- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004310 msgr2=0x7facc8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004310 0x7facc8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 -- 172.21.15.19:0/582309942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc80039b0 msgr2=0x7facc8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facc80039b0 0x7facc8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.304+0000 7facded9d640 1 -- 172.21.15.19:0/582309942 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8003520 con 0x7facc8004f40 2024-03-04T08:50:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7fd8a2d9d640 1 --2- 172.21.15.19:0/4074842547 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c006220 0x7fd89c006630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8940097a0 tx=0x7fd89402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806c7a20a1dc3e2b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.303+0000 7f566513a640 1 -- start start 2024-03-04T08:50:47.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f3962ffd640 1 --2- 172.21.15.19:0/1927085670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f396415ab90 0x7f39640b4730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39640b3120 tx=0x7f395802b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee1ff75530ec2dc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f566513a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 0x7f56600d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f566513a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5660161cf0 0x7f5660162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f39627fc640 1 -- 172.21.15.19:0/1927085670 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958038070 con 0x7f396415ab90 2024-03-04T08:50:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f39627fc640 1 -- 172.21.15.19:0/1927085670 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395802f050 con 0x7f396415ab90 2024-03-04T08:50:47.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f39627fc640 1 -- 172.21.15.19:0/1927085670 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958031970 con 0x7f396415ab90 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565ed9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 0x7f56600d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565ed9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 0x7f56600d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57180/0 (socket says 172.21.15.19:57180) 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565ed9d640 1 -- 172.21.15.19:0/2477628412 learned_addr learned my addr 172.21.15.19:0/2477628412 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600d22c0 con 0x7f5660162970 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5660161b00 con 0x7f5660161cf0 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600cecc0 con 0x7f56600b4460 2024-03-04T08:50:47.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565f59e640 1 --2- 172.21.15.19:0/2477628412 >> v2:172.21.15.19:3300/0 conn(0x7f5660161cf0 0x7f5660162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7facded9d640 1 -- 172.21.15.19:0/582309942 reap_dead start 2024-03-04T08:50:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7fad75d9b640 1 -- 172.21.15.19:0/1712264114 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780a8990 con 0x7fad700093a0 2024-03-04T08:50:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7fad75d9b640 1 -- 172.21.15.19:0/1712264114 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780a8b30 con 0x7fad700093a0 2024-03-04T08:50:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7fad75d9b640 1 -- 172.21.15.19:0/1712264114 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780b0420 con 0x7fad700093a0 2024-03-04T08:50:47.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f7c07d43640 1 -- 172.21.15.19:0/503545305 shutdown_connections 2024-03-04T08:50:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565f59e640 1 -- 172.21.15.19:0/2477628412 >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 msgr2=0x7f56600d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565f59e640 1 --2- 172.21.15.19:0/2477628412 >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 0x7f56600d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565f59e640 1 -- 172.21.15.19:0/2477628412 >> v1:172.21.15.19:6789/0 conn(0x7f5660162970 legacy=0x7f56600b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f565f59e640 1 -- 172.21.15.19:0/2477628412 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600d25a0 con 0x7f5660161cf0 2024-03-04T08:50:47.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7f54bc949640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 0x7f54a4003c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54b40098a0 tx=0x7f54a4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65de3a3faa0d0597 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.305+0000 7facded9d640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 0x7facc800b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7face00500e0 tx=0x7facc8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678f072b2004c5e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f7c07d43640 1 -- 172.21.15.19:0/503545305 wait complete. 2024-03-04T08:50:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00b3070 con 0x7facc8004f40 2024-03-04T08:50:47.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face00ae620 con 0x7facc8004f40 2024-03-04T08:50:47.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fd8a159a640 1 -- 172.21.15.19:0/4074842547 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894034070 con 0x7fd89c006220 2024-03-04T08:50:47.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7facdd59a640 1 -- 172.21.15.19:0/582309942 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0069fc0 con 0x7facc8004f40 2024-03-04T08:50:47.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400f040 con 0x7f54a40037a0 2024-03-04T08:50:47.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4004230 con 0x7f54a40037a0 2024-03-04T08:50:47.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fd8a159a640 1 -- 172.21.15.19:0/4074842547 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894030610 con 0x7fd89c006220 2024-03-04T08:50:47.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f54affff640 1 -- 172.21.15.19:0/532592439 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003610 con 0x7f54a40037a0 2024-03-04T08:50:47.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fd8a159a640 1 -- 172.21.15.19:0/4074842547 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940309e0 con 0x7fd89c006220 2024-03-04T08:50:47.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f396415ab90 msgr2=0x7f39640b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 --2- 172.21.15.19:0/1927085670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f396415ab90 0x7f39640b4730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39640b3120 tx=0x7f395802b7f0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 -- 172.21.15.19:0/1712264114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 msgr2=0x7fad70053a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 --2- 172.21.15.19:0/1712264114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad7807aee0 tx=0x7fad780a6b10 comp rx=0 tx=0).stop 2024-03-04T08:50:47.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 shutdown_connections 2024-03-04T08:50:47.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 --2- 172.21.15.19:0/1927085670 >> v2:172.21.15.19:3300/0 conn(0x7f3964071e20 0x7f396406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 --2- 172.21.15.19:0/1927085670 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f396415ab90 0x7f39640b4730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 >> 172.21.15.19:0/1927085670 conn(0x7f39640b1500 msgr2=0x7f39640b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 shutdown_connections 2024-03-04T08:50:47.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f565f59e640 1 --2- 172.21.15.19:0/2477628412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660161cf0 0x7f5660162180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f566008ddd0 tx=0x7f565402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20728e567ff40d16 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 -- 172.21.15.19:0/1712264114 shutdown_connections 2024-03-04T08:50:47.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 --2- 172.21.15.19:0/1712264114 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad70053a20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 --2- 172.21.15.19:0/1712264114 >> v2:172.21.15.204:3300/0 conn(0x7fad70007da0 0x7fad70056890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7fad7d202640 1 -- 172.21.15.19:0/1712264114 >> 172.21.15.19:0/1712264114 conn(0x7fad7001f120 msgr2=0x7fad70055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 -- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 msgr2=0x7f54a4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 0x7f54a4003c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54b40098a0 tx=0x7f54a4005830 comp rx=0 tx=0).stop 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 -- 172.21.15.19:0/532592439 shutdown_connections 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 --2- 172.21.15.19:0/532592439 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54a40037a0 0x7f54a4003c20 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54b40098a0 tx=0x7f54a4005830 comp rx=0 tx=0).stop 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 -- 172.21.15.19:0/532592439 >> 172.21.15.19:0/532592439 conn(0x7f54b809cee0 msgr2=0x7f54b80d3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 msgr2=0x7facc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f565dd9b640 1 -- 172.21.15.19:0/2477628412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540315a0 con 0x7f5660161cf0 2024-03-04T08:50:47.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f565dd9b640 1 -- 172.21.15.19:0/2477628412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654037070 con 0x7f5660161cf0 2024-03-04T08:50:47.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7facdf59e640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 0x7facc800b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7face00500e0 tx=0x7facc8005830 comp rx=0 tx=0).stop 2024-03-04T08:50:47.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f565dd9b640 1 -- 172.21.15.19:0/2477628412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654031960 con 0x7f5660161cf0 2024-03-04T08:50:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 -- 172.21.15.19:0/532592439 shutdown_connections 2024-03-04T08:50:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 shutdown_connections 2024-03-04T08:50:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7facdf59e640 1 --2- 172.21.15.19:0/582309942 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facc8004f40 0x7facc800b9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 >> 172.21.15.19:0/582309942 conn(0x7facd801ef40 msgr2=0x7facd8055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7f54be14c640 1 -- 172.21.15.19:0/532592439 wait complete. 2024-03-04T08:50:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7fd8a359e640 1 -- 172.21.15.19:0/4074842547 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c006220 msgr2=0x7fd89c006630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7fd8a359e640 1 --2- 172.21.15.19:0/4074842547 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c006220 0x7fd89c006630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8940097a0 tx=0x7fd89402b960 comp rx=0 tx=0).stop 2024-03-04T08:50:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7fd8a359e640 1 -- 172.21.15.19:0/4074842547 shutdown_connections 2024-03-04T08:50:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7fd8a359e640 1 --2- 172.21.15.19:0/4074842547 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c006220 0x7fd89c006630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7fd8a359e640 1 -- 172.21.15.19:0/4074842547 >> 172.21.15.19:0/4074842547 conn(0x7fd89c01e6c0 msgr2=0x7fd89c0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f7c07d43640 1 Processor -- start 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7ff1c0abe640 1 Processor -- start 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.306+0000 7ff1c0abe640 1 -- start start 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.307+0000 7ff1c0abe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 0x7ff1b4196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1c0abe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 0x7ff1b4199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1c0abe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 0x7ff1b40ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 0x7ff1b4199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 0x7ff1b4199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:39214/0 (socket says 172.21.15.19:39214) 2024-03-04T08:50:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7fad7d202640 1 -- 172.21.15.19:0/1712264114 shutdown_connections 2024-03-04T08:50:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7fad7d202640 1 -- 172.21.15.19:0/1712264114 wait complete. 2024-03-04T08:50:47.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660161cf0 msgr2=0x7f5660162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 --2- 172.21.15.19:0/2477628412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660161cf0 0x7f5660162180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f566008ddd0 tx=0x7f565402b840 comp rx=0 tx=0).stop 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 shutdown_connections 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 --2- 172.21.15.19:0/2477628412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660161cf0 0x7f5660162180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 --2- 172.21.15.19:0/2477628412 >> v2:172.21.15.204:3300/0 conn(0x7f56600b4460 0x7f56600d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 0x7ff1b40ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 0x7ff1b40ff3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46170/0 (socket says 172.21.15.19:46170) 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 0x7ff1b4196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 0x7ff1b4196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57188/0 (socket says 172.21.15.19:57188) 2024-03-04T08:50:47.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 >> 172.21.15.19:0/2477628412 conn(0x7f56600d3ce0 msgr2=0x7f56600d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 shutdown_connections 2024-03-04T08:50:47.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7facdf59e640 1 -- 172.21.15.19:0/582309942 wait complete. 2024-03-04T08:50:47.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7fd8a359e640 1 -- 172.21.15.19:0/4074842547 shutdown_connections 2024-03-04T08:50:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7fd8a359e640 1 -- 172.21.15.19:0/4074842547 wait complete. 2024-03-04T08:50:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 -- 172.21.15.19:0/2824753448 learned_addr learned my addr 172.21.15.19:0/2824753448 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b404f670 con 0x7ff1b404f290 2024-03-04T08:50:47.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7f3968b67640 1 -- 172.21.15.19:0/1927085670 wait complete. 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40076d0 con 0x7ff1b4033990 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b404f7f0 con 0x7ff1b4037c40 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 -- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 msgr2=0x7ff1b4196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 0x7ff1b4196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.308+0000 7ff1baffd640 1 -- 172.21.15.19:0/2824753448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 msgr2=0x7ff1b40ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f7c07d43640 1 -- start start 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f54be14c640 1 Processor -- start 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1baffd640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 0x7ff1b40ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1baffd640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b402b510 con 0x7ff1b4037c40 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1bbfff640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1b404f290 0x7ff1b40ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1bb7fe640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff1b4033990 0x7ff1b4196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1baffd640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 0x7ff1b4199c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800e870 tx=0x7ff1a800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 shutdown_connections 2024-03-04T08:50:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f3968b67640 1 Processor -- start 2024-03-04T08:50:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7fad7d202640 1 Processor -- start 2024-03-04T08:50:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7fad7d202640 1 -- start start 2024-03-04T08:50:47.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f3968b67640 1 -- start start 2024-03-04T08:50:47.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7fd8a359e640 1 Processor -- start 2024-03-04T08:50:47.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7fd8a359e640 1 -- start start 2024-03-04T08:50:47.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 0x7f7c00159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c000c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00162970 0x7f7c0015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f54be14c640 1 -- start start 2024-03-04T08:50:47.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f54be14c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54b81f9110 0x7f54b806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000ce950 con 0x7f7c00162970 2024-03-04T08:50:47.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000d2b60 con 0x7f7c00161cf0 2024-03-04T08:50:47.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f7c07d43640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000b4840 con 0x7f7c000b4460 2024-03-04T08:50:47.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f54be14c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54b806e7f0 0x7f54b80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7f54be14c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 0x7f54b81fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7facdf59e640 1 Processor -- start 2024-03-04T08:50:47.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f54be14c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80cf9d0 con 0x7f54b81f9110 2024-03-04T08:50:47.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f54be14c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80b0b70 con 0x7f54b80707f0 2024-03-04T08:50:47.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f54be14c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80b2c80 con 0x7f54b806e7f0 2024-03-04T08:50:47.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7facdf59e640 1 -- start start 2024-03-04T08:50:47.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fd8a359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c006220 0x7fd89c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f3968b67640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 0x7f3964154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f54bc949640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54b806e7f0 0x7f54b80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fd8a359e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 0x7fd89c033270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f3968b67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39640b2020 0x7f39640ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fd8a359e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89c0df800 0x7fd89c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3968b67640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f396415ab90 0x7f396413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fd8a359e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0560f0 con 0x7fd89c006220 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a359e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0dfc70 con 0x7fd89c055d10 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a359e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c03a0a0 con 0x7fd89c0df800 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3968b67640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396406cd40 con 0x7f39640b2020 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3968b67640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b4210 con 0x7f3964071e20 2024-03-04T08:50:47.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3968b67640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396406cec0 con 0x7f396415ab90 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 0x7fd89c033270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 0x7fd89c033270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57208/0 (socket says 172.21.15.19:57208) 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 -- 172.21.15.19:0/280206926 learned_addr learned my addr 172.21.15.19:0/280206926 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a2d9d640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89c0df800 0x7fd89c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7f566513a640 1 -- 172.21.15.19:0/2477628412 wait complete. 2024-03-04T08:50:47.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fad7d202640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad70007da0 0x7fad7004bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7fad7d202640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad700e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f566513a640 1 Processor -- start 2024-03-04T08:50:47.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.311+0000 7f566513a640 1 -- start start 2024-03-04T08:50:47.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f7c05adf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 0x7f7c00159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7d202640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad700e3550 0x7fad700e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad700e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad700e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:39246/0 (socket says 172.21.15.19:39246) 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 -- 172.21.15.19:0/2593909578 learned_addr learned my addr 172.21.15.19:0/2593909578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7ca01640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad700e3550 0x7fad700e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70053610 con 0x7fad70007da0 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70037350 con 0x7fad700e3550 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad70053790 con 0x7fad700093a0 2024-03-04T08:50:47.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facdf59e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004f40 0x7facd80ded50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8017070 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800c940 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800cd30 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.309+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b402b7f0 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.310+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b402bdb0 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff19c001030 con 0x7ff1b4037c40 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f39637fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 0x7f3964154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f39637fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 0x7f3964154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57206/0 (socket says 172.21.15.19:57206) 2024-03-04T08:50:47.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f39637fe640 1 -- 172.21.15.19:0/94810430 learned_addr learned my addr 172.21.15.19:0/94810430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facdf59e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facd80df4e0 0x7facd80e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3963fff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f396415ab90 0x7f396413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f7c05adf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 0x7f7c00159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:39230/0 (socket says 172.21.15.19:39230) 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 0x7f54b81fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 0x7f54b81fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57192/0 (socket says 172.21.15.19:57192) 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 -- 172.21.15.19:0/1961039896 learned_addr learned my addr 172.21.15.19:0/1961039896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f7c05adf640 1 -- 172.21.15.19:0/290090726 learned_addr learned my addr 172.21.15.19:0/290090726 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 -- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54b806e7f0 msgr2=0x7f54b80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54b806e7f0 0x7f54b80702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 -- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54b81f9110 msgr2=0x7f54b806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54b81f9110 0x7f54b806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f54bd94b640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8071030 con 0x7f54b80707f0 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 -- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89c0df800 msgr2=0x7fd89c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd89c0df800 0x7fd89c0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 -- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c006220 msgr2=0x7fd89c0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd89c006220 0x7fd89c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fd8a1d9b640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0d29e0 con 0x7fd89c055d10 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f7c052de640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c000c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f7c062e0640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00162970 0x7f7c0015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 -- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad700e3550 msgr2=0x7fad700e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fad700e3550 0x7fad700e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 -- 172.21.15.19:0/2593909578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad70007da0 msgr2=0x7fad7004bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad70007da0 0x7fad7004bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7fad7659c640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad701738a0 con 0x7fad700093a0 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facde59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004f40 0x7facd80ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facde59c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004f40 0x7facd80ded50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:39272/0 (socket says 172.21.15.19:39272) 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facddd9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facd80df4e0 0x7facd80e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facde59c640 1 -- 172.21.15.19:0/3407360314 learned_addr learned my addr 172.21.15.19:0/3407360314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7facdf59e640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd8052080 0x7facd8052530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.312+0000 7f3962ffd640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39640b2020 0x7f39640ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 -- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 msgr2=0x7f7c000c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1a801a070 con 0x7ff1b4037c40 2024-03-04T08:50:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f54bd94b640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 0x7f54b81fbce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54a4004780 tx=0x7f54b000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c00161cf0 0x7f7c000c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 -- 172.21.15.19:0/290090726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00162970 msgr2=0x7f7c0015fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c00162970 0x7f7c0015fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000c92e0 con 0x7f7c000b4460 2024-03-04T08:50:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7facded9d640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd8052080 0x7facd8052530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7fad7659c640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad700e0f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad6800ba70 tx=0x7fad6800bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 -- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f396415ab90 msgr2=0x7f396413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f396415ab90 0x7f396413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 -- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39640b2020 msgr2=0x7f39640ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39640b2020 0x7f39640ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396413d730 con 0x7f3964071e20 2024-03-04T08:50:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 0x7f56600b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003970 con 0x7f54b80707f0 2024-03-04T08:50:47.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0018070 con 0x7f54b80707f0 2024-03-04T08:50:47.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f3963fff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f396415ab90 0x7f396413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5660161cf0 0x7f5660158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd80558e0 con 0x7facd8052080 2024-03-04T08:50:47.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7fd8a1d9b640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 0x7fd89c033270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c410 tx=0x7fd89800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f565ed9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 0x7f56600b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660162970 0x7f56601f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff1a006b5a0 0x7ff1a006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600ce950 con 0x7f5660162970 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f565ed9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 0x7f56600b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:57238/0 (socket says 172.21.15.19:57238) 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600d2b60 con 0x7f56600b4460 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f565ed9d640 1 -- 172.21.15.19:0/2573837310 learned_addr learned my addr 172.21.15.19:0/2573837310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f566513a640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600b4840 con 0x7f5660161cf0 2024-03-04T08:50:47.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f39637fe640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 0x7f3964154d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c7d0 tx=0x7f395c00cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd803b7a0 con 0x7facd80df4e0 2024-03-04T08:50:47.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd8055a60 con 0x7facc8004f40 2024-03-04T08:50:47.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898017070 con 0x7fd89c055d10 2024-03-04T08:50:47.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f565f59e640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660162970 0x7f56601f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b8071310 con 0x7f54b80707f0 2024-03-04T08:50:47.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b81f98b0 con 0x7f54b80707f0 2024-03-04T08:50:47.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7f7c05adf640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 0x7f7c00159360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c5f0 tx=0x7f7bfc00cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003d70 con 0x7f54b80707f0 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c017070 con 0x7f3964071e20 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a808a370 con 0x7ff1b4037c40 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7ff1a0073820 0x7ff1a0075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1a00762f0 con 0x7ff1a0073820 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a8091050 con 0x7ff1b4037c40 2024-03-04T08:50:47.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.313+0000 7ff1bb7fe640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff1a006b5a0 0x7ff1a006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6801b070 con 0x7fad700093a0 2024-03-04T08:50:47.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c00a640 con 0x7f3964071e20 2024-03-04T08:50:47.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7ff1bbfff640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7ff1a0073820 0x7ff1a0075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c0d2cc0 con 0x7fd89c055d10 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c0d3280 con 0x7fd89c055d10 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898005ce0 con 0x7fd89c055d10 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980072f0 con 0x7fd89c055d10 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad70172800 con 0x7fad700093a0 2024-03-04T08:50:47.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad70172dc0 con 0x7fad700093a0 2024-03-04T08:50:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800f800 con 0x7fad700093a0 2024-03-04T08:50:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800fbf0 con 0x7fad700093a0 2024-03-04T08:50:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7facded9d640 1 -- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004f40 msgr2=0x7facd80ded50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7facded9d640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7facc8004f40 0x7facd80ded50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc018070 con 0x7f7c000b4460 2024-03-04T08:50:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0074e0 con 0x7f7c000b4460 2024-03-04T08:50:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc004a00 con 0x7f7c000b4460 2024-03-04T08:50:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7ff1bbfff640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7ff1a0073820 0x7ff1a0075c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7facded9d640 1 -- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facd80df4e0 msgr2=0x7facd80e0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7facded9d640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7facd80df4e0 0x7facd80e0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7ff1bb7fe640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff1a006b5a0 0x7ff1a006da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1b003d000 tx=0x7ff1b0038000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c000c9580 con 0x7f7c000b4460 2024-03-04T08:50:47.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7facded9d640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80e1760 con 0x7facd8052080 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000c9e20 con 0x7f7c000b4460 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f565e59c640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5660161cf0 0x7f5660158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f565ed9d640 1 -- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5660161cf0 msgr2=0x7f5660158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f565ed9d640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5660161cf0 0x7f5660158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.314+0000 7f565ed9d640 1 -- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660162970 msgr2=0x7f56601f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396413d9d0 con 0x7f3964071e20 2024-03-04T08:50:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396413df90 con 0x7f3964071e20 2024-03-04T08:50:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd89c0057e0 con 0x7fd89c055d10 2024-03-04T08:50:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00aa30 con 0x7f3964071e20 2024-03-04T08:50:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7facded9d640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd8052080 0x7facd8052530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7face004fa70 tx=0x7face0069a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f565ed9d640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660162970 0x7f56601f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f565ed9d640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600b81b0 con 0x7f56600b4460 2024-03-04T08:50:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54b8068f80 con 0x7f54b80707f0 2024-03-04T08:50:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00b3040 con 0x7facd8052080 2024-03-04T08:50:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f565ed9d640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 0x7f56600b9250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f565000efc0 tx=0x7f565000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f565e59c640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5660161cf0 0x7f5660158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f565f59e640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5660162970 0x7f56601f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face004fb80 con 0x7facd8052080 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face004f330 con 0x7facd8052080 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.315+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd80e1a40 con 0x7facd8052080 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd804d150 con 0x7facd8052080 2024-03-04T08:50:47.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c0004f330 con 0x7f7c000b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000cd40 con 0x7f56600b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650019070 con 0x7f56600b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650014680 con 0x7f56600b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.317+0000 7f566513a640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56600b8490 con 0x7f56600b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.317+0000 7f566513a640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56600b8a50 con 0x7f56600b4460 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad700059c0 con 0x7fad700093a0 2024-03-04T08:50:47.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.317+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad6801e070 con 0x7fad700093a0 2024-03-04T08:50:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.316+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== osd.4 v2:172.21.15.204:6808/3951183250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff1a00762f0 con 0x7ff1a0073820 2024-03-04T08:50:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.317+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f395c01a070 con 0x7f3964071e20 2024-03-04T08:50:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.317+0000 7fad5f7fe640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fad6406b5a0 0x7fad6406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7fad76d9d640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fad6406b5a0 0x7fad6406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7f394bfff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f395006b5d0 0x7f395006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad680898b0 con 0x7fad700093a0 2024-03-04T08:50:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f396413e370 con 0x7f3964071e20 2024-03-04T08:50:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7f566513a640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56600b30c0 con 0x7f56600b4460 2024-03-04T08:50:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7f3962ffd640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f395006b5d0 0x7f395006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f395c0897d0 con 0x7f3964071e20 2024-03-04T08:50:47.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd89801a070 con 0x7fd89c055d10 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7fad76d9d640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fad6406b5a0 0x7fad6406da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000f60 tx=0x7fad6c0079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7fad5f7fe640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7fad640737c0 0x7fad64075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad68021ec0 con 0x7fad640737c0 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7face00c3060 con 0x7facd8052080 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.318+0000 7facceffd640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7facc006b5d0 0x7facc006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7face0126350 con 0x7facd8052080 2024-03-04T08:50:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f3962ffd640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f395006b5d0 0x7f395006da90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3958035000 tx=0x7f3958008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fad7ca01640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7fad640737c0 0x7fad64075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6808e2a0 con 0x7fad700093a0 2024-03-04T08:50:47.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd892ffd640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd88406b4d0 0x7fd88406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f394bfff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f3950073770 0x7f3950075b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f395c00a640 con 0x7f3950073770 2024-03-04T08:50:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f395c057e40 con 0x7f3964071e20 2024-03-04T08:50:47.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f3963fff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f3950073770 0x7f3950075b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8980896c0 con 0x7fd89c055d10 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd892ffd640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7fd8840736f0 0x7fd884075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8840761c0 con 0x7fd8840736f0 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd898089ab0 con 0x7fd89c055d10 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facc4001030 con 0x7facd8052080 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7facde59c640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7facc006b5d0 0x7facc006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fad7ca01640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7fad640737c0 0x7fad64075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54b0005070 con 0x7f54b80707f0 2024-03-04T08:50:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7fd8a2d9d640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7fd8840736f0 0x7fd884075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7bfc01b070 con 0x7f7c000b4460 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7facceffd640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7facc0073770 0x7facc0075b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.319+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face006ce80 con 0x7facc0073770 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7face00f0cc0 con 0x7facd8052080 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7facde59c640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7facc006b5d0 0x7facc006da90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7facd0009b80 tx=0x7facd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f3963fff640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f3950073770 0x7f3950075b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7fd8a2d9d640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7fd8840736f0 0x7fd884075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7fd8a259c640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd88406b4d0 0x7fd88406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7facddd9b640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7facc0073770 0x7facc0075b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f54adffb640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f549c06b4d0 0x7f549c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5650005d10 con 0x7f56600b4460 2024-03-04T08:50:47.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f54bd14a640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f549c06b4d0 0x7f549c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54b008add0 con 0x7f54b80707f0 2024-03-04T08:50:47.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== osd.6 v2:172.21.15.204:6824/2219646256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fad68021ec0 con 0x7fad640737c0 2024-03-04T08:50:47.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f56477fe640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f564c06b5d0 0x7f564c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f7bf67fc640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7be406b5a0 0x7f7be406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.320+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bfc0896d0 con 0x7f7c000b4460 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7bf67fc640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f7be40737c0 0x7f7be4075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f565e59c640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f564c06b5d0 0x7f564c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f54adffb640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7f549c0736d0 0x7f549c075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f54bd14a640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f549c06b4d0 0x7f549c06d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54a8001bd0 tx=0x7f54a8001b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f565008b270 con 0x7f56600b4460 2024-03-04T08:50:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bfc016e70 con 0x7f7be40737c0 2024-03-04T08:50:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== osd.0 v2:172.21.15.19:6824/3268910335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f395c00a640 con 0x7f3950073770 2024-03-04T08:50:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f56477fe640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f564c0737f0 0x7f564c075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5650022e70 con 0x7f564c0737f0 2024-03-04T08:50:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f565008b660 con 0x7f56600b4460 2024-03-04T08:50:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bfc090050 con 0x7f7c000b4460 2024-03-04T08:50:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7c062e0640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f7be40737c0 0x7f7be4075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7facddd9b640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7facc0073770 0x7facc0075b90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f565f59e640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f564c0737f0 0x7f564c075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f549c0761a0 con 0x7f549c0736d0 2024-03-04T08:50:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54b008b260 con 0x7f54b80707f0 2024-03-04T08:50:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f54bc949640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7f549c0736d0 0x7f549c075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== osd.2 v2:172.21.15.19:6808/2828546557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd8840761c0 con 0x7fd8840736f0 2024-03-04T08:50:47.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7fd8a259c640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd88406b4d0 0x7fd88406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4064ac0 tx=0x7fd8a406a640 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7c052de640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7be406b5a0 0x7f7be406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.321+0000 7f7c062e0640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f7be40737c0 0x7f7be4075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.322+0000 7f565e59c640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f564c06b5d0 0x7f564c06da90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f566006c550 tx=0x7f5658009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.322+0000 7f565f59e640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f564c0737f0 0x7f564c075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.322+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== osd.7 v2:172.21.15.204:6816/2477088309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7face006ce80 con 0x7facc0073770 2024-03-04T08:50:47.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.322+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== osd.3 v2:172.21.15.19:6813/154157976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5650022e70 con 0x7f564c0737f0 2024-03-04T08:50:47.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.323+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== osd.5 v2:172.21.15.204:6800/1186499881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7bfc016e70 con 0x7f7be40737c0 2024-03-04T08:50:47.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.323+0000 7f54bc949640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7f549c0736d0 0x7f549c075af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.323+0000 7f7c052de640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7be406b5a0 0x7f7be406da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c0006d560 tx=0x7f7bf0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.324+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== osd.1 v2:172.21.15.19:6800/909506056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f549c0761a0 con 0x7f549c0736d0 2024-03-04T08:50:47.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.348+0000 7ff1c0abe640 1 -- 172.21.15.19:0/2824753448 --> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff19c002dd0 con 0x7ff1a0073820 2024-03-04T08:50:47.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.348+0000 7ff1a7fff640 1 -- 172.21.15.19:0/2824753448 <== osd.4 v2:172.21.15.204:6808/3951183250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff19c002dd0 con 0x7ff1a0073820 2024-03-04T08:50:47.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.348+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7ff1a0073820 msgr2=0x7ff1a0075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7ff1a0073820 0x7ff1a0075c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff1a006b5a0 msgr2=0x7ff1a006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff1a006b5a0 0x7ff1a006da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1b003d000 tx=0x7ff1b0038000 comp rx=0 tx=0).stop 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 msgr2=0x7ff1b4199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 --2- 172.21.15.19:0/2824753448 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1b4037c40 0x7ff1b4199c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800e870 tx=0x7ff1a800ed30 comp rx=0 tx=0).stop 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1bbfff640 1 -- 172.21.15.19:0/2824753448 reap_dead start 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 shutdown_connections 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 >> 172.21.15.19:0/2824753448 conn(0x7ff1b4009fb0 msgr2=0x7ff1b404dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 shutdown_connections 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.349+0000 7ff1a5ffb640 1 -- 172.21.15.19:0/2824753448 wait complete. 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 --> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c000c9920 con 0x7f7be40737c0 2024-03-04T08:50:47.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 --> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd89c050930 con 0x7fd8840736f0 2024-03-04T08:50:47.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 --> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facc4002dd0 con 0x7facc0073770 2024-03-04T08:50:47.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 --> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3964068f80 con 0x7f3950073770 2024-03-04T08:50:47.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7fad7d202640 1 -- 172.21.15.19:0/2593909578 --> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad70055860 con 0x7fad640737c0 2024-03-04T08:50:47.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7fd892ffd640 1 -- 172.21.15.19:0/280206926 <== osd.2 v2:172.21.15.19:6808/2828546557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd89c050930 con 0x7fd8840736f0 2024-03-04T08:50:47.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7facceffd640 1 -- 172.21.15.19:0/3407360314 <== osd.7 v2:172.21.15.204:6816/2477088309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facc4002dd0 con 0x7facc0073770 2024-03-04T08:50:47.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7f394bfff640 1 -- 172.21.15.19:0/94810430 <== osd.0 v2:172.21.15.19:6824/3268910335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3964068f80 con 0x7f3950073770 2024-03-04T08:50:47.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7f7bf67fc640 1 -- 172.21.15.19:0/290090726 <== osd.5 v2:172.21.15.204:6800/1186499881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c000c9920 con 0x7f7be40737c0 2024-03-04T08:50:47.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.355+0000 7fad5f7fe640 1 -- 172.21.15.19:0/2593909578 <== osd.6 v2:172.21.15.204:6824/2219646256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad70055860 con 0x7fad640737c0 2024-03-04T08:50:47.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f7be40737c0 msgr2=0x7f7be4075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7fd8840736f0 msgr2=0x7fd884075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f7be40737c0 0x7f7be4075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7fd8840736f0 0x7fd884075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7facc0073770 msgr2=0x7facc0075b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7facc0073770 0x7facc0075b90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7be406b5a0 msgr2=0x7f7be406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f3950073770 msgr2=0x7f3950075b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f3950073770 0x7f3950075b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7be406b5a0 0x7f7be406da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c0006d560 tx=0x7f7bf0009190 comp rx=0 tx=0).stop 2024-03-04T08:50:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f566513a640 1 -- 172.21.15.19:0/2573837310 --> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56600d4800 con 0x7f564c0737f0 2024-03-04T08:50:47.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 msgr2=0x7f7c00159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7fad640737c0 msgr2=0x7fad64075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7fad640737c0 0x7fad64075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 --2- 172.21.15.19:0/290090726 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c000b4460 0x7f7c00159360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c5f0 tx=0x7f7bfc00cab0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7facc006b5d0 msgr2=0x7facc006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7facc006b5d0 0x7facc006da90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7facd0009b80 tx=0x7facd0008040 comp rx=0 tx=0).stop 2024-03-04T08:50:47.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd88406b4d0 msgr2=0x7fd88406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd88406b4d0 0x7fd88406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4064ac0 tx=0x7fd8a406a640 comp rx=0 tx=0).stop 2024-03-04T08:50:47.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fad6406b5a0 msgr2=0x7fad6406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fad6406b5a0 0x7fad6406da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad6c000f60 tx=0x7fad6c0079d0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd8052080 msgr2=0x7facd8052530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 --2- 172.21.15.19:0/3407360314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facd8052080 0x7facd8052530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7face004fa70 tx=0x7face0069a60 comp rx=0 tx=0).stop 2024-03-04T08:50:47.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c062e0640 1 -- 172.21.15.19:0/290090726 reap_dead start 2024-03-04T08:50:47.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 shutdown_connections 2024-03-04T08:50:47.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facded9d640 1 -- 172.21.15.19:0/3407360314 reap_dead start 2024-03-04T08:50:47.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 >> 172.21.15.19:0/290090726 conn(0x7f7c000d3ce0 msgr2=0x7f7c000d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 msgr2=0x7fd89c033270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 msgr2=0x7fad700e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a359e640 1 --2- 172.21.15.19:0/280206926 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd89c055d10 0x7fd89c033270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c410 tx=0x7fd89800c8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fad5d7fa640 1 --2- 172.21.15.19:0/2593909578 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fad700093a0 0x7fad700e0f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad6800ba70 tx=0x7fad6800bf30 comp rx=0 tx=0).stop 2024-03-04T08:50:47.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f395006b5d0 msgr2=0x7f395006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f395006b5d0 0x7f395006da90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3958035000 tx=0x7f3958008030 comp rx=0 tx=0).stop 2024-03-04T08:50:47.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 msgr2=0x7f3964154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7f3968b67640 1 --2- 172.21.15.19:0/94810430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3964071e20 0x7f3964154d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c7d0 tx=0x7f395c00cc90 comp rx=0 tx=0).stop 2024-03-04T08:50:47.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7fd8a2d9d640 1 -- 172.21.15.19:0/280206926 reap_dead start 2024-03-04T08:50:47.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 shutdown_connections 2024-03-04T08:50:47.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.356+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 >> 172.21.15.19:0/3407360314 conn(0x7facd801ef40 msgr2=0x7facd8007f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56477fe640 1 -- 172.21.15.19:0/2573837310 <== osd.3 v2:172.21.15.19:6813/154157976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56600d4800 con 0x7f564c0737f0 2024-03-04T08:50:47.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 shutdown_connections 2024-03-04T08:50:47.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 shutdown_connections 2024-03-04T08:50:47.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fad7ca01640 1 -- 172.21.15.19:0/2593909578 reap_dead start 2024-03-04T08:50:47.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 >> 172.21.15.19:0/280206926 conn(0x7fd89c01e6c0 msgr2=0x7fd89c00a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f3963fff640 1 -- 172.21.15.19:0/94810430 reap_dead start 2024-03-04T08:50:47.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 shutdown_connections 2024-03-04T08:50:47.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 >> 172.21.15.19:0/94810430 conn(0x7f39640b1500 msgr2=0x7f39640b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7facdf59e640 1 -- 172.21.15.19:0/3407360314 wait complete. 2024-03-04T08:50:47.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 shutdown_connections 2024-03-04T08:50:47.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 shutdown_connections 2024-03-04T08:50:47.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 >> 172.21.15.19:0/2593909578 conn(0x7fad7001f120 msgr2=0x7fad70055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 shutdown_connections 2024-03-04T08:50:47.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fd8a359e640 1 -- 172.21.15.19:0/280206926 wait complete. 2024-03-04T08:50:47.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f3968b67640 1 -- 172.21.15.19:0/94810430 wait complete. 2024-03-04T08:50:47.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 shutdown_connections 2024-03-04T08:50:47.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f7c07d43640 1 -- 172.21.15.19:0/290090726 wait complete. 2024-03-04T08:50:47.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f564c0737f0 msgr2=0x7f564c075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f564c0737f0 0x7f564c075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 shutdown_connections 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f564c06b5d0 msgr2=0x7f564c06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f564c06b5d0 0x7f564c06da90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f566006c550 tx=0x7f5658009040 comp rx=0 tx=0).stop 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 msgr2=0x7f56600b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f56457fa640 1 --2- 172.21.15.19:0/2573837310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56600b4460 0x7f56600b9250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f565000efc0 tx=0x7f565000c490 comp rx=0 tx=0).stop 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7f565f59e640 1 -- 172.21.15.19:0/2573837310 reap_dead start 2024-03-04T08:50:47.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.357+0000 7fad5d7fa640 1 -- 172.21.15.19:0/2593909578 wait complete. 2024-03-04T08:50:47.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 shutdown_connections 2024-03-04T08:50:47.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 >> 172.21.15.19:0/2573837310 conn(0x7f56600d3ce0 msgr2=0x7f56600b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 --> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54b80714e0 con 0x7f549c0736d0 2024-03-04T08:50:47.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 shutdown_connections 2024-03-04T08:50:47.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f56457fa640 1 -- 172.21.15.19:0/2573837310 wait complete. 2024-03-04T08:50:47.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.358+0000 7f54adffb640 1 -- 172.21.15.19:0/1961039896 <== osd.1 v2:172.21.15.19:6800/909506056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f54b80714e0 con 0x7f549c0736d0 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.359+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7f549c0736d0 msgr2=0x7f549c075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.359+0000 7f54be14c640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7f549c0736d0 0x7f549c075af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f549c06b4d0 msgr2=0x7f549c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f549c06b4d0 0x7f549c06d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54a8001bd0 tx=0x7f54a8001b20 comp rx=0 tx=0).stop 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 msgr2=0x7f54b81fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 --2- 172.21.15.19:0/1961039896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54b80707f0 0x7f54b81fbce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54a4004780 tx=0x7f54b000ec00 comp rx=0 tx=0).stop 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54bd94b640 1 -- 172.21.15.19:0/1961039896 reap_dead start 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 shutdown_connections 2024-03-04T08:50:47.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.360+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 >> 172.21.15.19:0/1961039896 conn(0x7f54b809cee0 msgr2=0x7f54b80d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.361+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 shutdown_connections 2024-03-04T08:50:47.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.361+0000 7f54be14c640 1 -- 172.21.15.19:0/1961039896 wait complete. 2024-03-04T08:50:47.427 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-04T08:50:47.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T08:50:47.428 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:47.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T08:50:47.429 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-03-04T08:50:47.430 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T08:50:47.431 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:47.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T08:50:47.432 INFO:teuthology.orchestra.run.smithi019.stdout:64424509448 2024-03-04T08:50:47.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T08:50:47.433 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-03-04T08:50:47.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T08:50:47.434 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:47.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T08:50:47.435 INFO:teuthology.orchestra.run.smithi019.stdout:55834574853 2024-03-04T08:50:47.435 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T08:50:47.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.645+0000 7f9c4e246640 1 Processor -- start 2024-03-04T08:50:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.645+0000 7f9c4e246640 1 -- start start 2024-03-04T08:50:47.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.645+0000 7fd43759e640 1 Processor -- start 2024-03-04T08:50:47.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.645+0000 7fd43759e640 1 -- start start 2024-03-04T08:50:47.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c4e246640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 0x7f9c4806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c4e246640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c4806da60 0x7f9c48162a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c4e246640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4806dea0 con 0x7f9c4815ff70 2024-03-04T08:50:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c4e246640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c480717e0 con 0x7f9c4806d000 2024-03-04T08:50:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c4e246640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4806e170 con 0x7f9c4806da60 2024-03-04T08:50:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7fab9b46b640 1 Processor -- start 2024-03-04T08:50:47.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c47fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c4806da60 0x7f9c48162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c47fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c4806da60 0x7f9c48162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51328/0 (socket says 172.21.15.19:51328) 2024-03-04T08:50:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7fab9b46b640 1 -- start start 2024-03-04T08:50:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.646+0000 7f9c47fff640 1 -- 172.21.15.19:0/3619666064 learned_addr learned my addr 172.21.15.19:0/3619666064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fe8fcf75640 1 Processor -- start 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43759e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd4300e42d0 0x7fd4300539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43759e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd430056590 con 0x7fd4300e02d0 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43759e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300094b0 con 0x7fd4300e42d0 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43759e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd430056870 con 0x7fd4300dfef0 2024-03-04T08:50:47.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f006b33f640 1 Processor -- start 2024-03-04T08:50:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f9c47fff640 1 -- 172.21.15.19:0/3619666064 >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 msgr2=0x7f9c4806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f5315995640 1 Processor -- start 2024-03-04T08:50:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f5315995640 1 -- start start 2024-03-04T08:50:47.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fab9b46b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab940b2950 0x7fab9406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fab9b46b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab940b2db0 con 0x7fab940ce9e0 2024-03-04T08:50:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fab9b46b640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab94071fd0 con 0x7fab9415dda0 2024-03-04T08:50:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fab9b46b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab940722b0 con 0x7fab940b2950 2024-03-04T08:50:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f006b33f640 1 -- start start 2024-03-04T08:50:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/3619666064 >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 0x7f9c4806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7f9c47fff640 1 --2- 172.21.15.19:0/3619666064 >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 0x7f9c4806d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd436d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd4300e42d0 0x7fd4300539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43659c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42348/0 (socket says 172.21.15.19:42348) 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fd43659c640 1 -- 172.21.15.19:0/1177194246 learned_addr learned my addr 172.21.15.19:0/1177194246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fab99a08640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fab9415dda0 0x7fab9415e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:55334/0 (socket says 172.21.15.19:55334) 2024-03-04T08:50:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f9c47fff640 1 -- 172.21.15.19:0/3619666064 >> v1:172.21.15.204:6789/0 conn(0x7f9c4815ff70 legacy=0x7f9c4806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab99a08640 1 -- 172.21.15.19:0/3943523303 learned_addr learned my addr 172.21.15.19:0/3943523303 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417127785 0 0) 0x7fab94071fd0 con 0x7fab9415dda0 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab80003520 con 0x7fab9415dda0 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v1:172.21.15.204:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730122001 0 0) 0x7fab80003520 con 0x7fab9415dda0 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 >> v2:172.21.15.19:3300/0 conn(0x7fab940b2950 msgr2=0x7fab9406e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 --2- 172.21.15.19:0/3943523303 >> v2:172.21.15.19:3300/0 conn(0x7fab940b2950 0x7fab9406e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.647+0000 7fe8fcf75640 1 -- start start 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe8f80aed00 0x7fe8f8162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8165b80 0x7fe8f8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8f8071670 0x7fe8f80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f8166410 con 0x7fe8f8071670 2024-03-04T08:50:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f81666f0 con 0x7fe8f80aed00 2024-03-04T08:50:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe8fcf75640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81669d0 con 0x7fe8f8165b80 2024-03-04T08:50:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 >> v1:172.21.15.19:6789/0 conn(0x7fab940ce9e0 legacy=0x7fab940cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f5315995640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5308053c60 0x7f5308038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f9c47fff640 1 -- 172.21.15.19:0/3619666064 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48165ff0 con 0x7f9c4806da60 2024-03-04T08:50:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/3619666064 >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 0x7f9c4806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8f8071670 0x7fe8f80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8f8071670 0x7fe8f80b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36968/0 (socket says 172.21.15.19:36968) 2024-03-04T08:50:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fe9f759e640 1 Processor -- start 2024-03-04T08:50:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe9f759e640 1 -- start start 2024-03-04T08:50:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fd43659c640 1 -- 172.21.15.19:0/1177194246 >> v2:172.21.15.204:3300/0 conn(0x7fd4300e42d0 msgr2=0x7fd4300539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 -- 172.21.15.19:0/3227503868 learned_addr learned my addr 172.21.15.19:0/3227503868 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006b33f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00640d27a0 0x7f0064168a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fd43659c640 1 --2- 172.21.15.19:0/1177194246 >> v2:172.21.15.204:3300/0 conn(0x7fd4300e42d0 0x7fd4300539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fd43659c640 1 -- 172.21.15.19:0/1177194246 >> v1:172.21.15.19:6789/0 conn(0x7fd4300e02d0 legacy=0x7fd4300e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7fd43659c640 1 -- 172.21.15.19:0/1177194246 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430008e60 con 0x7fd4300dfef0 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fd43659c640 1 --2- 172.21.15.19:0/1177194246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610327caa847cbca server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f5315995640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5308033ee0 0x7f530804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f5315995640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080541d0 con 0x7f530800c090 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f5315995640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5308005f20 con 0x7f5308033ee0 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.648+0000 7f5315995640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5308006200 con 0x7f5308053c60 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5308033ee0 0x7f530804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5308033ee0 0x7f530804fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51344/0 (socket says 172.21.15.19:51344) 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 -- 172.21.15.19:0/3227503868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8165b80 msgr2=0x7fe8f8071130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 --2- 172.21.15.19:0/3227503868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8165b80 0x7fe8f8071130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 --> v1:172.21.15.204:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94072590 con 0x7fab9415dda0 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v1:172.21.15.204:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fab8c004df0 con 0x7fab9415dda0 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 >> v1:172.21.15.204:6789/0 conn(0x7fab9415dda0 legacy=0x7fab9415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 0x7fab80003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab80004800 0x7fab80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800052c0 0x7fab8000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab940722b0 con 0x7fab80004800 2024-03-04T08:50:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 -- 172.21.15.19:0/3227503868 >> v2:172.21.15.204:3300/0 conn(0x7fe8f80aed00 msgr2=0x7fe8f8162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 -- 172.21.15.19:0/3644689534 learned_addr learned my addr 172.21.15.19:0/3644689534 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f530ffff640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5308053c60 0x7f5308038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8000d310 con 0x7fab800039b0 2024-03-04T08:50:47.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8000d510 con 0x7fab800052c0 2024-03-04T08:50:47.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f77fe640 1 --2- 172.21.15.19:0/3227503868 >> v2:172.21.15.204:3300/0 conn(0x7fe8f80aed00 0x7fe8f8162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006ab3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00640d27a0 0x7f0064168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006ab3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00640d27a0 0x7f0064168a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36982/0 (socket says 172.21.15.19:36982) 2024-03-04T08:50:47.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006ab3e640 1 -- 172.21.15.19:0/3758819303 learned_addr learned my addr 172.21.15.19:0/3758819303 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fd43559a640 1 -- 172.21.15.19:0/1177194246 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c034070 con 0x7fd4300dfef0 2024-03-04T08:50:47.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640d1b20 con 0x7f006415de50 2024-03-04T08:50:47.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640cf180 con 0x7f00640cecd0 2024-03-04T08:50:47.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fd43559a640 1 -- 172.21.15.19:0/1177194246 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c030860 con 0x7fd4300dfef0 2024-03-04T08:50:47.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fab99a08640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800052c0 0x7fab8000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fd43559a640 1 -- 172.21.15.19:0/1177194246 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c030c70 con 0x7fd4300dfef0 2024-03-04T08:50:47.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640cf460 con 0x7f00640d27a0 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 -- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5308053c60 msgr2=0x7f5308038070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5308053c60 0x7f5308038070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f5315194640 1 -- 172.21.15.19:0/3644689534 >> v1:172.21.15.19:6789/0 conn(0x7f530800c090 legacy=0x7f53080defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 0x7fab80003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 --2- 172.21.15.19:0/3227503868 >> v2:172.21.15.204:3300/0 conn(0x7fe8f80aed00 0x7fe8f8162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7fe8f7fff640 1 -- 172.21.15.19:0/3227503868 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f806c560 con 0x7fe8f8071670 2024-03-04T08:50:47.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f61a4dc7640 1 Processor -- start 2024-03-04T08:50:47.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.649+0000 7f61a4dc7640 1 -- start start 2024-03-04T08:50:47.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f5315194640 1 -- 172.21.15.19:0/3644689534 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080064e0 con 0x7f5308033ee0 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61a009ba20 0x7f61a00d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 0x7f61a00b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f61a00b7b80 0x7f61a006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a009d360 con 0x7f61a009ba20 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00b8010 con 0x7f61a00b7b80 2024-03-04T08:50:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f61a4dc7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00b8260 con 0x7f61a009be00 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 -- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800052c0 msgr2=0x7fab8000cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800052c0 0x7fab8000cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 -- 172.21.15.19:0/3943523303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab80004800 msgr2=0x7fab80004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab80004800 0x7fab80004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99207640 1 -- 172.21.15.19:0/3943523303 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94072590 con 0x7fab800039b0 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fab99a08640 1 -- 172.21.15.19:0/3943523303 reap_dead start 2024-03-04T08:50:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f9c47fff640 1 --2- 172.21.15.19:0/3619666064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806da60 0x7f9c48162a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c480cf810 tx=0x7f9c3802b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85306e4b487296d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9f80b4870 0x7fe9f816f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80724e0 0x7fe9f806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9f806d4d0 0x7fe9f80b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f816af80 con 0x7fe9f806d4d0 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80708e0 con 0x7fe9f80b4870 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f759e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8070bc0 con 0x7fe9f80724e0 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9f80b4870 0x7fe9f816f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f659c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9f80b4870 0x7fe9f816f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51366/0 (socket says 172.21.15.19:51366) 2024-03-04T08:50:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f659c640 1 -- 172.21.15.19:0/2769662600 learned_addr learned my addr 172.21.15.19:0/2769662600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7fe9f5d9b640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80724e0 0x7fe9f806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f6d9d640 1 --2- 172.21.15.19:0/2769662600 >> v2:172.21.15.19:3300/0 conn(0x7fe9f806d4d0 0x7fe9f80b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe8f7fff640 1 --2- 172.21.15.19:0/3227503868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8071670 0x7fe8f80b3710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8166900 tx=0x7fe8f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b02440457aeae7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f659c640 1 -- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80724e0 msgr2=0x7fe9f806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f659c640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80724e0 0x7fe9f806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f659c640 1 -- 172.21.15.19:0/2769662600 >> v2:172.21.15.19:3300/0 conn(0x7fe9f806d4d0 msgr2=0x7fe9f80b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f659c640 1 --2- 172.21.15.19:0/2769662600 >> v2:172.21.15.19:3300/0 conn(0x7fe9f806d4d0 0x7fe9f80b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe9f659c640 1 -- 172.21.15.19:0/2769662600 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8070ea0 con 0x7fe9f80b4870 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f006ab3e640 1 -- 172.21.15.19:0/3758819303 >> v1:172.21.15.204:6789/0 conn(0x7f00640cecd0 legacy=0x7f00640d2090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f006ab3e640 1 -- 172.21.15.19:0/3758819303 >> v1:172.21.15.19:6789/0 conn(0x7f006415de50 legacy=0x7f00640ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.650+0000 7f006ab3e640 1 -- 172.21.15.19:0/3758819303 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640cf740 con 0x7f00640d27a0 2024-03-04T08:50:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f5315194640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530804fa80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5304009870 tx=0x7f530402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b59d1fb5e6bc980 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f619effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 0x7f61a00b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f619f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61a009ba20 0x7f61a00d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f619effd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 0x7f61a00b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42394/0 (socket says 172.21.15.19:42394) 2024-03-04T08:50:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f619effd640 1 -- 172.21.15.19:0/157961916 learned_addr learned my addr 172.21.15.19:0/157961916 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fab99207640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 0x7fab80003df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab84001780 tx=0x7fab80005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22bed6ffb32f8b4b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe8f67fc640 1 -- 172.21.15.19:0/3227503868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002ca80 con 0x7fe8f8071670 2024-03-04T08:50:47.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe8f67fc640 1 -- 172.21.15.19:0/3227503868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f002cc20 con 0x7fe8f8071670 2024-03-04T08:50:47.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f530f7fe640 1 -- 172.21.15.19:0/3644689534 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304035020 con 0x7f5308033ee0 2024-03-04T08:50:47.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f9c467fc640 1 -- 172.21.15.19:0/3619666064 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38037070 con 0x7f9c4806da60 2024-03-04T08:50:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f530f7fe640 1 -- 172.21.15.19:0/3644689534 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304031640 con 0x7f5308033ee0 2024-03-04T08:50:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f619ffff640 1 --2- 172.21.15.19:0/157961916 >> v2:172.21.15.204:3300/0 conn(0x7f61a00b7b80 0x7f61a006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7f9c467fc640 1 -- 172.21.15.19:0/3619666064 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38030710 con 0x7f9c4806da60 2024-03-04T08:50:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f006ab3e640 1 --2- 172.21.15.19:0/3758819303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00640d27a0 0x7f0064168a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f006408cc90 tx=0x7f005c02c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c693f4d61d11a40a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f619ffff640 1 -- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 msgr2=0x7f61a00b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f619ffff640 1 --2- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 0x7f61a00b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f619ffff640 1 -- 172.21.15.19:0/157961916 >> v2:172.21.15.19:3300/0 conn(0x7f61a009ba20 msgr2=0x7f61a00d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f619ffff640 1 --2- 172.21.15.19:0/157961916 >> v2:172.21.15.19:3300/0 conn(0x7f61a009ba20 0x7f61a00d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f619ffff640 1 -- 172.21.15.19:0/157961916 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00d2820 con 0x7f61a00b7b80 2024-03-04T08:50:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c467fc640 1 -- 172.21.15.19:0/3619666064 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38030b20 con 0x7f9c4806da60 2024-03-04T08:50:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fe8f67fc640 1 -- 172.21.15.19:0/3227503868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00343f0 con 0x7fe8f8071670 2024-03-04T08:50:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fe9f659c640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80b4870 0x7fe9f816f090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80d05c0 tx=0x7fe9e802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef819072889ea57 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f006933b640 1 -- 172.21.15.19:0/3758819303 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c02ca30 con 0x7f00640d27a0 2024-03-04T08:50:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f006933b640 1 -- 172.21.15.19:0/3758819303 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c02cbd0 con 0x7f00640d27a0 2024-03-04T08:50:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fe9f559a640 1 -- 172.21.15.19:0/2769662600 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8035020 con 0x7fe9f80b4870 2024-03-04T08:50:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fe9f559a640 1 -- 172.21.15.19:0/2769662600 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8031870 con 0x7fe9f80b4870 2024-03-04T08:50:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fe8fcf75640 1 -- 172.21.15.19:0/3227503868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8071670 msgr2=0x7fe8f80b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fe8fcf75640 1 --2- 172.21.15.19:0/3227503868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8071670 0x7fe8f80b3710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8166900 tx=0x7fe8f002bee0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 -- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 msgr2=0x7f530804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530804fa80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5304009870 tx=0x7f530402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 -- 172.21.15.19:0/3619666064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806da60 msgr2=0x7f9c48162a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 --2- 172.21.15.19:0/3619666064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806da60 0x7f9c48162a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c480cf810 tx=0x7f9c3802b770 comp rx=0 tx=0).stop 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 -- 172.21.15.19:0/3644689534 shutdown_connections 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530804fa80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 --2- 172.21.15.19:0/3644689534 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5308053c60 0x7f5308038070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f5315995640 1 -- 172.21.15.19:0/3644689534 >> 172.21.15.19:0/3644689534 conn(0x7f5308009fa0 msgr2=0x7f530800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fd43759e640 1 -- 172.21.15.19:0/1177194246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 msgr2=0x7fd4300085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fd43759e640 1 --2- 172.21.15.19:0/1177194246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fd43759e640 1 -- 172.21.15.19:0/1177194246 shutdown_connections 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fd43759e640 1 --2- 172.21.15.19:0/1177194246 >> v2:172.21.15.204:3300/0 conn(0x7fd4300e42d0 0x7fd4300539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fd43759e640 1 --2- 172.21.15.19:0/1177194246 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300dfef0 0x7fd4300085d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fd43759e640 1 -- 172.21.15.19:0/1177194246 >> 172.21.15.19:0/1177194246 conn(0x7fd43001ef40 msgr2=0x7fd430055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 -- 172.21.15.19:0/3619666064 shutdown_connections 2024-03-04T08:50:47.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 --2- 172.21.15.19:0/3619666064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806da60 0x7f9c48162a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 --2- 172.21.15.19:0/3619666064 >> v2:172.21.15.19:3300/0 conn(0x7f9c4806d000 0x7f9c4806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f9c4e246640 1 -- 172.21.15.19:0/3619666064 >> 172.21.15.19:0/3619666064 conn(0x7f9c480b1c80 msgr2=0x7f9c480cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f559a640 1 -- 172.21.15.19:0/2769662600 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8031c40 con 0x7fe9f80b4870 2024-03-04T08:50:47.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fd43759e640 1 -- 172.21.15.19:0/1177194246 shutdown_connections 2024-03-04T08:50:47.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84001350 con 0x7fab800039b0 2024-03-04T08:50:47.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7f006933b640 1 -- 172.21.15.19:0/3758819303 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0343f0 con 0x7f00640d27a0 2024-03-04T08:50:47.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f5315995640 1 -- 172.21.15.19:0/3644689534 shutdown_connections 2024-03-04T08:50:47.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fd43759e640 1 -- 172.21.15.19:0/1177194246 wait complete. 2024-03-04T08:50:47.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f5315995640 1 -- 172.21.15.19:0/3644689534 wait complete. 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab840052d0 con 0x7fab800039b0 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.651+0000 7fab8bfff640 1 -- 172.21.15.19:0/3943523303 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84001350 con 0x7fab800039b0 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fab9b46b640 1 -- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 msgr2=0x7fab80003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.652+0000 7fab9b46b640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 0x7fab80003df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab84001780 tx=0x7fab80005830 comp rx=0 tx=0).stop 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fab9b46b640 1 -- 172.21.15.19:0/3943523303 shutdown_connections 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fab9b46b640 1 --2- 172.21.15.19:0/3943523303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab800039b0 0x7fab80003df0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fab9b46b640 1 -- 172.21.15.19:0/3943523303 >> 172.21.15.19:0/3943523303 conn(0x7fab940b1c80 msgr2=0x7fab940cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fab9b46b640 1 -- 172.21.15.19:0/3943523303 shutdown_connections 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f9c4e246640 1 -- 172.21.15.19:0/3619666064 shutdown_connections 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 -- 172.21.15.19:0/3227503868 shutdown_connections 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 --2- 172.21.15.19:0/3227503868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8071670 0x7fe8f80b3710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 --2- 172.21.15.19:0/3227503868 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8165b80 0x7fe8f8071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 --2- 172.21.15.19:0/3227503868 >> v2:172.21.15.204:3300/0 conn(0x7fe8f80aed00 0x7fe8f8162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 -- 172.21.15.19:0/3227503868 >> 172.21.15.19:0/3227503868 conn(0x7fe8f80b16e0 msgr2=0x7fe8f80b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00640d27a0 msgr2=0x7f0064168a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f006b33f640 1 --2- 172.21.15.19:0/3758819303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00640d27a0 0x7f0064168a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f006408cc90 tx=0x7f005c02c090 comp rx=0 tx=0).stop 2024-03-04T08:50:47.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f619ffff640 1 --2- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a00b7b80 0x7f61a006b6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b8a30 tx=0x7f619002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=685d96dd8f42a7d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 -- 172.21.15.19:0/3227503868 shutdown_connections 2024-03-04T08:50:47.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe8fcf75640 1 -- 172.21.15.19:0/3227503868 wait complete. 2024-03-04T08:50:47.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 shutdown_connections 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 -- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80b4870 msgr2=0x7fe9f816f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80b4870 0x7fe9f816f090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80d05c0 tx=0x7fe9e802b910 comp rx=0 tx=0).stop 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 -- 172.21.15.19:0/2769662600 shutdown_connections 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 --2- 172.21.15.19:0/2769662600 >> v2:172.21.15.19:3300/0 conn(0x7fe9f806d4d0 0x7fe9f80b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80724e0 0x7fe9f806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 --2- 172.21.15.19:0/2769662600 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80b4870 0x7fe9f816f090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 -- 172.21.15.19:0/2769662600 >> 172.21.15.19:0/2769662600 conn(0x7fe9f806afb0 msgr2=0x7fe9f806b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f619e7fc640 1 -- 172.21.15.19:0/157961916 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900317c0 con 0x7f61a00b7b80 2024-03-04T08:50:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f619e7fc640 1 -- 172.21.15.19:0/157961916 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190037070 con 0x7f61a00b7b80 2024-03-04T08:50:47.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f619e7fc640 1 -- 172.21.15.19:0/157961916 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190031bc0 con 0x7f61a00b7b80 2024-03-04T08:50:47.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7f9c4e246640 1 -- 172.21.15.19:0/3619666064 wait complete. 2024-03-04T08:50:47.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f006b33f640 1 --2- 172.21.15.19:0/3758819303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00640d27a0 0x7f0064168a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 >> 172.21.15.19:0/3758819303 conn(0x7f006409cdf0 msgr2=0x7f00640d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fab9b46b640 1 -- 172.21.15.19:0/3943523303 wait complete. 2024-03-04T08:50:47.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 -- 172.21.15.19:0/2769662600 shutdown_connections 2024-03-04T08:50:47.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.653+0000 7fe9f759e640 1 -- 172.21.15.19:0/2769662600 wait complete. 2024-03-04T08:50:47.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 -- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a00b7b80 msgr2=0x7f61a006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a00b7b80 0x7f61a006b6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b8a30 tx=0x7f619002b860 comp rx=0 tx=0).stop 2024-03-04T08:50:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f5315995640 1 Processor -- start 2024-03-04T08:50:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 -- 172.21.15.19:0/157961916 shutdown_connections 2024-03-04T08:50:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f5315995640 1 -- start start 2024-03-04T08:50:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fd43759e640 1 Processor -- start 2024-03-04T08:50:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a00b7b80 0x7f61a006b6c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fd43759e640 1 -- start start 2024-03-04T08:50:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/157961916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009be00 0x7f61a00b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f9c4e246640 1 Processor -- start 2024-03-04T08:50:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/157961916 >> v2:172.21.15.19:3300/0 conn(0x7f61a009ba20 0x7f61a00d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.654+0000 7f61a4dc7640 1 -- 172.21.15.19:0/157961916 >> 172.21.15.19:0/157961916 conn(0x7f61a00d3ab0 msgr2=0x7f61a00d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fe8fcf75640 1 Processor -- start 2024-03-04T08:50:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fab9b46b640 1 Processor -- start 2024-03-04T08:50:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 shutdown_connections 2024-03-04T08:50:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f61a4dc7640 1 -- 172.21.15.19:0/157961916 shutdown_connections 2024-03-04T08:50:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f006b33f640 1 -- 172.21.15.19:0/3758819303 wait complete. 2024-03-04T08:50:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f9c4e246640 1 -- start start 2024-03-04T08:50:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd43759e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7f5315995640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 0x7f530803d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd43759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300e42d0 0x7fd4300d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fab9b46b640 1 -- start start 2024-03-04T08:50:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fab9b46b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 0x7fab94156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fab9b46b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fab9b46b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 0x7fab94145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7f5315995640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530803a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7f9c4e246640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d000 0x7f9c481fc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fe8fcf75640 1 -- start start 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 0x7fe8f814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8f80aed00 0x7fe8f8154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 0x7fe8f814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8166030 con 0x7fe8f8165b80 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81636a0 con 0x7fe8f80aed00 2024-03-04T08:50:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fe8fcf75640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81661b0 con 0x7fe8f8071670 2024-03-04T08:50:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7f5315995640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd43659c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd43659c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51388/0 (socket says 172.21.15.19:51388) 2024-03-04T08:50:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd43659c640 1 -- 172.21.15.19:0/2198504774 learned_addr learned my addr 172.21.15.19:0/2198504774 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f9c4e246640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315995640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308037a80 con 0x7f5308053c60 2024-03-04T08:50:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315194640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab98a06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 0x7fe8f814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 0x7fe8f814b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37026/0 (socket says 172.21.15.19:37026) 2024-03-04T08:50:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab99207640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 0x7fab94156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab98a06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37012/0 (socket says 172.21.15.19:37012) 2024-03-04T08:50:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f77fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 0x7fe8f814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f7fff640 1 -- 172.21.15.19:0/1073617079 learned_addr learned my addr 172.21.15.19:0/1073617079 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab99207640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 0x7fab94156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42410/0 (socket says 172.21.15.19:42410) 2024-03-04T08:50:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315194640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37042/0 (socket says 172.21.15.19:37042) 2024-03-04T08:50:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315194640 1 -- 172.21.15.19:0/1275804871 learned_addr learned my addr 172.21.15.19:0/1275804871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5314993640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 0x7f530803d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308037900 con 0x7f5308033ee0 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530804ffc0 con 0x7f530800c090 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab98a06640 1 -- 172.21.15.19:0/1889082903 learned_addr learned my addr 172.21.15.19:0/1889082903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fe9f759e640 1 Processor -- start 2024-03-04T08:50:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7fe9f759e640 1 -- start start 2024-03-04T08:50:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab99a08640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 0x7fab94145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94140790 con 0x7fab9415d290 2024-03-04T08:50:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94072b50 con 0x7fab94139500 2024-03-04T08:50:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9406dd60 con 0x7fab800039b0 2024-03-04T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f006b33f640 1 Processor -- start 2024-03-04T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f006b33f640 1 -- start start 2024-03-04T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.656+0000 7fd435d9b640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300e42d0 0x7fd4300d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 0x7fd4300d7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f9c4e246640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 0x7f9c48148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f6ffd640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8f80aed00 0x7fe8f8154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f77fe640 1 -- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8f80aed00 msgr2=0x7fe8f8154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f77fe640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8f80aed00 0x7fe8f8154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430008b10 con 0x7fd4300d70d0 2024-03-04T08:50:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f77fe640 1 -- 172.21.15.19:0/1073617079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 msgr2=0x7fe8f814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430056b50 con 0x7fd4300dfef0 2024-03-04T08:50:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe8f77fe640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 0x7fe8f814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 0x7fe9f8167990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80b4870 0x7fe9f80c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300e4910 con 0x7fd4300e42d0 2024-03-04T08:50:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe8f77fe640 1 -- 172.21.15.19:0/1073617079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8155790 con 0x7fe8f8071670 2024-03-04T08:50:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8072aa0 con 0x7fe9f806d4d0 2024-03-04T08:50:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c46ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c46ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42460/0 (socket says 172.21.15.19:42460) 2024-03-04T08:50:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8072920 con 0x7fe9f80724e0 2024-03-04T08:50:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd436d9d640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 0x7fd4300d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f759e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80b2d40 con 0x7fe9f80b4870 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5314993640 1 -- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 msgr2=0x7f530803a040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5314993640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530803a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f5314993640 1 -- 172.21.15.19:0/1275804871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 msgr2=0x7f530803a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f5314993640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f5314993640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080cab50 con 0x7f530800c090 2024-03-04T08:50:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f5315194640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 0x7f9c48148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 0x7f9c48148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37062/0 (socket says 172.21.15.19:37062) 2024-03-04T08:50:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c46ffd640 1 -- 172.21.15.19:0/4232893298 learned_addr learned my addr 172.21.15.19:0/4232893298 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48160350 con 0x7f9c4815ff70 2024-03-04T08:50:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c481665b0 con 0x7f9c4806d000 2024-03-04T08:50:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48166db0 con 0x7f9c4806da60 2024-03-04T08:50:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd43659c640 1 -- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300e42d0 msgr2=0x7fd4300d6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f9c477fe640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d000 0x7f9c481fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 0x7f0064160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 0x7f00641f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006415de50 0x7f00641f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd43659c640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300e42d0 0x7fd4300d6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd43659c640 1 -- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 msgr2=0x7fd4300d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd43659c640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 0x7fd4300d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd43659c640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43004fba0 con 0x7fd4300dfef0 2024-03-04T08:50:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fd436d9d640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 0x7fd4300d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b1db0 con 0x7f006415de50 2024-03-04T08:50:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415e230 con 0x7f00640d27a0 2024-03-04T08:50:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.655+0000 7f61a4dc7640 1 -- 172.21.15.19:0/157961916 wait complete. 2024-03-04T08:50:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f006b33f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00640b1f30 con 0x7f00640cecd0 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f61a4dc7640 1 Processor -- start 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7f61a4dc7640 1 -- start start 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 0x7f61a009d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a009be00 0x7f61a00cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 0x7f61a014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a009c260 con 0x7f61a00b7b80 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00d2de0 con 0x7f61a009be00 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7f61a4dc7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00b8540 con 0x7f61a009ba20 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 0x7f61a009d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 0x7f61a014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619f7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 0x7f61a009d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42464/0 (socket says 172.21.15.19:42464) 2024-03-04T08:50:47.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619f7fe640 1 -- 172.21.15.19:0/1359951743 learned_addr learned my addr 172.21.15.19:0/1359951743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fd43659c640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009990 tx=0x7fd42c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f0069b3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 0x7f00641f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f0069b3c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 0x7f00641f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51406/0 (socket says 172.21.15.19:51406) 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f0069b3c640 1 -- 172.21.15.19:0/1060435888 learned_addr learned my addr 172.21.15.19:0/1060435888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006ab3e640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006415de50 0x7f00641f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 0x7f0064160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619effd640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a009be00 0x7f61a00cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 -- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d000 msgr2=0x7f9c481fc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d000 0x7f9c481fc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 -- 172.21.15.19:0/4232893298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 msgr2=0x7f9c48148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 0x7f9c48148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4815bbc0 con 0x7f9c4806da60 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c048070 con 0x7fd4300dfef0 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fab99a08640 1 -- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 msgr2=0x7fab94156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fab99a08640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 0x7fab94156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 -- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 msgr2=0x7f61a009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 0x7f61a009d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 -- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a009be00 msgr2=0x7f61a00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a009be00 0x7f61a00cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f619ffff640 1 -- 172.21.15.19:0/1359951743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a014bb60 con 0x7f61a00b7b80 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51400/0 (socket says 172.21.15.19:51400) 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 -- 172.21.15.19:0/3722282356 learned_addr learned my addr 172.21.15.19:0/3722282356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f6d9d640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80b4870 0x7fe9f80c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f659c640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 0x7fe9f8167990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 -- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80b4870 msgr2=0x7fe9f80c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80b4870 0x7fe9f80c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 -- 172.21.15.19:0/3722282356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 msgr2=0x7fe9f8167990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 0x7fe9f8167990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f5d9b640 1 -- 172.21.15.19:0/3722282356 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f817c450 con 0x7fe9f80724e0 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.657+0000 7fe9f659c640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 0x7fe9f8167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9f5d9b640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009db0 tx=0x7fe9f000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0018020 con 0x7fe9f80724e0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0014480 con 0x7fe9f80724e0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0014830 con 0x7fe9f80724e0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9f759e640 1 -- 172.21.15.19:0/3722282356 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8168020 con 0x7fe9f80724e0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fe9f759e640 1 -- 172.21.15.19:0/3722282356 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f81685e0 con 0x7fe9f80724e0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300496f0 con 0x7fd4300dfef0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd430049cb0 con 0x7fd4300dfef0 2024-03-04T08:50:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cf60 tx=0x7f9c4000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.658+0000 7fab99a08640 1 -- 172.21.15.19:0/1889082903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 msgr2=0x7fab9415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fab99a08640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fab99a08640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9415c1f0 con 0x7fab94139500 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fab98a06640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f5314993640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 0x7f530803d070 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f531006a8c0 tx=0x7f531004f5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c030660 con 0x7fd4300dfef0 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fe8f77fe640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 0x7fe8f814d2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c5e0 tx=0x7fe8e800caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 -- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 msgr2=0x7f00641f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 0x7f00641f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 -- 172.21.15.19:0/1060435888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006415de50 msgr2=0x7f00641f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006415de50 0x7f00641f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7f006a33d640 1 -- 172.21.15.19:0/1060435888 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640c7db0 con 0x7f00640cecd0 2024-03-04T08:50:47.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.659+0000 7fab99a08640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 0x7fab94145160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab9415e180 tx=0x7fab8c007f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310073530 con 0x7f530800c090 2024-03-04T08:50:47.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c034040 con 0x7fd4300dfef0 2024-03-04T08:50:47.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f006a33d640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 0x7f0064160be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f005400b410 tx=0x7f005400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53100911d0 con 0x7f530800c090 2024-03-04T08:50:47.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fe9f759e640 1 -- 172.21.15.19:0/3722282356 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8068f80 con 0x7fe9f80724e0 2024-03-04T08:50:47.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4001a070 con 0x7f9c4806da60 2024-03-04T08:50:47.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53080cae30 con 0x7f530800c090 2024-03-04T08:50:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53080cb3f0 con 0x7f530800c090 2024-03-04T08:50:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000d840 con 0x7f9c4806da60 2024-03-04T08:50:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8015070 con 0x7fe8f8071670 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054015020 con 0x7f00640cecd0 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00640c8090 con 0x7f00640cecd0 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640c8650 con 0x7f00640cecd0 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0054011830 con 0x7f00640cecd0 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fe8fcf75640 1 -- 172.21.15.19:0/1073617079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f8155a70 con 0x7fe8f8071670 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fe8fcf75640 1 -- 172.21.15.19:0/1073617079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8156030 con 0x7fe8f8071670 2024-03-04T08:50:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8004220 con 0x7fe8f8071670 2024-03-04T08:50:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054015020 con 0x7f00640cecd0 2024-03-04T08:50:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0072e0 con 0x7fab94139500 2024-03-04T08:50:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c010a70 con 0x7fab94139500 2024-03-04T08:50:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7f619ffff640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 0x7f61a014afd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6190033000 tx=0x7f61900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.660+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c010e40 con 0x7fab94139500 2024-03-04T08:50:47.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8003610 con 0x7fe8f8071670 2024-03-04T08:50:47.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c005290 con 0x7fd4300dfef0 2024-03-04T08:50:47.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4815bea0 con 0x7f9c4806da60 2024-03-04T08:50:47.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9415c4d0 con 0x7fab94139500 2024-03-04T08:50:47.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9415ca90 con 0x7fab94139500 2024-03-04T08:50:47.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd42c04b070 con 0x7fd4300dfef0 2024-03-04T08:50:47.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100915c0 con 0x7f530800c090 2024-03-04T08:50:47.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190032650 con 0x7f61a00b7b80 2024-03-04T08:50:47.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190031ec0 con 0x7f61a00b7b80 2024-03-04T08:50:47.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190032a50 con 0x7f61a00b7b80 2024-03-04T08:50:47.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fd426ffd640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 0x7fd41806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.661+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9f0005d10 con 0x7fe9f80724e0 2024-03-04T08:50:47.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fe8fcf75640 1 -- 172.21.15.19:0/1073617079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8005290 con 0x7fe8f8071670 2024-03-04T08:50:47.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd42c0ac1b0 con 0x7fd4300dfef0 2024-03-04T08:50:47.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000dc10 con 0x7f9c4806da60 2024-03-04T08:50:47.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c481498a0 con 0x7f9c4806da60 2024-03-04T08:50:47.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a014be40 con 0x7f61a00b7b80 2024-03-04T08:50:47.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a014c400 con 0x7f61a00b7b80 2024-03-04T08:50:47.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fe9e6ffd640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 0x7fe9d806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.662+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f008ac50 con 0x7fe9f80724e0 2024-03-04T08:50:47.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.663+0000 7fd435d9b640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 0x7fd41806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.663+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9404f330 con 0x7fab94139500 2024-03-04T08:50:47.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.663+0000 7fe9f659c640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 0x7fe9d806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.663+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53080d0a50 con 0x7f530800c090 2024-03-04T08:50:47.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4804f330 con 0x7f9c4806da60 2024-03-04T08:50:47.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.663+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe8e80037d0 con 0x7fe8f8071670 2024-03-04T08:50:47.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0064068f80 con 0x7f00640cecd0 2024-03-04T08:50:47.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0054018020 con 0x7f00640cecd0 2024-03-04T08:50:47.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7fe8dffff640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 0x7fe8e406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5310094030 con 0x7f530800c090 2024-03-04T08:50:47.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7fd435d9b640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 0x7fd41806da90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd438064ac0 tx=0x7fd43806d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8e8089f30 con 0x7fe8f8071670 2024-03-04T08:50:47.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a0068f80 con 0x7f61a00b7b80 2024-03-04T08:50:47.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7fe8f6ffd640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 0x7fe8e406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f005affd640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 0x7f004806db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7fe9f659c640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 0x7fe9d806da90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8036000 tx=0x7fe9e803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f530d7fa640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 0x7f52f406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.664+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0054089c40 con 0x7f00640cecd0 2024-03-04T08:50:47.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c4001d070 con 0x7f9c4806da60 2024-03-04T08:50:47.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6190032bf0 con 0x7f61a00b7b80 2024-03-04T08:50:47.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5310104a30 con 0x7f530800c090 2024-03-04T08:50:47.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f0069b3c640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 0x7f004806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f6187fff640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 0x7f618c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f530ffff640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 0x7f52f406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61900abc70 con 0x7f61a00b7b80 2024-03-04T08:50:47.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f619f7fe640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 0x7f618c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f9c2ffff640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 0x7f9c3406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7fe8f6ffd640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 0x7fe8e406da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8150df0 tx=0x7fe8ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f0069b3c640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 0x7f004806db90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00640d4540 tx=0x7f0060008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c4008a950 con 0x7f9c4806da60 2024-03-04T08:50:47.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.665+0000 7f9c477fe640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 0x7f9c3406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.666+0000 7f530ffff640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 0x7f52f406d9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53080debf0 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.666+0000 7f619f7fe640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 0x7f618c06da60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6198009a40 tx=0x7f619800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.666+0000 7f9c477fe640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 0x7f9c3406da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f60 tx=0x7f9c3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.668+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f53080d0a50 con 0x7f530800c090 2024-03-04T08:50:47.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.669+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe9f0022070 con 0x7fe9f80724e0 2024-03-04T08:50:47.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.669+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab8c01a020 con 0x7fab94139500 2024-03-04T08:50:47.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.670+0000 7fab89ffb640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 0x7fab7806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:47.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.670+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6190040070 con 0x7f61a00b7b80 2024-03-04T08:50:47.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.670+0000 7fab99207640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 0x7fab7806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:47.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.671+0000 7fab99207640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 0x7fab7806da10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab84033000 tx=0x7fab84009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:47.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.673+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe8e8058740 con 0x7fe8f8071670 2024-03-04T08:50:47.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.677+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9c400591f0 con 0x7f9c4806da60 2024-03-04T08:50:47.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.677+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd42c07aa50 con 0x7fd4300dfef0 2024-03-04T08:50:47.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.678+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab8c0575b0 con 0x7fab94139500 2024-03-04T08:50:47.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.681+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f005401f020 con 0x7f00640cecd0 2024-03-04T08:50:47.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:47.686+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fab8c059510 con 0x7fab94139500 2024-03-04T08:50:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.073+0000 7f5315995640 1 -- 172.21.15.19:0/1275804871 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5308005380 con 0x7f530800c090 2024-03-04T08:50:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.074+0000 7f530d7fa640 1 -- 172.21.15.19:0/1275804871 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f531009b020 con 0x7f530800c090 2024-03-04T08:50:48.070 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-03-04T08:50:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 msgr2=0x7f52f406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 0x7f52f406d9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f53080debf0 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 msgr2=0x7f530803d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 0x7f530803d070 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f531006a8c0 tx=0x7f531004f5c0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 shutdown_connections 2024-03-04T08:50:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.077+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5308053c60 0x7f530803a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52f406b520 0x7f52f406d9e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5308033ee0 0x7f530803a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 --2- 172.21.15.19:0/1275804871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f530800c090 0x7f530803d070 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 >> 172.21.15.19:0/1275804871 conn(0x7f5308009fa0 msgr2=0x7f53080dcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 shutdown_connections 2024-03-04T08:50:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.078+0000 7f52faffd640 1 -- 172.21.15.19:0/1275804871 wait complete. 2024-03-04T08:50:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.081+0000 7fe9f759e640 1 -- 172.21.15.19:0/3722282356 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe9f816cc40 con 0x7fe9f80724e0 2024-03-04T08:50:48.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.082+0000 7fe9e6ffd640 1 -- 172.21.15.19:0/3722282356 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9f0010040 con 0x7fe9f80724e0 2024-03-04T08:50:48.078 INFO:teuthology.orchestra.run.smithi019.stdout:55834574853 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.085+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 msgr2=0x7fe9d806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.085+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 0x7fe9d806da90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8036000 tx=0x7fe9e803c040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.085+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 msgr2=0x7fe9f817bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.085+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009db0 tx=0x7fe9f000c490 comp rx=0 tx=0).stop 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.085+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 shutdown_connections 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9f80b4870 0x7fe9f80c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe9d806b5d0 0x7fe9d806da90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9f80724e0 0x7fe9f817bf10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 --2- 172.21.15.19:0/3722282356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9f806d4d0 0x7fe9f8167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 >> 172.21.15.19:0/3722282356 conn(0x7fe9f806afb0 msgr2=0x7fe9f806b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 shutdown_connections 2024-03-04T08:50:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.086+0000 7fe9e4ff9640 1 -- 172.21.15.19:0/3722282356 wait complete. 2024-03-04T08:50:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.088+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61a009cd80 con 0x7f61a00b7b80 2024-03-04T08:50:48.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.089+0000 7f6187fff640 1 -- 172.21.15.19:0/1359951743 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f619007a480 con 0x7f61a00b7b80 2024-03-04T08:50:48.085 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-04T08:50:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.091+0000 7fe8fcf75640 1 -- 172.21.15.19:0/1073617079 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8d8005580 con 0x7fe8f8071670 2024-03-04T08:50:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.091+0000 7fe8dffff640 1 -- 172.21.15.19:0/1073617079 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8e805c7e0 con 0x7fe8f8071670 2024-03-04T08:50:48.088 INFO:teuthology.orchestra.run.smithi019.stdout:64424509443 2024-03-04T08:50:48.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.092+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 msgr2=0x7f618c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.092+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 0x7f618c06da60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6198009a40 tx=0x7f619800b040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.092+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 msgr2=0x7f61a014afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.092+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 0x7f61a014afd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6190033000 tx=0x7f61900046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 shutdown_connections 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a00b7b80 0x7f61a014afd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618c06b5a0 0x7f618c06da60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61a009be00 0x7f61a00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 --2- 172.21.15.19:0/1359951743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61a009ba20 0x7f61a009d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.093+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 >> 172.21.15.19:0/1359951743 conn(0x7f61a00d3ab0 msgr2=0x7f61a0072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.094+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 shutdown_connections 2024-03-04T08:50:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.094+0000 7f61a4dc7640 1 -- 172.21.15.19:0/1359951743 wait complete. 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 msgr2=0x7fe8e406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 0x7fe8e406da60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8150df0 tx=0x7fe8ec008040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 msgr2=0x7fe8f814d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 0x7fe8f814d2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c5e0 tx=0x7fe8e800caa0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 shutdown_connections 2024-03-04T08:50:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8f8165b80 0x7fe8f814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe8e406b5a0 0x7fe8e406da60 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8150df0 tx=0x7fe8ec008040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.095+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe8f80aed00 0x7fe8f8154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.096+0000 7fe8ddffb640 1 --2- 172.21.15.19:0/1073617079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe8f8071670 0x7fe8f814d2b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.096+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 >> 172.21.15.19:0/1073617079 conn(0x7fe8f80b16e0 msgr2=0x7fe8f80b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.096+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c480cbb40 con 0x7f9c4806da60 2024-03-04T08:50:48.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.6 2024-03-04T08:50:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.096+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 shutdown_connections 2024-03-04T08:50:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.096+0000 7fe8ddffb640 1 -- 172.21.15.19:0/1073617079 wait complete. 2024-03-04T08:50:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.097+0000 7f9c2ffff640 1 -- 172.21.15.19:0/4232893298 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c4005f030 con 0x7f9c4806da60 2024-03-04T08:50:48.095 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-03-04T08:50:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.099+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f006415d3b0 con 0x7f00640cecd0 2024-03-04T08:50:48.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.100+0000 7f005affd640 1 -- 172.21.15.19:0/1060435888 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0054058a20 con 0x7f00640cecd0 2024-03-04T08:50:48.096 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-03-04T08:50:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd41c005580 con 0x7fd4300dfef0 2024-03-04T08:50:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 msgr2=0x7f9c3406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 0x7f9c3406da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f60 tx=0x7f9c3c009040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 msgr2=0x7f9c4815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cf60 tx=0x7f9c4000cf90 comp rx=0 tx=0).stop 2024-03-04T08:50:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 shutdown_connections 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815ff70 0x7f9c48148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.101+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4806da60 0x7f9c4815b490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b5a0 0x7f9c3406da60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7f9c4e246640 1 --2- 172.21.15.19:0/4232893298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d000 0x7f9c481fc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 >> 172.21.15.19:0/4232893298 conn(0x7f9c480b1c80 msgr2=0x7f9c480b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7fd426ffd640 1 -- 172.21.15.19:0/2198504774 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd42c07eaf0 con 0x7fd4300dfef0 2024-03-04T08:50:48.099 INFO:teuthology.orchestra.run.smithi019.stdout:64424509444 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 shutdown_connections 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.102+0000 7f9c4e246640 1 -- 172.21.15.19:0/4232893298 wait complete. 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 msgr2=0x7f004806db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 0x7f004806db90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00640d4540 tx=0x7f0060008040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 msgr2=0x7f0064160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 0x7f0064160be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f005400b410 tx=0x7f005400b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 shutdown_connections 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f006415de50 0x7f00641f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f004806b6d0 0x7f004806db90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00640d27a0 0x7f00641f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 --2- 172.21.15.19:0/1060435888 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00640cecd0 0x7f0064160be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 >> 172.21.15.19:0/1060435888 conn(0x7f006409cdf0 msgr2=0x7f00640b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.103+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 shutdown_connections 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.104+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab9406a1b0 con 0x7fab94139500 2024-03-04T08:50:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.104+0000 7f006b33f640 1 -- 172.21.15.19:0/1060435888 wait complete. 2024-03-04T08:50:48.102 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-03-04T08:50:48.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.104+0000 7fab89ffb640 1 -- 172.21.15.19:0/1889082903 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab8c05d5b0 con 0x7fab94139500 2024-03-04T08:50:48.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 msgr2=0x7fd41806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 0x7fd41806da90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd438064ac0 tx=0x7fd43806d040 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 msgr2=0x7fd43004bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009990 tx=0x7fd42c004730 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 shutdown_connections 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4300d70d0 0x7fd4300d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd4300e42d0 0x7fd4300d6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd41806b5d0 0x7fd41806da90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 --2- 172.21.15.19:0/2198504774 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd4300dfef0 0x7fd43004bfb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.105+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 >> 172.21.15.19:0/2198504774 conn(0x7fd43001ef40 msgr2=0x7fd430054e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.106+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 shutdown_connections 2024-03-04T08:50:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.106+0000 7fd43759e640 1 -- 172.21.15.19:0/2198504774 wait complete. 2024-03-04T08:50:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 msgr2=0x7fab7806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 0x7fab7806da10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab84033000 tx=0x7fab84009030 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 msgr2=0x7fab94145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 0x7fab94145160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab9415e180 tx=0x7fab8c007f40 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 shutdown_connections 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fab7806b550 0x7fab7806da10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab94139500 0x7fab94145160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.107+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab9415d290 0x7fab9415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.108+0000 7fab9b46b640 1 --2- 172.21.15.19:0/1889082903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fab800039b0 0x7fab94156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.108+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 >> 172.21.15.19:0/1889082903 conn(0x7fab940b1c80 msgr2=0x7fab940b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.108+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 shutdown_connections 2024-03-04T08:50:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:48.108+0000 7fab9b46b640 1 -- 172.21.15.19:0/1889082903 wait complete. 2024-03-04T08:50:48.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-04T08:50:48.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-03-04T08:50:48.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.0 2024-03-04T08:50:48.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-03-04T08:50:48.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2024-03-04T08:50:48.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-03-04T08:50:49.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T08:50:49.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T08:50:49.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T08:50:49.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T08:50:49.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T08:50:49.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T08:50:49.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T08:50:49.123 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.263+0000 7efe2f226640 1 Processor -- start 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.263+0000 7efe2f226640 1 -- start start 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2f226640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efe280d1fc0 0x7efe2806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2f226640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280d0990 con 0x7efe280d04e0 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2f226640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280d11f0 con 0x7efe28162100 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2f226640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280cc3a0 con 0x7efe280d1fc0 2024-03-04T08:50:49.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2ea25640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efe280d04e0 0x7efe280cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42900/0 (socket says 172.21.15.19:42900) 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2ea25640 1 -- 172.21.15.19:0/975945809 learned_addr learned my addr 172.21.15.19:0/975945809 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.265+0000 7efe2da23640 1 --2- 172.21.15.19:0/975945809 >> v2:172.21.15.204:3300/0 conn(0x7efe280d1fc0 0x7efe2806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943511561 0 0) 0x7efe280d0990 con 0x7efe280d04e0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe14003520 con 0x7efe280d04e0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073499087 0 0) 0x7efe14003520 con 0x7efe280d04e0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 >> v2:172.21.15.204:3300/0 conn(0x7efe280d1fc0 msgr2=0x7efe2806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 --2- 172.21.15.19:0/975945809 >> v2:172.21.15.204:3300/0 conn(0x7efe280d1fc0 0x7efe2806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 >> v1:172.21.15.204:6789/0 conn(0x7efe28162100 legacy=0x7efe280d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280d0c30 con 0x7efe280d04e0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7efe200019f0 con 0x7efe280d04e0 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 >> v1:172.21.15.19:6789/0 conn(0x7efe280d04e0 legacy=0x7efe280cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe14003a00 0x7efe14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe14004800 0x7efe14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140051c0 0x7efe1400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.266+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280cc3a0 con 0x7efe14003a00 2024-03-04T08:50:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1400c090 con 0x7efe140051c0 2024-03-04T08:50:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1400c290 con 0x7efe14004800 2024-03-04T08:50:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe14004800 0x7efe14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 -- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140051c0 msgr2=0x7efe1400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe140051c0 0x7efe1400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 -- 172.21.15.19:0/975945809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe14003a00 msgr2=0x7efe14003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2e224640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe14003a00 0x7efe14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe14003a00 0x7efe14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.267+0000 7efe2da23640 1 -- 172.21.15.19:0/975945809 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14003520 con 0x7efe14004800 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.269+0000 7efe2da23640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe14004800 0x7efe14004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe24009ac0 tx=0x7efe14005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd092ca6568be47 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.269+0000 7efe2e224640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe14003a00 0x7efe14003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.269+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24039070 con 0x7efe14004800 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.269+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2402c710 con 0x7efe14004800 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.269+0000 7efe2d222640 1 -- 172.21.15.19:0/975945809 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24009690 con 0x7efe14004800 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.270+0000 7efe2f226640 1 -- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe14004800 msgr2=0x7efe14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.270+0000 7efe2f226640 1 --2- 172.21.15.19:0/975945809 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe14004800 0x7efe14004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe24009ac0 tx=0x7efe14005830 comp rx=0 tx=0).stop 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.271+0000 7efe2ea25640 1 -- 172.21.15.19:0/975945809 reap_dead start 2024-03-04T08:50:49.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.271+0000 7efe2f226640 1 -- 172.21.15.19:0/975945809 shutdown_connections 2024-03-04T08:50:49.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.271+0000 7efe2f226640 1 -- 172.21.15.19:0/975945809 >> 172.21.15.19:0/975945809 conn(0x7efe2809a9f0 msgr2=0x7efe2809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.271+0000 7efe2f226640 1 -- 172.21.15.19:0/975945809 shutdown_connections 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.271+0000 7efe2f226640 1 -- 172.21.15.19:0/975945809 wait complete. 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.273+0000 7efe2f226640 1 Processor -- start 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.273+0000 7efe2f226640 1 -- start start 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2806fb80 0x7efe28164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe281635b0 0x7efe2808b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe281624e0 con 0x7efe2806ff60 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280cc030 con 0x7efe281635b0 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.274+0000 7efe2f226640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe280ccf40 con 0x7efe2806fb80 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37092/0 (socket says 172.21.15.19:37092) 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 -- 172.21.15.19:0/2025349199 learned_addr learned my addr 172.21.15.19:0/2025349199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2ea25640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe281635b0 0x7efe2808b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 -- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2806fb80 msgr2=0x7efe28164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2806fb80 0x7efe28164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 -- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe281635b0 msgr2=0x7efe2808b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe281635b0 0x7efe2808b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 -- 172.21.15.19:0/2025349199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28163db0 con 0x7efe2806ff60 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.275+0000 7efe2da23640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe2402c300 tx=0x7efe24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.277+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24043020 con 0x7efe2806ff60 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.277+0000 7efe2f226640 1 -- 172.21.15.19:0/2025349199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe28164090 con 0x7efe2806ff60 2024-03-04T08:50:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.277+0000 7efe2f226640 1 -- 172.21.15.19:0/2025349199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe28164650 con 0x7efe2806ff60 2024-03-04T08:50:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.281+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe240044c0 con 0x7efe2806ff60 2024-03-04T08:50:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.281+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24039040 con 0x7efe2806ff60 2024-03-04T08:50:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.281+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe24046020 con 0x7efe2806ff60 2024-03-04T08:50:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.282+0000 7efe1effd640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 0x7efe0c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.282+0000 7efe2e224640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 0x7efe0c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.282+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe240ab710 con 0x7efe2806ff60 2024-03-04T08:50:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.283+0000 7efe2e224640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 0x7efe0c06dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe18001650 tx=0x7efe18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.283+0000 7efe2f226640 1 -- 172.21.15.19:0/2025349199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe28163990 con 0x7efe2806ff60 2024-03-04T08:50:49.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.292+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efe2407a600 con 0x7efe2806ff60 2024-03-04T08:50:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.320+0000 7f10a1ac9640 1 Processor -- start 2024-03-04T08:50:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.320+0000 7f10a1ac9640 1 -- start start 2024-03-04T08:50:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f7ce58af640 1 Processor -- start 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f10a1ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42504/0 (socket says 172.21.15.19:42504) 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f109b7fe640 1 -- 172.21.15.19:0/92013213 learned_addr learned my addr 172.21.15.19:0/92013213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/92013213 >> v2:172.21.15.204:3300/0 conn(0x7f1094054260 0x7f10940389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f7ce58af640 1 -- start start 2024-03-04T08:50:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7fc0a9e26640 1 Processor -- start 2024-03-04T08:50:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7fc0a9e26640 1 -- start start 2024-03-04T08:50:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10940503a0 con 0x7f10940df410 2024-03-04T08:50:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1094006890 con 0x7f1094054260 2024-03-04T08:50:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1094006ae0 con 0x7f109404fa80 2024-03-04T08:50:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.322+0000 7f109bfff640 1 --2- 172.21.15.19:0/92013213 >> v2:172.21.15.204:3300/0 conn(0x7f1094054260 0x7f10940389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7ff22a93a640 1 Processor -- start 2024-03-04T08:50:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7ff22a93a640 1 -- start start 2024-03-04T08:50:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7ce58af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd8005e80 0x7f7cd80062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f109b7fe640 1 -- 172.21.15.19:0/92013213 >> v2:172.21.15.204:3300/0 conn(0x7f1094054260 msgr2=0x7f10940389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f109b7fe640 1 --2- 172.21.15.19:0/92013213 >> v2:172.21.15.204:3300/0 conn(0x7f1094054260 0x7f10940389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f109b7fe640 1 -- 172.21.15.19:0/92013213 >> v1:172.21.15.19:6789/0 conn(0x7f10940df410 legacy=0x7f10940382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7ce58af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cd8006800 0x7f7cd8006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f109b7fe640 1 -- 172.21.15.19:0/92013213 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094006dc0 con 0x7f109404fa80 2024-03-04T08:50:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7ce58af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd8053710 con 0x7f7cd80eacf0 2024-03-04T08:50:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7ce58af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd8054320 con 0x7f7cd8006800 2024-03-04T08:50:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7ce58af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80539f0 con 0x7f7cd8005e80 2024-03-04T08:50:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7cdeffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7cd80eacf0 0x7f7cd804fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42914/0 (socket says 172.21.15.19:42914) 2024-03-04T08:50:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7f7cdeffd640 1 -- 172.21.15.19:0/183924284 learned_addr learned my addr 172.21.15.19:0/183924284 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:49.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7fc0a9e26640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c0552f0 0x7fc09c0068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7fc0a9e26640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0387d0 con 0x7fc09c0ebb40 2024-03-04T08:50:49.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7fc0a9e26640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c056d80 con 0x7fc09c0eb050 2024-03-04T08:50:49.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7fc0a9e26640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c057e20 con 0x7fc09c0552f0 2024-03-04T08:50:49.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.323+0000 7fc0a3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc09c0ebb40 0x7fc09c006190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42916/0 (socket says 172.21.15.19:42916) 2024-03-04T08:50:49.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121323379 0 0) 0x7f7cd8053710 con 0x7f7cd80eacf0 2024-03-04T08:50:49.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc8003520 con 0x7f7cd80eacf0 2024-03-04T08:50:49.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a3fff640 1 -- 172.21.15.19:0/3740314295 learned_addr learned my addr 172.21.15.19:0/3740314295 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:49.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cdf7fe640 1 --2- 172.21.15.19:0/183924284 >> v2:172.21.15.19:3300/0 conn(0x7f7cd8006800 0x7f7cd8006c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134559732 0 0) 0x7fc090001110 con 0x7fc09c0ebb40 2024-03-04T08:50:49.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094003520 con 0x7fc09c0ebb40 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22965739 0 0) 0x7f7cc8003520 con 0x7f7cd80eacf0 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd8005e80 msgr2=0x7f7cd80062c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd8005e80 0x7f7cd80062c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 >> v2:172.21.15.19:3300/0 conn(0x7f7cd8006800 msgr2=0x7f7cd8006c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 --2- 172.21.15.19:0/183924284 >> v2:172.21.15.19:3300/0 conn(0x7f7cd8006800 0x7f7cd8006c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8053cd0 con 0x7f7cd80eacf0 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f7ce004fb80 con 0x7f7cd80eacf0 2024-03-04T08:50:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 >> v1:172.21.15.19:6789/0 conn(0x7f7cd80eacf0 legacy=0x7f7cd804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8054320 con 0x7f7cc8004800 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80539f0 con 0x7f7cc80051c0 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc800bfe0 con 0x7f7cc80039b0 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdf7fe640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7ff22a93a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2240cc920 0x7ff22415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7ff22a93a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff22406e000 0x7ff224072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff223fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2240cc920 0x7ff22415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff22a93a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22406e770 con 0x7ff2240b4a50 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff223fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2240cc920 0x7ff22415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51452/0 (socket says 172.21.15.19:51452) 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff223fff640 1 -- 172.21.15.19:0/364051605 learned_addr learned my addr 172.21.15.19:0/364051605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2405313859 0 0) 0x7fc094003520 con 0x7fc09c0ebb40 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c0552f0 msgr2=0x7fc09c0068a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c0552f0 0x7fc09c0068a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 >> v1:172.21.15.204:6789/0 conn(0x7fc09c0eb050 legacy=0x7fc09c0eb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c057060 con 0x7fc09c0ebb40 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fc090001840 con 0x7fc09c0ebb40 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 >> v1:172.21.15.19:6789/0 conn(0x7fc09c0ebb40 legacy=0x7fc09c006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0940039e0 0x7fc094003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.324+0000 7f109b7fe640 1 --2- 172.21.15.19:0/92013213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1090009870 tx=0x7f109002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f6265038c2ae63 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f456e48b640 1 Processor -- start 2024-03-04T08:50:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc094004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f109a7fc640 1 -- 172.21.15.19:0/92013213 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090034070 con 0x7f109404fa80 2024-03-04T08:50:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0940053c0 0x7fc09400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f109a7fc640 1 -- 172.21.15.19:0/92013213 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1090030860 con 0x7f109404fa80 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdeffd640 1 -- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7cc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdeffd640 1 -- 172.21.15.19:0/183924284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc8004800 msgr2=0x7f7cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cdeffd640 1 -- 172.21.15.19:0/183924284 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8053cd0 con 0x7f7cc80039b0 2024-03-04T08:50:49.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400c200 con 0x7fc0940053c0 2024-03-04T08:50:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400c3b0 con 0x7fc094004800 2024-03-04T08:50:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400c5b0 con 0x7fc0940039e0 2024-03-04T08:50:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff22a93a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22415e660 con 0x7ff22406e000 2024-03-04T08:50:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22406e490 con 0x7ff2240cc920 2024-03-04T08:50:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cbffff640 1 Processor -- start 2024-03-04T08:50:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f7cbffff640 1 -- start start 2024-03-04T08:50:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f109a7fc640 1 -- 172.21.15.19:0/92013213 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090030c30 con 0x7f109404fa80 2024-03-04T08:50:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a9625640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0940053c0 0x7fc09400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc094004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a8e24640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0940039e0 0x7fc094003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0000b60 tx=0x7f7cc8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe9859a58e16fcb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 msgr2=0x7f109404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00b4070 con 0x7f7cc80039b0 2024-03-04T08:50:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00a7d20 con 0x7f7cc80039b0 2024-03-04T08:50:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cddffb640 1 -- 172.21.15.19:0/183924284 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0068fd0 con 0x7f7cc80039b0 2024-03-04T08:50:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/92013213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1090009870 tx=0x7f109002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.325+0000 7f456e48b640 1 -- start start 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f456e48b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 0x7f456004fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f456e48b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4560006a50 0x7f4560006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f456e48b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4560054c10 con 0x7f456004b3c0 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f456e48b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600062e0 con 0x7f4560006a50 2024-03-04T08:50:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f456e48b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560050120 con 0x7f4560034020 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 shutdown_connections 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/92013213 >> v2:172.21.15.204:3300/0 conn(0x7f1094054260 0x7f10940389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7ff223fff640 1 -- 172.21.15.19:0/364051605 >> v2:172.21.15.19:3300/0 conn(0x7ff22406e000 msgr2=0x7ff224072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7ff223fff640 1 --2- 172.21.15.19:0/364051605 >> v2:172.21.15.19:3300/0 conn(0x7ff22406e000 0x7ff224072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7ff223fff640 1 -- 172.21.15.19:0/364051605 >> v1:172.21.15.19:6789/0 conn(0x7ff2240b4a50 legacy=0x7ff224150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7ff223fff640 1 -- 172.21.15.19:0/364051605 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22415e010 con 0x7ff2240cc920 2024-03-04T08:50:49.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/92013213 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f109404fe60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 >> 172.21.15.19:0/92013213 conn(0x7f1094009fa0 msgr2=0x7f109400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cbffff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7cb80e1060 0x7f7cb8054db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4560006a50 0x7f4560006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4560006a50 0x7f4560006e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37126/0 (socket says 172.21.15.19:37126) 2024-03-04T08:50:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 -- 172.21.15.19:0/306282369 learned_addr learned my addr 172.21.15.19:0/306282369 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cbffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cb80521c0 0x7f7cb8039e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456cc88640 1 --2- 172.21.15.19:0/306282369 >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 0x7f456004fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cbffff640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80e1440 con 0x7f7cb803ca20 2024-03-04T08:50:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cbffff640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb8056330 con 0x7f7cb80521c0 2024-03-04T08:50:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7f7cbffff640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb8055720 con 0x7f7cb80e1060 2024-03-04T08:50:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a3fff640 1 -- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0940039e0 msgr2=0x7fc094003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 -- 172.21.15.19:0/306282369 >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 msgr2=0x7f456004fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0940039e0 0x7fc094003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7cbeffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7cb80e1060 0x7f7cb8054db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7cbeffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7cb80e1060 0x7f7cb8054db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51478/0 (socket says 172.21.15.19:51478) 2024-03-04T08:50:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1570799391 learned_addr learned my addr 172.21.15.19:0/1570799391 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7cbe7fc640 1 --1- 172.21.15.19:0/1570799391 >> v1:172.21.15.19:6789/0 conn(0x7f7cb803ca20 0x7f7cb8051ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42928/0 (socket says 172.21.15.19:42928) 2024-03-04T08:50:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7cbf7fe640 1 --2- 172.21.15.19:0/1570799391 >> v2:172.21.15.19:3300/0 conn(0x7f7cb80521c0 0x7f7cb8039e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 --2- 172.21.15.19:0/306282369 >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 0x7f456004fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 -- 172.21.15.19:0/306282369 >> v1:172.21.15.19:6789/0 conn(0x7f456004b3c0 legacy=0x7f456004f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a3fff640 1 -- 172.21.15.19:0/3740314295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0940053c0 msgr2=0x7fc09400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0940053c0 0x7fc09400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.326+0000 7fc0a3fff640 1 -- 172.21.15.19:0/3740314295 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094003520 con 0x7fc094004800 2024-03-04T08:50:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc094004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c2f0 tx=0x7fc094005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9d7a7f1134ab113 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7ce58af640 1 -- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cc80039b0 msgr2=0x7f7cc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f7ce58af640 1 --2- 172.21.15.19:0/183924284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0000b60 tx=0x7f7cc8005830 comp rx=0 tx=0).stop 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7cdf7fe640 1 -- 172.21.15.19:0/183924284 reap_dead start 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7ff223fff640 1 --2- 172.21.15.19:0/364051605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2240cc920 0x7ff22415eaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2240737d0 tx=0x7ff21402e0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd12f227d96746b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7ff222ffd640 1 -- 172.21.15.19:0/364051605 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21403b070 con 0x7ff2240cc920 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7ff222ffd640 1 -- 172.21.15.19:0/364051605 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214036440 con 0x7ff2240cc920 2024-03-04T08:50:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7ff222ffd640 1 -- 172.21.15.19:0/364051605 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214036810 con 0x7ff2240cc920 2024-03-04T08:50:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090007e10 con 0x7fc094004800 2024-03-04T08:50:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7ce58af640 1 -- 172.21.15.19:0/183924284 shutdown_connections 2024-03-04T08:50:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7ce58af640 1 -- 172.21.15.19:0/183924284 >> 172.21.15.19:0/183924284 conn(0x7f7cd8009fa0 msgr2=0x7f7cd800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7fc0a37fe640 1 -- 172.21.15.19:0/3740314295 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090030070 con 0x7fc094004800 2024-03-04T08:50:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 shutdown_connections 2024-03-04T08:50:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7ce58af640 1 -- 172.21.15.19:0/183924284 shutdown_connections 2024-03-04T08:50:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.327+0000 7f456dc8a640 1 -- 172.21.15.19:0/306282369 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560053a50 con 0x7f4560006a50 2024-03-04T08:50:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f456cc88640 1 --2- 172.21.15.19:0/306282369 >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 0x7f456004fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2240cc920 msgr2=0x7ff22415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1570799391 >> v2:172.21.15.19:3300/0 conn(0x7f7cb80521c0 msgr2=0x7f7cb8039e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7cbeffd640 1 --2- 172.21.15.19:0/1570799391 >> v2:172.21.15.19:3300/0 conn(0x7f7cb80521c0 0x7f7cb8039e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1570799391 >> v1:172.21.15.19:6789/0 conn(0x7f7cb803ca20 legacy=0x7f7cb8051ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1570799391 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8055a00 con 0x7f7cb80e1060 2024-03-04T08:50:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7ff22a93a640 1 --2- 172.21.15.19:0/364051605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2240cc920 0x7ff22415eaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2240737d0 tx=0x7ff21402e0f0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f10a1ac9640 1 -- 172.21.15.19:0/92013213 wait complete. 2024-03-04T08:50:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 -- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 msgr2=0x7fc094004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 --2- 172.21.15.19:0/3740314295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc094004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c2f0 tx=0x7fc094005830 comp rx=0 tx=0).stop 2024-03-04T08:50:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9625640 1 -- 172.21.15.19:0/3740314295 reap_dead start 2024-03-04T08:50:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 shutdown_connections 2024-03-04T08:50:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 --2- 172.21.15.19:0/364051605 >> v2:172.21.15.19:3300/0 conn(0x7ff22406e000 0x7ff224072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 -- 172.21.15.19:0/3740314295 shutdown_connections 2024-03-04T08:50:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 -- 172.21.15.19:0/3740314295 >> 172.21.15.19:0/3740314295 conn(0x7fc09c0559d0 msgr2=0x7fc09c055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 --2- 172.21.15.19:0/364051605 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2240cc920 0x7ff22415eaf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 >> 172.21.15.19:0/364051605 conn(0x7ff2240b1c80 msgr2=0x7ff2240cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.328+0000 7f7ce58af640 1 -- 172.21.15.19:0/183924284 wait complete. 2024-03-04T08:50:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 -- 172.21.15.19:0/3740314295 shutdown_connections 2024-03-04T08:50:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7fc0a9e26640 1 -- 172.21.15.19:0/3740314295 wait complete. 2024-03-04T08:50:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 shutdown_connections 2024-03-04T08:50:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7ff22a93a640 1 -- 172.21.15.19:0/364051605 wait complete. 2024-03-04T08:50:49.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7f456dc8a640 1 --2- 172.21.15.19:0/306282369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560006a50 0x7f4560006e80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4560006460 tx=0x7f45680a6940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7523a8ff1d93cf server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.329+0000 7f10a1ac9640 1 Processor -- start 2024-03-04T08:50:49.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f7ce58af640 1 Processor -- start 2024-03-04T08:50:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f10a1ac9640 1 -- start start 2024-03-04T08:50:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f455ffff640 1 -- 172.21.15.19:0/306282369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45680af020 con 0x7f4560006a50 2024-03-04T08:50:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f455ffff640 1 -- 172.21.15.19:0/306282369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45680ab920 con 0x7f4560006a50 2024-03-04T08:50:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f7cbeffd640 1 --2- 172.21.15.19:0/1570799391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb80e1060 0x7f7cb8054db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800ae80 tx=0x7f7cb002b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d40f9635467b993 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f455ffff640 1 -- 172.21.15.19:0/306282369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45680abdd0 con 0x7f4560006a50 2024-03-04T08:50:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.330+0000 7f7ce58af640 1 -- start start 2024-03-04T08:50:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f7ce58af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f7ce58af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd80393c0 0x7f7cd80e87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f109affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f109b7fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42548/0 (socket says 172.21.15.19:42548) 2024-03-04T08:50:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f109affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37136/0 (socket says 172.21.15.19:37136) 2024-03-04T08:50:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f7cdeffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f7cdeffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51480/0 (socket says 172.21.15.19:51480) 2024-03-04T08:50:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f7cdeffd640 1 -- 172.21.15.19:0/2920792841 learned_addr learned my addr 172.21.15.19:0/2920792841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940546f0 con 0x7f1094054260 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1094007380 con 0x7f10940df410 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f10a1ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1094054870 con 0x7f109404fa80 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.331+0000 7f456e48b640 1 -- 172.21.15.19:0/306282369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560006a50 msgr2=0x7f4560006e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 --2- 172.21.15.19:0/306282369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560006a50 0x7f4560006e80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4560006460 tx=0x7f45680a6940 comp rx=0 tx=0).stop 2024-03-04T08:50:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7fc0a9e26640 1 Processor -- start 2024-03-04T08:50:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51486/0 (socket says 172.21.15.19:51486) 2024-03-04T08:50:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 -- 172.21.15.19:0/2503596492 learned_addr learned my addr 172.21.15.19:0/2503596492 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7ff22a93a640 1 Processor -- start 2024-03-04T08:50:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7ff6d533e640 1 Processor -- start 2024-03-04T08:50:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7fc0a9e26640 1 -- start start 2024-03-04T08:50:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7ff6d533e640 1 -- start start 2024-03-04T08:50:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 -- 172.21.15.19:0/306282369 shutdown_connections 2024-03-04T08:50:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 --2- 172.21.15.19:0/306282369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560006a50 0x7f4560006e80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 --2- 172.21.15.19:0/306282369 >> v2:172.21.15.204:3300/0 conn(0x7f4560034020 0x7f456004fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 -- 172.21.15.19:0/306282369 >> 172.21.15.19:0/306282369 conn(0x7f456000a400 msgr2=0x7f456000a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cde7fc640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd80393c0 0x7f7cd80e87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8039840 0x7f7cd80e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80547b0 con 0x7f7cd8039840 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8050190 con 0x7f7cc80039b0 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8054930 con 0x7f7cd80393c0 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7ff22a93a640 1 -- start start 2024-03-04T08:50:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 -- 172.21.15.19:0/306282369 shutdown_connections 2024-03-04T08:50:49.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdf7fe640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8039840 0x7f7cd80e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f456e48b640 1 -- 172.21.15.19:0/306282369 wait complete. 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdeffd640 1 -- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd80393c0 msgr2=0x7f7cd80e87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd80393c0 0x7f7cd80e87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdeffd640 1 -- 172.21.15.19:0/2920792841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8039840 msgr2=0x7f7cd80e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8039840 0x7f7cd80e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f7cdeffd640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80e9510 con 0x7f7cc80039b0 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6d533e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6d00d21b0 0x7ff6d0166df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6d533e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d00b2d80 con 0x7ff6d00d04e0 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6d533e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d00ae9c0 con 0x7ff6d015bed0 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6d533e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d00aeca0 con 0x7ff6d00d21b0 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f7cdeffd640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0062b90 tx=0x7f7ce0069a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 -- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 msgr2=0x7f10940483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 -- 172.21.15.19:0/2503596492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 msgr2=0x7f10940d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.332+0000 7f109bfff640 1 -- 172.21.15.19:0/2503596492 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940d4c00 con 0x7f10940df410 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f109affd640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f109b7fe640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6ce7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6d00d04e0 0x7ff6d00d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42946/0 (socket says 172.21.15.19:42946) 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6ce7fc640 1 -- 172.21.15.19:0/3278064452 learned_addr learned my addr 172.21.15.19:0/3278064452 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/3278064452 >> v2:172.21.15.19:3300/0 conn(0x7ff6d00d21b0 0x7ff6d0166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f7cbdffb640 1 -- 172.21.15.19:0/1570799391 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0034070 con 0x7f7cb80e1060 2024-03-04T08:50:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f7cbdffb640 1 -- 172.21.15.19:0/1570799391 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0030870 con 0x7f7cb80e1060 2024-03-04T08:50:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7f7cbdffb640 1 -- 172.21.15.19:0/1570799391 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0030c40 con 0x7f7cb80e1060 2024-03-04T08:50:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff22a93a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff22a93a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 0x7ff22415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7fc0a9e26640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cdffb640 1 -- 172.21.15.19:0/3278064452 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177161114 0 0) 0x7ff6d00ae9c0 con 0x7ff6d015bed0 2024-03-04T08:50:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cdffb640 1 -- 172.21.15.19:0/3278064452 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b8003520 con 0x7ff6d015bed0 2024-03-04T08:50:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/3278064452 >> v1:172.21.15.204:6789/0 conn(0x7ff6d015bed0 legacy=0x7ff6d00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/3278064452 >> v1:172.21.15.19:6789/0 conn(0x7ff6d00d04e0 legacy=0x7ff6d00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff223fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff223fff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42566/0 (socket says 172.21.15.19:42566) 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff223fff640 1 -- 172.21.15.19:0/1627818462 learned_addr learned my addr 172.21.15.19:0/1627818462 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9e26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 0x7fc09c0526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 0x7ff224151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff2237fe640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 0x7ff22415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51490/0 (socket says 172.21.15.19:51490) 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 -- 172.21.15.19:0/19084231 learned_addr learned my addr 172.21.15.19:0/19084231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9e26640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 0x7fc09c04ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9e26640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c055780 con 0x7fc09c050fa0 2024-03-04T08:50:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240cce80 con 0x7ff2240cc920 2024-03-04T08:50:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f456e48b640 1 Processor -- start 2024-03-04T08:50:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9e26640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c057990 con 0x7fc094004800 2024-03-04T08:50:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff228ed7640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 0x7ff224151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f456e48b640 1 -- start start 2024-03-04T08:50:49.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9625640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 0x7fc09c04ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.333+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/3278064452 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00aef80 con 0x7ff6d00d21b0 2024-03-04T08:50:49.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a9e26640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c057620 con 0x7fc09c052be0 2024-03-04T08:50:49.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240ccd00 con 0x7ff22415b2a0 2024-03-04T08:50:49.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 -- 172.21.15.19:0/1570799391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb80e1060 msgr2=0x7f7cb8054db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1570799391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb80e1060 0x7f7cb8054db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800ae80 tx=0x7f7cb002b9b0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff224070940 con 0x7ff2240b4a50 2024-03-04T08:50:49.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 -- 172.21.15.19:0/1570799391 shutdown_connections 2024-03-04T08:50:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1570799391 >> v2:172.21.15.19:3300/0 conn(0x7f7cb80521c0 0x7f7cb8039e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f109bfff640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f108800d580 tx=0x7f108800da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1570799391 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb80e1060 0x7f7cb8054db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 0x7fc09c0526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cbffff640 1 -- 172.21.15.19:0/1570799391 >> 172.21.15.19:0/1570799391 conn(0x7f7cb8056ce0 msgr2=0x7f7cb80570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 -- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 msgr2=0x7fc09c04ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 0x7fc09c04ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7fc0a8e24640 1 -- 172.21.15.19:0/19084231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 msgr2=0x7fc09c0526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7f7cbffff640 1 -- 172.21.15.19:0/1570799391 shutdown_connections 2024-03-04T08:50:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7f7cbffff640 1 -- 172.21.15.19:0/1570799391 wait complete. 2024-03-04T08:50:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7fc0a8e24640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 0x7fc09c0526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00b4040 con 0x7f7cc80039b0 2024-03-04T08:50:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce0050220 con 0x7f7cc80039b0 2024-03-04T08:50:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce004fb80 con 0x7f7cc80039b0 2024-03-04T08:50:49.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd80e9230 con 0x7f7cc80039b0 2024-03-04T08:50:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 -- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 msgr2=0x7ff224151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 0x7ff224151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 -- 172.21.15.19:0/1627818462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 msgr2=0x7ff22415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7fc0a8e24640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c171c70 con 0x7fc094004800 2024-03-04T08:50:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7fc0a9625640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 0x7fc09c04ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff228ed7640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 0x7ff224151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.334+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd80e6f20 con 0x7f7cc80039b0 2024-03-04T08:50:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 0x7fc09c0526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 0x7ff22415ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2241efd60 con 0x7ff2240b4a50 2024-03-04T08:50:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/3278064452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d00d21b0 0x7ff6d0166df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c54924677634bb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff2237fe640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 0x7ff22415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7ff223fff640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b2c0 tx=0x7ff2140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880125f0 con 0x7f10940df410 2024-03-04T08:50:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088019070 con 0x7f10940df410 2024-03-04T08:50:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.335+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880129f0 con 0x7f10940df410 2024-03-04T08:50:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10940d4ee0 con 0x7f10940df410 2024-03-04T08:50:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940e10d0 con 0x7f10940df410 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8005380 con 0x7f7cc80039b0 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ce00c1030 con 0x7f7cc80039b0 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f456e48b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f456e48b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f456d489640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456d489640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51502/0 (socket says 172.21.15.19:51502) 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456cc88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456cc88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37186/0 (socket says 172.21.15.19:37186) 2024-03-04T08:50:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456d489640 1 -- 172.21.15.19:0/303747164 learned_addr learned my addr 172.21.15.19:0/303747164 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f456004b3c0 0x7f45600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456004b7a0 con 0x7f4560034020 2024-03-04T08:50:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560006530 con 0x7f4560006a50 2024-03-04T08:50:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4560054830 con 0x7f456004b3c0 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7f7cbffff640 1 Processor -- start 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f7cbffff640 1 -- start start 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7fc0a8e24640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e460 tx=0x7fc09800e920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098019070 con 0x7fc094004800 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980052e0 con 0x7fc094004800 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7fc0a9e26640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c171f50 con 0x7fc094004800 2024-03-04T08:50:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7fc0a9e26640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c172510 con 0x7fc094004800 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7ff6cdffb640 1 -- 172.21.15.19:0/3278064452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8039070 con 0x7ff6d00d21b0 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7ff6cdffb640 1 -- 172.21.15.19:0/3278064452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c802cbe0 con 0x7ff6d00d21b0 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7ff6cdffb640 1 -- 172.21.15.19:0/3278064452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8034440 con 0x7ff6d00d21b0 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214046020 con 0x7ff2240b4a50 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f7cc7fff640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 0x7f7ccc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ce0126130 con 0x7f7cc80039b0 2024-03-04T08:50:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10940e0f00 con 0x7f10940df410 2024-03-04T08:50:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.336+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214034950 con 0x7ff2240b4a50 2024-03-04T08:50:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21403b040 con 0x7ff2240b4a50 2024-03-04T08:50:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2241f0040 con 0x7ff2240b4a50 2024-03-04T08:50:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7f7cde7fc640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 0x7f7ccc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456dc8a640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f456004b3c0 0x7f45600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2241f0600 con 0x7ff2240b4a50 2024-03-04T08:50:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 -- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f456004b3c0 msgr2=0x7f45600ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f456004b3c0 0x7f45600ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 -- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 msgr2=0x7f45600cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.337+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098019070 con 0x7fc094004800 2024-03-04T08:50:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560039420 con 0x7f4560034020 2024-03-04T08:50:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7ff6d533e640 1 -- 172.21.15.19:0/3278064452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d00d21b0 msgr2=0x7ff6d0166df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7ff6d533e640 1 --2- 172.21.15.19:0/3278064452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d00d21b0 0x7ff6d0166df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802be30 comp rx=0 tx=0).stop 2024-03-04T08:50:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456d489640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb80521c0 0x7f7cb8035bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456cc88640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f455800c820 tx=0x7f455800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbeffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbeffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:51516/0 (socket says 172.21.15.19:51516) 2024-03-04T08:50:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1398183059 learned_addr learned my addr 172.21.15.19:0/1398183059 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cb80e1060 0x7f7cb800e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cde7fc640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 0x7f7ccc06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80067d0 tx=0x7f7cd40090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80552f0 con 0x7f7cb80521c0 2024-03-04T08:50:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558015070 con 0x7f4560034020 2024-03-04T08:50:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbf7fe640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cb80e1060 0x7f7cb800e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8055fc0 con 0x7f7cb803ca20 2024-03-04T08:50:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8055470 con 0x7f7cb80e1060 2024-03-04T08:50:49.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbe7fc640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb80521c0 0x7f7cb8035bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1088012b90 con 0x7f10940df410 2024-03-04T08:50:49.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f1087fff640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 0x7f108006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f108808b090 con 0x7f10940df410 2024-03-04T08:50:49.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7ff6d533e640 1 -- 172.21.15.19:0/3278064452 shutdown_connections 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7ff6d533e640 1 --2- 172.21.15.19:0/3278064452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d00d21b0 0x7ff6d0166df0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7ff6d533e640 1 -- 172.21.15.19:0/3278064452 >> 172.21.15.19:0/3278064452 conn(0x7ff6d009a9f0 msgr2=0x7ff6d009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cb80e1060 msgr2=0x7f7cb800e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cb80e1060 0x7f7cb800e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1398183059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb80521c0 msgr2=0x7f7cb8035bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb80521c0 0x7f7cb8035bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb800ea50 con 0x7f7cb803ca20 2024-03-04T08:50:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f109b7fe640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 0x7f108006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4560039700 con 0x7f4560034020 2024-03-04T08:50:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560039cc0 con 0x7f4560034020 2024-03-04T08:50:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800ce10 con 0x7f4560034020 2024-03-04T08:50:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.339+0000 7f7cbeffd640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cb002bfc0 tx=0x7f7cb00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455801e060 con 0x7f4560034020 2024-03-04T08:50:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff214049020 con 0x7ff2240b4a50 2024-03-04T08:50:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.338+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c007cc0 con 0x7fc094004800 2024-03-04T08:50:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7f109b7fe640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 0x7f108006da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1090036000 tx=0x7f109003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff6d533e640 1 -- 172.21.15.19:0/3278064452 shutdown_connections 2024-03-04T08:50:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff6d533e640 1 -- 172.21.15.19:0/3278064452 wait complete. 2024-03-04T08:50:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22404f330 con 0x7ff2240b4a50 2024-03-04T08:50:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff220ff9640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 0x7ff21006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2140af160 con 0x7ff2240b4a50 2024-03-04T08:50:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7ff2237fe640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 0x7ff21006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.340+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4548005290 con 0x7f4560034020 2024-03-04T08:50:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.341+0000 7ff2237fe640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 0x7ff21006d9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff22415a160 tx=0x7ff21c009570 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.341+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4558007830 con 0x7f4560034020 2024-03-04T08:50:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.341+0000 7f455dffb640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 0x7f454c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7f456d489640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 0x7f454c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f455808a280 con 0x7f4560034020 2024-03-04T08:50:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7ff6d533e640 1 Processor -- start 2024-03-04T08:50:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7ff6d533e640 1 -- start start 2024-03-04T08:50:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7f456d489640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 0x7f454c06d9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4564007fd0 tx=0x7f4564009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7ff6d533e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 0x7ff6d0157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.342+0000 7ff6d533e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6d00d21b0 0x7ff6d015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6d533e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 0x7ff6d015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 0x7ff6d0157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 0x7ff6d0157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:42596/0 (socket says 172.21.15.19:42596) 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6ceffd640 1 -- 172.21.15.19:0/2448792308 learned_addr learned my addr 172.21.15.19:0/2448792308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6ce7fc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6d00d21b0 0x7ff6d015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 0x7ff6d015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d015c2b0 con 0x7ff6d015bed0 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00b0790 con 0x7ff6d00d21b0 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00cc330 con 0x7ff6d00d04e0 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 msgr2=0x7ff6d0157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 0x7ff6d0157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6d00d21b0 msgr2=0x7ff6d015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6d00d21b0 0x7ff6d015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00cb310 con 0x7ff6d015bed0 2024-03-04T08:50:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7ff6cf7fe640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 0x7ff6d015e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8033000 tx=0x7ff6c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.343+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7ce00c8020 con 0x7f7cc80039b0 2024-03-04T08:50:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.344+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0034040 con 0x7f7cb803ca20 2024-03-04T08:50:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.344+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8047e60 con 0x7f7cb803ca20 2024-03-04T08:50:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.344+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8048420 con 0x7f7cb803ca20 2024-03-04T08:50:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.345+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb8005390 con 0x7f7cb803ca20 2024-03-04T08:50:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.345+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc09801c070 con 0x7fc094004800 2024-03-04T08:50:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.345+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff214050030 con 0x7ff2240b4a50 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.346+0000 7fc0a17fa640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 0x7fc08806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.346+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 0x7fc08806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.347+0000 7fc0a3fff640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 0x7fc08806dd90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc090034000 tx=0x7fc090007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8044020 con 0x7ff6d015bed0 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c803f470 con 0x7ff6d015bed0 2024-03-04T08:50:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8039040 con 0x7ff6d015bed0 2024-03-04T08:50:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4558058ab0 con 0x7f4560034020 2024-03-04T08:50:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00cb5f0 con 0x7ff6d015bed0 2024-03-04T08:50:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.350+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d006c0c0 con 0x7ff6d015bed0 2024-03-04T08:50:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.351+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d004f330 con 0x7ff6d015bed0 2024-03-04T08:50:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.352+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6c8047020 con 0x7ff6d015bed0 2024-03-04T08:50:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.352+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0030870 con 0x7f7cb803ca20 2024-03-04T08:50:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.352+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0051060 con 0x7f7cb803ca20 2024-03-04T08:50:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.353+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f108803c030 con 0x7f10940df410 2024-03-04T08:50:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.353+0000 7ff6b77fe640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 0x7ff6bc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.353+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c80ad100 con 0x7ff6d015bed0 2024-03-04T08:50:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.353+0000 7ff6ceffd640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 0x7ff6bc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.354+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc098010040 con 0x7fc094004800 2024-03-04T08:50:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.354+0000 7ff6ceffd640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 0x7ff6bc06d9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4007fd0 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.357+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc09c007cc0 con 0x7fc094004800 2024-03-04T08:50:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.358+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7cb0037070 con 0x7f7cb803ca20 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.359+0000 7f7ca77fe640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 0x7f7cac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.359+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb00ac870 con 0x7f7cb803ca20 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.359+0000 7f7cbe7fc640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 0x7f7cac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.360+0000 7f7cbe7fc640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 0x7f7cac06d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800aca0 tx=0x7f7cb4000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.361+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7cb003e070 con 0x7f7cb803ca20 2024-03-04T08:50:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.361+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff6c804e030 con 0x7ff6d015bed0 2024-03-04T08:50:49.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.697+0000 7efe2f226640 1 -- 172.21.15.19:0/2025349199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efe28068f80 con 0x7efe2806ff60 2024-03-04T08:50:49.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.698+0000 7efe1effd640 1 -- 172.21.15.19:0/2025349199 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe24079f00 con 0x7efe2806ff60 2024-03-04T08:50:49.694 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.701+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 msgr2=0x7efe0c06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.701+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 0x7efe0c06dac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe18001650 tx=0x7efe18009040 comp rx=0 tx=0).stop 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.701+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 msgr2=0x7efe28163070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.701+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe2402c300 tx=0x7efe24004730 comp rx=0 tx=0).stop 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.701+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 shutdown_connections 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efe0c06b600 0x7efe0c06dac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efe281635b0 0x7efe2808b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2806ff60 0x7efe28163070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 --2- 172.21.15.19:0/2025349199 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efe2806fb80 0x7efe28164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 >> 172.21.15.19:0/2025349199 conn(0x7efe2809a9f0 msgr2=0x7efe2814c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 shutdown_connections 2024-03-04T08:50:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.702+0000 7efe1cff9640 1 -- 172.21.15.19:0/2025349199 wait complete. 2024-03-04T08:50:49.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-03-04T08:50:49.715 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.745+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6d01587c0 con 0x7ff6d015bed0 2024-03-04T08:50:49.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.745+0000 7ff6b77fe640 1 -- 172.21.15.19:0/2448792308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6c807ba30 con 0x7ff6d015bed0 2024-03-04T08:50:49.741 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 msgr2=0x7ff6bc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 0x7ff6bc06d9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4007fd0 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 msgr2=0x7ff6d015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 0x7ff6d015e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8033000 tx=0x7ff6c8004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 shutdown_connections 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d015bed0 0x7ff6d015e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff6bc06b520 0x7ff6bc06d9e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff6d00d21b0 0x7ff6d015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 --2- 172.21.15.19:0/2448792308 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff6d00d04e0 0x7ff6d0157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.747+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 >> 172.21.15.19:0/2448792308 conn(0x7ff6d009a9f0 msgr2=0x7ff6d00704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.748+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 shutdown_connections 2024-03-04T08:50:49.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.748+0000 7ff6d533e640 1 -- 172.21.15.19:0/2448792308 wait complete. 2024-03-04T08:50:49.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-03-04T08:50:49.755 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.770+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7cd8034110 con 0x7f7cc80039b0 2024-03-04T08:50:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.771+0000 7f7cc7fff640 1 -- 172.21.15.19:0/2920792841 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cd80e9510 con 0x7f7cc80039b0 2024-03-04T08:50:49.767 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-04T08:50:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 msgr2=0x7f7ccc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 0x7f7ccc06da60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80067d0 tx=0x7f7cd40090e0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 msgr2=0x7f7cd80d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0062b90 tx=0x7f7ce0069a60 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 shutdown_connections 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cd8039840 0x7f7cd80e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cd80393c0 0x7f7cd80e87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7ccc06b5a0 0x7f7ccc06da60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 --2- 172.21.15.19:0/2920792841 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cc80039b0 0x7f7cd80d0950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 >> 172.21.15.19:0/2920792841 conn(0x7f7cd8009fa0 msgr2=0x7f7cd80ea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 shutdown_connections 2024-03-04T08:50:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f7ce58af640 1 -- 172.21.15.19:0/2920792841 wait complete. 2024-03-04T08:50:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff22415ee10 con 0x7ff2240b4a50 2024-03-04T08:50:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7ff220ff9640 1 -- 172.21.15.19:0/1627818462 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff21407e150 con 0x7ff2240b4a50 2024-03-04T08:50:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.774+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4548005850 con 0x7f4560034020 2024-03-04T08:50:49.772 INFO:teuthology.orchestra.run.smithi019.stdout:55834574853 2024-03-04T08:50:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.775+0000 7f455dffb640 1 -- 172.21.15.19:0/303747164 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f455805cb50 con 0x7f4560034020 2024-03-04T08:50:49.773 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-03-04T08:50:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.776+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f10940d35d0 con 0x7f10940df410 2024-03-04T08:50:49.774 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-03-04T08:50:49.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7f1087fff640 1 -- 172.21.15.19:0/2503596492 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1088059ef0 con 0x7f10940df410 2024-03-04T08:50:49.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 msgr2=0x7ff21006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 0x7ff21006d9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff22415a160 tx=0x7ff21c009570 comp rx=0 tx=0).stop 2024-03-04T08:50:49.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 msgr2=0x7ff22414c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b2c0 tx=0x7ff2140046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 shutdown_connections 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff21006b520 0x7ff21006d9e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff22415b2a0 0x7ff224151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2240cc920 0x7ff22415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.777+0000 7ff22a93a640 1 --2- 172.21.15.19:0/1627818462 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2240b4a50 0x7ff22414c3b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 >> 172.21.15.19:0/1627818462 conn(0x7ff2240b1c80 msgr2=0x7ff22406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 shutdown_connections 2024-03-04T08:50:49.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7ff22a93a640 1 -- 172.21.15.19:0/1627818462 wait complete. 2024-03-04T08:50:49.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 msgr2=0x7f454c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 0x7f454c06d9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4564007fd0 tx=0x7f4564009040 comp rx=0 tx=0).stop 2024-03-04T08:50:49.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 msgr2=0x7f45600dbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f455800c820 tx=0x7f455800cce0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 shutdown_connections 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f456004b3c0 0x7f45600ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4560034020 0x7f45600dbb00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f454c06b500 0x7f454c06d9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 --2- 172.21.15.19:0/303747164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4560006a50 0x7f45600cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 >> 172.21.15.19:0/303747164 conn(0x7f456000a400 msgr2=0x7f4560034d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.778+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 shutdown_connections 2024-03-04T08:50:49.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f456e48b640 1 -- 172.21.15.19:0/303747164 wait complete. 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 msgr2=0x7f108006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 0x7f108006da60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1090036000 tx=0x7f109003b040 comp rx=0 tx=0).stop 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 msgr2=0x7f10940e18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f108800d580 tx=0x7f108800da40 comp rx=0 tx=0).stop 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 shutdown_connections 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f108006b5a0 0x7f108006da60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f10940df410 0x7f10940e18d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1094054260 0x7f10940d68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 --2- 172.21.15.19:0/2503596492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f109404fa80 0x7f10940483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 >> 172.21.15.19:0/2503596492 conn(0x7f1094009fa0 msgr2=0x7f10940d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 shutdown_connections 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.779+0000 7f10a1ac9640 1 -- 172.21.15.19:0/2503596492 wait complete. 2024-03-04T08:50:49.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.784+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc09c0057d0 con 0x7fc094004800 2024-03-04T08:50:49.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.784+0000 7fc0a17fa640 1 -- 172.21.15.19:0/19084231 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc098057f20 con 0x7fc094004800 2024-03-04T08:50:49.781 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-03-04T08:50:49.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.786+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7cb803a4a0 con 0x7f7cb803ca20 2024-03-04T08:50:49.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.787+0000 7f7ca77fe640 1 -- 172.21.15.19:0/1398183059 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cb007b230 con 0x7f7cb803ca20 2024-03-04T08:50:49.783 INFO:teuthology.orchestra.run.smithi019.stdout:64424509448 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.787+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 msgr2=0x7fc08806dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.787+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 0x7fc08806dd90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc090034000 tx=0x7fc090007000 comp rx=0 tx=0).stop 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.787+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 msgr2=0x7fc09c0db150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.787+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e460 tx=0x7fc09800e920 comp rx=0 tx=0).stop 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 shutdown_connections 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc09c052be0 0x7fc09c04ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc09c050fa0 0x7fc09c0526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc08806b8d0 0x7fc08806dd90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 --2- 172.21.15.19:0/19084231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc094004800 0x7fc09c0db150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 >> 172.21.15.19:0/19084231 conn(0x7fc09c0559d0 msgr2=0x7fc09c006f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 shutdown_connections 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.788+0000 7fc08effd640 1 -- 172.21.15.19:0/19084231 wait complete. 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 msgr2=0x7f7cac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 0x7f7cac06d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800aca0 tx=0x7f7cb4000ed0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 msgr2=0x7f7cb80477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cb002bfc0 tx=0x7f7cb00046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 shutdown_connections 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7cb80e1060 0x7f7cb800e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb80521c0 0x7f7cb8035bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7cac06b4d0 0x7f7cac06d990 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800aca0 tx=0x7f7cb4000ed0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 --2- 172.21.15.19:0/1398183059 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7cb803ca20 0x7f7cb80477f0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cb002bfc0 tx=0x7f7cb00046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.790+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 >> 172.21.15.19:0/1398183059 conn(0x7f7cb8056ce0 msgr2=0x7f7cb800a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.791+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 shutdown_connections 2024-03-04T08:50:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.791+0000 7f7cbffff640 1 -- 172.21.15.19:0/1398183059 wait complete. 2024-03-04T08:50:49.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-03-04T08:50:49.791 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-03-04T08:50:49.795 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-03-04T08:50:49.796 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-03-04T08:50:49.796 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-03-04T08:50:49.798 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-03-04T08:50:49.800 DEBUG:teuthology.parallel:result is None 2024-03-04T08:50:49.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T08:50:49.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:49.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.945+0000 7f00b77e2640 1 Processor -- start 2024-03-04T08:50:49.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.946+0000 7f00b77e2640 1 -- start start 2024-03-04T08:50:49.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.946+0000 7f00b77e2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f00b00d4760 0x7f00b00b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.946+0000 7f00b77e2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00d25d0 con 0x7f00b00d0a80 2024-03-04T08:50:49.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.946+0000 7f00b77e2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00d2870 con 0x7f00b00b4170 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.946+0000 7f00b77e2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00d4bf0 con 0x7f00b00d4760 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b5d7f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f00b00d0a80 0x7f00b00cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42950/0 (socket says 172.21.15.19:42950) 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b5d7f640 1 -- 172.21.15.19:0/3787621137 learned_addr learned my addr 172.21.15.19:0/3787621137 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b4d7d640 1 --2- 172.21.15.19:0/3787621137 >> v2:172.21.15.204:3300/0 conn(0x7f00b00d4760 0x7f00b00b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946826386 0 0) 0x7f00b00d25d0 con 0x7f00b00d0a80 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f009c003520 con 0x7f00b00d0a80 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934649089 0 0) 0x7f00b00d2870 con 0x7f00b00b4170 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b00d25d0 con 0x7f00b00b4170 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b4d7d640 1 -- 172.21.15.19:0/3787621137 >> v1:172.21.15.204:6789/0 conn(0x7f00b00b4170 legacy=0x7f00b00d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b4d7d640 1 -- 172.21.15.19:0/3787621137 >> v1:172.21.15.19:6789/0 conn(0x7f00b00d0a80 legacy=0x7f00b00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.947+0000 7f00b4d7d640 1 -- 172.21.15.19:0/3787621137 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00d2b50 con 0x7f00b00d4760 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b4d7d640 1 --2- 172.21.15.19:0/3787621137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00d4760 0x7f00b00b6a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00a00097a0 tx=0x7f00a002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80b4a374a3de2cbd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0034070 con 0x7f00b00d4760 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0030610 con 0x7f00b00d4760 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00a7fff640 1 -- 172.21.15.19:0/3787621137 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a00309e0 con 0x7f00b00d4760 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b77e2640 1 -- 172.21.15.19:0/3787621137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00d4760 msgr2=0x7f00b00b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b77e2640 1 --2- 172.21.15.19:0/3787621137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00d4760 0x7f00b00b6a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00a00097a0 tx=0x7f00a002b960 comp rx=0 tx=0).stop 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b77e2640 1 -- 172.21.15.19:0/3787621137 shutdown_connections 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b77e2640 1 --2- 172.21.15.19:0/3787621137 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00d4760 0x7f00b00b6a90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.948+0000 7f00b77e2640 1 -- 172.21.15.19:0/3787621137 >> 172.21.15.19:0/3787621137 conn(0x7f00b00d3c40 msgr2=0x7f00b00d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.949+0000 7f00b77e2640 1 -- 172.21.15.19:0/3787621137 shutdown_connections 2024-03-04T08:50:49.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.949+0000 7f00b77e2640 1 -- 172.21.15.19:0/3787621137 wait complete. 2024-03-04T08:50:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 Processor -- start 2024-03-04T08:50:49.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 -- start start 2024-03-04T08:50:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00b00d0a80 0x7f00b00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00cd3b0 0x7f00b0158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b4dd0 con 0x7f00b00b4170 2024-03-04T08:50:49.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00ce9e0 con 0x7f00b00cd3b0 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b77e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b4f50 con 0x7f00b00d0a80 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b557e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b557e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37210/0 (socket says 172.21.15.19:37210) 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.950+0000 7f00b557e640 1 -- 172.21.15.19:0/663115295 learned_addr learned my addr 172.21.15.19:0/663115295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b4d7d640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00b00d0a80 0x7f00b00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b5d7f640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00cd3b0 0x7f00b0158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 -- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00b00d0a80 msgr2=0x7f00b00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00b00d0a80 0x7f00b00cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 -- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00cd3b0 msgr2=0x7f00b0158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00cd3b0 0x7f00b0158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 -- 172.21.15.19:0/663115295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0159690 con 0x7f00b00b4170 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b557e640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c500 tx=0x7f00ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0052d0 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac005490 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b0159970 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac012870 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.951+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b0159f30 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.952+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00cd7c0 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.953+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00ac012a10 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.953+0000 7f00a5ffb640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.953+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00ac089df0 con 0x7f00b00b4170 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.953+0000 7f00b4d7d640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:49.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.954+0000 7f00b4d7d640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 0x7f009406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00a0036000 tx=0x7f00a003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:49.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:49.957+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f00b00cd7c0 con 0x7f00b00b4170 2024-03-04T08:50:50.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.133+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00b015a370 con 0x7f009406b4d0 2024-03-04T08:50:50.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.140+0000 7f00a5ffb640 1 -- 172.21.15.19:0/663115295 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f00a00857d0 con 0x7f009406b4d0 2024-03-04T08:50:50.139 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:50.140 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.142+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 msgr2=0x7f009406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.142+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 0x7f009406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00a0036000 tx=0x7f00a003b040 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.142+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 msgr2=0x7f00b01f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.142+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c500 tx=0x7f00ac00c9c0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 shutdown_connections 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f009406b4d0 0x7f009406d990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f00b00cd3b0 0x7f00b0158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f00b00d0a80 0x7f00b00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 --2- 172.21.15.19:0/663115295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b00b4170 0x7f00b01f67f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 >> 172.21.15.19:0/663115295 conn(0x7f00b00d3c40 msgr2=0x7f00b00d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 shutdown_connections 2024-03-04T08:50:50.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.143+0000 7f00b77e2640 1 -- 172.21.15.19:0/663115295 wait complete. 2024-03-04T08:50:50.151 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-04T08:50:49.141230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219028,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755692,"statfs":{"total":773094113280,"available":772869828608,"internally_reserved":0,"allocated":2924544,"data_stored":1770620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762604+0000","last_change":"2024-03-04T08:50:38.374441+0000","last_active":"2024-03-04T08:50:41.762604+0000","last_peered":"2024-03-04T08:50:41.762604+0000","last_clean":"2024-03-04T08:50:41.762604+0000","last_became_active":"2024-03-04T08:50:38.373591+0000","last_became_peered":"2024-03-04T08:50:38.373591+0000","last_unstale":"2024-03-04T08:50:41.762604+0000","last_undegraded":"2024-03-04T08:50:41.762604+0000","last_fullsized":"2024-03-04T08:50:41.762604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855140+0000","last_change":"2024-03-04T08:50:38.358053+0000","last_active":"2024-03-04T08:50:39.855140+0000","last_peered":"2024-03-04T08:50:39.855140+0000","last_clean":"2024-03-04T08:50:39.855140+0000","last_became_active":"2024-03-04T08:50:38.357255+0000","last_became_peered":"2024-03-04T08:50:38.357255+0000","last_unstale":"2024-03-04T08:50:39.855140+0000","last_undegraded":"2024-03-04T08:50:39.855140+0000","last_fullsized":"2024-03-04T08:50:39.855140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361037+0000","last_change":"2024-03-04T08:50:38.366948+0000","last_active":"2024-03-04T08:50:39.361037+0000","last_peered":"2024-03-04T08:50:39.361037+0000","last_clean":"2024-03-04T08:50:39.361037+0000","last_became_active":"2024-03-04T08:50:38.366208+0000","last_became_peered":"2024-03-04T08:50:38.366208+0000","last_unstale":"2024-03-04T08:50:39.361037+0000","last_undegraded":"2024-03-04T08:50:39.361037+0000","last_fullsized":"2024-03-04T08:50:39.361037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762315+0000","last_change":"2024-03-04T08:50:38.368966+0000","last_active":"2024-03-04T08:50:41.762315+0000","last_peered":"2024-03-04T08:50:41.762315+0000","last_clean":"2024-03-04T08:50:41.762315+0000","last_became_active":"2024-03-04T08:50:38.368654+0000","last_became_peered":"2024-03-04T08:50:38.368654+0000","last_unstale":"2024-03-04T08:50:41.762315+0000","last_undegraded":"2024-03-04T08:50:41.762315+0000","last_fullsized":"2024-03-04T08:50:41.762315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360847+0000","last_change":"2024-03-04T08:50:38.367968+0000","last_active":"2024-03-04T08:50:39.360847+0000","last_peered":"2024-03-04T08:50:39.360847+0000","last_clean":"2024-03-04T08:50:39.360847+0000","last_became_active":"2024-03-04T08:50:38.367016+0000","last_became_peered":"2024-03-04T08:50:38.367016+0000","last_unstale":"2024-03-04T08:50:39.360847+0000","last_undegraded":"2024-03-04T08:50:39.360847+0000","last_fullsized":"2024-03-04T08:50:39.360847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762203+0000","last_change":"2024-03-04T08:50:38.369638+0000","last_active":"2024-03-04T08:50:41.762203+0000","last_peered":"2024-03-04T08:50:41.762203+0000","last_clean":"2024-03-04T08:50:41.762203+0000","last_became_active":"2024-03-04T08:50:38.369312+0000","last_became_peered":"2024-03-04T08:50:38.369312+0000","last_unstale":"2024-03-04T08:50:41.762203+0000","last_undegraded":"2024-03-04T08:50:41.762203+0000","last_fullsized":"2024-03-04T08:50:41.762203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358569+0000","last_change":"2024-03-04T08:50:38.366361+0000","last_active":"2024-03-04T08:50:39.358569+0000","last_peered":"2024-03-04T08:50:39.358569+0000","last_clean":"2024-03-04T08:50:39.358569+0000","last_became_active":"2024-03-04T08:50:38.366068+0000","last_became_peered":"2024-03-04T08:50:38.366068+0000","last_unstale":"2024-03-04T08:50:39.358569+0000","last_undegraded":"2024-03-04T08:50:39.358569+0000","last_fullsized":"2024-03-04T08:50:39.358569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762627+0000","last_change":"2024-03-04T08:50:38.374220+0000","last_active":"2024-03-04T08:50:41.762627+0000","last_peered":"2024-03-04T08:50:41.762627+0000","last_clean":"2024-03-04T08:50:41.762627+0000","last_became_active":"2024-03-04T08:50:38.373445+0000","last_became_peered":"2024-03-04T08:50:38.373445+0000","last_unstale":"2024-03-04T08:50:41.762627+0000","last_undegraded":"2024-03-04T08:50:41.762627+0000","last_fullsized":"2024-03-04T08:50:41.762627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:10.678854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346401+0000","last_change":"2024-03-04T08:50:38.367714+0000","last_active":"2024-03-04T08:50:40.346401+0000","last_peered":"2024-03-04T08:50:40.346401+0000","last_clean":"2024-03-04T08:50:40.346401+0000","last_became_active":"2024-03-04T08:50:38.366771+0000","last_became_peered":"2024-03-04T08:50:38.366771+0000","last_unstale":"2024-03-04T08:50:40.346401+0000","last_undegraded":"2024-03-04T08:50:40.346401+0000","last_fullsized":"2024-03-04T08:50:40.346401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346207+0000","last_change":"2024-03-04T08:50:38.368524+0000","last_active":"2024-03-04T08:50:40.346207+0000","last_peered":"2024-03-04T08:50:40.346207+0000","last_clean":"2024-03-04T08:50:40.346207+0000","last_became_active":"2024-03-04T08:50:38.368245+0000","last_became_peered":"2024-03-04T08:50:38.368245+0000","last_unstale":"2024-03-04T08:50:40.346207+0000","last_undegraded":"2024-03-04T08:50:40.346207+0000","last_fullsized":"2024-03-04T08:50:40.346207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514841+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:40.514841+0000","last_peered":"2024-03-04T08:50:40.514841+0000","last_clean":"2024-03-04T08:50:40.514841+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:40.514841+0000","last_undegraded":"2024-03-04T08:50:40.514841+0000","last_fullsized":"2024-03-04T08:50:40.514841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:16.616308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358986+0000","last_change":"2024-03-04T08:50:38.362814+0000","last_active":"2024-03-04T08:50:39.358986+0000","last_peered":"2024-03-04T08:50:39.358986+0000","last_clean":"2024-03-04T08:50:39.358986+0000","last_became_active":"2024-03-04T08:50:38.362485+0000","last_became_peered":"2024-03-04T08:50:38.362485+0000","last_unstale":"2024-03-04T08:50:39.358986+0000","last_undegraded":"2024-03-04T08:50:39.358986+0000","last_fullsized":"2024-03-04T08:50:39.358986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854913+0000","last_change":"2024-03-04T08:50:38.351189+0000","last_active":"2024-03-04T08:50:39.854913+0000","last_peered":"2024-03-04T08:50:39.854913+0000","last_clean":"2024-03-04T08:50:39.854913+0000","last_became_active":"2024-03-04T08:50:38.350891+0000","last_became_peered":"2024-03-04T08:50:38.350891+0000","last_unstale":"2024-03-04T08:50:39.854913+0000","last_undegraded":"2024-03-04T08:50:39.854913+0000","last_fullsized":"2024-03-04T08:50:39.854913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.937210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360695+0000","last_change":"2024-03-04T08:50:38.367551+0000","last_active":"2024-03-04T08:50:39.360695+0000","last_peered":"2024-03-04T08:50:39.360695+0000","last_clean":"2024-03-04T08:50:39.360695+0000","last_became_active":"2024-03-04T08:50:38.367313+0000","last_became_peered":"2024-03-04T08:50:38.367313+0000","last_unstale":"2024-03-04T08:50:39.360695+0000","last_undegraded":"2024-03-04T08:50:39.360695+0000","last_fullsized":"2024-03-04T08:50:39.360695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361629+0000","last_change":"2024-03-04T08:50:38.368986+0000","last_active":"2024-03-04T08:50:39.361629+0000","last_peered":"2024-03-04T08:50:39.361629+0000","last_clean":"2024-03-04T08:50:39.361629+0000","last_became_active":"2024-03-04T08:50:38.368733+0000","last_became_peered":"2024-03-04T08:50:38.368733+0000","last_unstale":"2024-03-04T08:50:39.361629+0000","last_undegraded":"2024-03-04T08:50:39.361629+0000","last_fullsized":"2024-03-04T08:50:39.361629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394395+0000","last_change":"2024-03-04T08:50:38.360761+0000","last_active":"2024-03-04T08:50:39.394395+0000","last_peered":"2024-03-04T08:50:39.394395+0000","last_clean":"2024-03-04T08:50:39.394395+0000","last_became_active":"2024-03-04T08:50:38.360455+0000","last_became_peered":"2024-03-04T08:50:38.360455+0000","last_unstale":"2024-03-04T08:50:39.394395+0000","last_undegraded":"2024-03-04T08:50:39.394395+0000","last_fullsized":"2024-03-04T08:50:39.394395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:12.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762612+0000","last_change":"2024-03-04T08:50:38.370011+0000","last_active":"2024-03-04T08:50:41.762612+0000","last_peered":"2024-03-04T08:50:41.762612+0000","last_clean":"2024-03-04T08:50:41.762612+0000","last_became_active":"2024-03-04T08:50:38.369378+0000","last_became_peered":"2024-03-04T08:50:38.369378+0000","last_unstale":"2024-03-04T08:50:41.762612+0000","last_undegraded":"2024-03-04T08:50:41.762612+0000","last_fullsized":"2024-03-04T08:50:41.762612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:31.681098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346113+0000","last_change":"2024-03-04T08:50:38.358855+0000","last_active":"2024-03-04T08:50:40.346113+0000","last_peered":"2024-03-04T08:50:40.346113+0000","last_clean":"2024-03-04T08:50:40.346113+0000","last_became_active":"2024-03-04T08:50:38.358588+0000","last_became_peered":"2024-03-04T08:50:38.358588+0000","last_unstale":"2024-03-04T08:50:40.346113+0000","last_undegraded":"2024-03-04T08:50:40.346113+0000","last_fullsized":"2024-03-04T08:50:40.346113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855044+0000","last_change":"2024-03-04T08:50:38.358718+0000","last_active":"2024-03-04T08:50:39.855044+0000","last_peered":"2024-03-04T08:50:39.855044+0000","last_clean":"2024-03-04T08:50:39.855044+0000","last_became_active":"2024-03-04T08:50:38.358117+0000","last_became_peered":"2024-03-04T08:50:38.358117+0000","last_unstale":"2024-03-04T08:50:39.855044+0000","last_undegraded":"2024-03-04T08:50:39.855044+0000","last_fullsized":"2024-03-04T08:50:39.855044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360927+0000","last_change":"2024-03-04T08:50:38.369801+0000","last_active":"2024-03-04T08:50:39.360927+0000","last_peered":"2024-03-04T08:50:39.360927+0000","last_clean":"2024-03-04T08:50:39.360927+0000","last_became_active":"2024-03-04T08:50:38.369294+0000","last_became_peered":"2024-03-04T08:50:38.369294+0000","last_unstale":"2024-03-04T08:50:39.360927+0000","last_undegraded":"2024-03-04T08:50:39.360927+0000","last_fullsized":"2024-03-04T08:50:39.360927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358684+0000","last_change":"2024-03-04T08:50:38.357671+0000","last_active":"2024-03-04T08:50:39.358684+0000","last_peered":"2024-03-04T08:50:39.358684+0000","last_clean":"2024-03-04T08:50:39.358684+0000","last_became_active":"2024-03-04T08:50:38.355946+0000","last_became_peered":"2024-03-04T08:50:38.355946+0000","last_unstale":"2024-03-04T08:50:39.358684+0000","last_undegraded":"2024-03-04T08:50:39.358684+0000","last_fullsized":"2024-03-04T08:50:39.358684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360776+0000","last_change":"2024-03-04T08:50:38.365190+0000","last_active":"2024-03-04T08:50:39.360776+0000","last_peered":"2024-03-04T08:50:39.360776+0000","last_clean":"2024-03-04T08:50:39.360776+0000","last_became_active":"2024-03-04T08:50:38.364935+0000","last_became_peered":"2024-03-04T08:50:38.364935+0000","last_unstale":"2024-03-04T08:50:39.360776+0000","last_undegraded":"2024-03-04T08:50:39.360776+0000","last_fullsized":"2024-03-04T08:50:39.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359096+0000","last_change":"2024-03-04T08:50:38.354934+0000","last_active":"2024-03-04T08:50:39.359096+0000","last_peered":"2024-03-04T08:50:39.359096+0000","last_clean":"2024-03-04T08:50:39.359096+0000","last_became_active":"2024-03-04T08:50:38.354640+0000","last_became_peered":"2024-03-04T08:50:38.354640+0000","last_unstale":"2024-03-04T08:50:39.359096+0000","last_undegraded":"2024-03-04T08:50:39.359096+0000","last_fullsized":"2024-03-04T08:50:39.359096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346441+0000","last_change":"2024-03-04T08:50:38.371561+0000","last_active":"2024-03-04T08:50:40.346441+0000","last_peered":"2024-03-04T08:50:40.346441+0000","last_clean":"2024-03-04T08:50:40.346441+0000","last_became_active":"2024-03-04T08:50:38.371294+0000","last_became_peered":"2024-03-04T08:50:38.371294+0000","last_unstale":"2024-03-04T08:50:40.346441+0000","last_undegraded":"2024-03-04T08:50:40.346441+0000","last_fullsized":"2024-03-04T08:50:40.346441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358972+0000","last_change":"2024-03-04T08:50:38.351562+0000","last_active":"2024-03-04T08:50:39.358972+0000","last_peered":"2024-03-04T08:50:39.358972+0000","last_clean":"2024-03-04T08:50:39.358972+0000","last_became_active":"2024-03-04T08:50:38.351257+0000","last_became_peered":"2024-03-04T08:50:38.351257+0000","last_unstale":"2024-03-04T08:50:39.358972+0000","last_undegraded":"2024-03-04T08:50:39.358972+0000","last_fullsized":"2024-03-04T08:50:39.358972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855063+0000","last_change":"2024-03-04T08:50:38.359297+0000","last_active":"2024-03-04T08:50:39.855063+0000","last_peered":"2024-03-04T08:50:39.855063+0000","last_clean":"2024-03-04T08:50:39.855063+0000","last_became_active":"2024-03-04T08:50:38.358979+0000","last_became_peered":"2024-03-04T08:50:38.358979+0000","last_unstale":"2024-03-04T08:50:39.855063+0000","last_undegraded":"2024-03-04T08:50:39.855063+0000","last_fullsized":"2024-03-04T08:50:39.855063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361039+0000","last_change":"2024-03-04T08:50:38.367261+0000","last_active":"2024-03-04T08:50:39.361039+0000","last_peered":"2024-03-04T08:50:39.361039+0000","last_clean":"2024-03-04T08:50:39.361039+0000","last_became_active":"2024-03-04T08:50:38.366669+0000","last_became_peered":"2024-03-04T08:50:38.366669+0000","last_unstale":"2024-03-04T08:50:39.361039+0000","last_undegraded":"2024-03-04T08:50:39.361039+0000","last_fullsized":"2024-03-04T08:50:39.361039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394336+0000","last_change":"2024-03-04T08:50:38.363033+0000","last_active":"2024-03-04T08:50:39.394336+0000","last_peered":"2024-03-04T08:50:39.394336+0000","last_clean":"2024-03-04T08:50:39.394336+0000","last_became_active":"2024-03-04T08:50:38.362766+0000","last_became_peered":"2024-03-04T08:50:38.362766+0000","last_unstale":"2024-03-04T08:50:39.394336+0000","last_undegraded":"2024-03-04T08:50:39.394336+0000","last_fullsized":"2024-03-04T08:50:39.394336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:58.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346206+0000","last_change":"2024-03-04T08:50:38.368924+0000","last_active":"2024-03-04T08:50:40.346206+0000","last_peered":"2024-03-04T08:50:40.346206+0000","last_clean":"2024-03-04T08:50:40.346206+0000","last_became_active":"2024-03-04T08:50:38.368637+0000","last_became_peered":"2024-03-04T08:50:38.368637+0000","last_unstale":"2024-03-04T08:50:40.346206+0000","last_undegraded":"2024-03-04T08:50:40.346206+0000","last_fullsized":"2024-03-04T08:50:40.346206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514579+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:40.514579+0000","last_peered":"2024-03-04T08:50:40.514579+0000","last_clean":"2024-03-04T08:50:40.514579+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:40.514579+0000","last_undegraded":"2024-03-04T08:50:40.514579+0000","last_fullsized":"2024-03-04T08:50:40.514579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:21.382564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359083+0000","last_change":"2024-03-04T08:50:37.354227+0000","last_active":"2024-03-04T08:50:39.359083+0000","last_peered":"2024-03-04T08:50:39.359083+0000","last_clean":"2024-03-04T08:50:39.359083+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.359083+0000","last_undegraded":"2024-03-04T08:50:39.359083+0000","last_fullsized":"2024-03-04T08:50:39.359083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855222+0000","last_change":"2024-03-04T08:50:38.349460+0000","last_active":"2024-03-04T08:50:39.855222+0000","last_peered":"2024-03-04T08:50:39.855222+0000","last_clean":"2024-03-04T08:50:39.855222+0000","last_became_active":"2024-03-04T08:50:38.349165+0000","last_became_peered":"2024-03-04T08:50:38.349165+0000","last_unstale":"2024-03-04T08:50:39.855222+0000","last_undegraded":"2024-03-04T08:50:39.855222+0000","last_fullsized":"2024-03-04T08:50:39.855222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345975+0000","last_change":"2024-03-04T08:50:37.357596+0000","last_active":"2024-03-04T08:50:40.345975+0000","last_peered":"2024-03-04T08:50:40.345975+0000","last_clean":"2024-03-04T08:50:40.345975+0000","last_became_active":"2024-03-04T08:50:37.357184+0000","last_became_peered":"2024-03-04T08:50:37.357184+0000","last_unstale":"2024-03-04T08:50:40.345975+0000","last_undegraded":"2024-03-04T08:50:40.345975+0000","last_fullsized":"2024-03-04T08:50:40.345975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358596+0000","last_change":"2024-03-04T08:50:37.360184+0000","last_active":"2024-03-04T08:50:39.358596+0000","last_peered":"2024-03-04T08:50:39.358596+0000","last_clean":"2024-03-04T08:50:39.358596+0000","last_became_active":"2024-03-04T08:50:37.359861+0000","last_became_peered":"2024-03-04T08:50:37.359861+0000","last_unstale":"2024-03-04T08:50:39.358596+0000","last_undegraded":"2024-03-04T08:50:39.358596+0000","last_fullsized":"2024-03-04T08:50:39.358596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358627+0000","last_change":"2024-03-04T08:50:38.357592+0000","last_active":"2024-03-04T08:50:39.358627+0000","last_peered":"2024-03-04T08:50:39.358627+0000","last_clean":"2024-03-04T08:50:39.358627+0000","last_became_active":"2024-03-04T08:50:38.357281+0000","last_became_peered":"2024-03-04T08:50:38.357281+0000","last_unstale":"2024-03-04T08:50:39.358627+0000","last_undegraded":"2024-03-04T08:50:39.358627+0000","last_fullsized":"2024-03-04T08:50:39.358627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360880+0000","last_change":"2024-03-04T08:50:37.354365+0000","last_active":"2024-03-04T08:50:39.360880+0000","last_peered":"2024-03-04T08:50:39.360880+0000","last_clean":"2024-03-04T08:50:39.360880+0000","last_became_active":"2024-03-04T08:50:37.354030+0000","last_became_peered":"2024-03-04T08:50:37.354030+0000","last_unstale":"2024-03-04T08:50:39.360880+0000","last_undegraded":"2024-03-04T08:50:39.360880+0000","last_fullsized":"2024-03-04T08:50:39.360880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346201+0000","last_change":"2024-03-04T08:50:37.360991+0000","last_active":"2024-03-04T08:50:40.346201+0000","last_peered":"2024-03-04T08:50:40.346201+0000","last_clean":"2024-03-04T08:50:40.346201+0000","last_became_active":"2024-03-04T08:50:37.360694+0000","last_became_peered":"2024-03-04T08:50:37.360694+0000","last_unstale":"2024-03-04T08:50:40.346201+0000","last_undegraded":"2024-03-04T08:50:40.346201+0000","last_fullsized":"2024-03-04T08:50:40.346201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361659+0000","last_change":"2024-03-04T08:50:38.369004+0000","last_active":"2024-03-04T08:50:39.361659+0000","last_peered":"2024-03-04T08:50:39.361659+0000","last_clean":"2024-03-04T08:50:39.361659+0000","last_became_active":"2024-03-04T08:50:38.368693+0000","last_became_peered":"2024-03-04T08:50:38.368693+0000","last_unstale":"2024-03-04T08:50:39.361659+0000","last_undegraded":"2024-03-04T08:50:39.361659+0000","last_fullsized":"2024-03-04T08:50:39.361659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361605+0000","last_change":"2024-03-04T08:50:37.362455+0000","last_active":"2024-03-04T08:50:39.361605+0000","last_peered":"2024-03-04T08:50:39.361605+0000","last_clean":"2024-03-04T08:50:39.361605+0000","last_became_active":"2024-03-04T08:50:37.362158+0000","last_became_peered":"2024-03-04T08:50:37.362158+0000","last_unstale":"2024-03-04T08:50:39.361605+0000","last_undegraded":"2024-03-04T08:50:39.361605+0000","last_fullsized":"2024-03-04T08:50:39.361605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855246+0000","last_change":"2024-03-04T08:50:38.365240+0000","last_active":"2024-03-04T08:50:39.855246+0000","last_peered":"2024-03-04T08:50:39.855246+0000","last_clean":"2024-03-04T08:50:39.855246+0000","last_became_active":"2024-03-04T08:50:38.364917+0000","last_became_peered":"2024-03-04T08:50:38.364917+0000","last_unstale":"2024-03-04T08:50:39.855246+0000","last_undegraded":"2024-03-04T08:50:39.855246+0000","last_fullsized":"2024-03-04T08:50:39.855246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514952+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:40.514952+0000","last_peered":"2024-03-04T08:50:40.514952+0000","last_clean":"2024-03-04T08:50:40.514952+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:40.514952+0000","last_undegraded":"2024-03-04T08:50:40.514952+0000","last_fullsized":"2024-03-04T08:50:40.514952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:03:01.506515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346169+0000","last_change":"2024-03-04T08:50:37.359849+0000","last_active":"2024-03-04T08:50:40.346169+0000","last_peered":"2024-03-04T08:50:40.346169+0000","last_clean":"2024-03-04T08:50:40.346169+0000","last_became_active":"2024-03-04T08:50:37.359576+0000","last_became_peered":"2024-03-04T08:50:37.359576+0000","last_unstale":"2024-03-04T08:50:40.346169+0000","last_undegraded":"2024-03-04T08:50:40.346169+0000","last_fullsized":"2024-03-04T08:50:40.346169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762329+0000","last_change":"2024-03-04T08:50:38.369740+0000","last_active":"2024-03-04T08:50:41.762329+0000","last_peered":"2024-03-04T08:50:41.762329+0000","last_clean":"2024-03-04T08:50:41.762329+0000","last_became_active":"2024-03-04T08:50:38.369073+0000","last_became_peered":"2024-03-04T08:50:38.369073+0000","last_unstale":"2024-03-04T08:50:41.762329+0000","last_undegraded":"2024-03-04T08:50:41.762329+0000","last_fullsized":"2024-03-04T08:50:41.762329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855159+0000","last_change":"2024-03-04T08:50:37.354223+0000","last_active":"2024-03-04T08:50:39.855159+0000","last_peered":"2024-03-04T08:50:39.855159+0000","last_clean":"2024-03-04T08:50:39.855159+0000","last_became_active":"2024-03-04T08:50:37.353906+0000","last_became_peered":"2024-03-04T08:50:37.353906+0000","last_unstale":"2024-03-04T08:50:39.855159+0000","last_undegraded":"2024-03-04T08:50:39.855159+0000","last_fullsized":"2024-03-04T08:50:39.855159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854976+0000","last_change":"2024-03-04T08:50:38.360076+0000","last_active":"2024-03-04T08:50:39.854976+0000","last_peered":"2024-03-04T08:50:39.854976+0000","last_clean":"2024-03-04T08:50:39.854976+0000","last_became_active":"2024-03-04T08:50:38.359714+0000","last_became_peered":"2024-03-04T08:50:38.359714+0000","last_unstale":"2024-03-04T08:50:39.854976+0000","last_undegraded":"2024-03-04T08:50:39.854976+0000","last_fullsized":"2024-03-04T08:50:39.854976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360992+0000","last_change":"2024-03-04T08:50:37.353826+0000","last_active":"2024-03-04T08:50:39.360992+0000","last_peered":"2024-03-04T08:50:39.360992+0000","last_clean":"2024-03-04T08:50:39.360992+0000","last_became_active":"2024-03-04T08:50:37.353132+0000","last_became_peered":"2024-03-04T08:50:37.353132+0000","last_unstale":"2024-03-04T08:50:39.360992+0000","last_undegraded":"2024-03-04T08:50:39.360992+0000","last_fullsized":"2024-03-04T08:50:39.360992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762394+0000","last_change":"2024-03-04T08:50:38.373171+0000","last_active":"2024-03-04T08:50:41.762394+0000","last_peered":"2024-03-04T08:50:41.762394+0000","last_clean":"2024-03-04T08:50:41.762394+0000","last_became_active":"2024-03-04T08:50:38.370738+0000","last_became_peered":"2024-03-04T08:50:38.370738+0000","last_unstale":"2024-03-04T08:50:41.762394+0000","last_undegraded":"2024-03-04T08:50:41.762394+0000","last_fullsized":"2024-03-04T08:50:41.762394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345970+0000","last_change":"2024-03-04T08:50:37.359455+0000","last_active":"2024-03-04T08:50:40.345970+0000","last_peered":"2024-03-04T08:50:40.345970+0000","last_clean":"2024-03-04T08:50:40.345970+0000","last_became_active":"2024-03-04T08:50:37.359137+0000","last_became_peered":"2024-03-04T08:50:37.359137+0000","last_unstale":"2024-03-04T08:50:40.345970+0000","last_undegraded":"2024-03-04T08:50:40.345970+0000","last_fullsized":"2024-03-04T08:50:40.345970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346243+0000","last_change":"2024-03-04T08:50:38.367626+0000","last_active":"2024-03-04T08:50:40.346243+0000","last_peered":"2024-03-04T08:50:40.346243+0000","last_clean":"2024-03-04T08:50:40.346243+0000","last_became_active":"2024-03-04T08:50:38.367277+0000","last_became_peered":"2024-03-04T08:50:38.367277+0000","last_unstale":"2024-03-04T08:50:40.346243+0000","last_undegraded":"2024-03-04T08:50:40.346243+0000","last_fullsized":"2024-03-04T08:50:40.346243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394201+0000","last_change":"2024-03-04T08:50:37.356475+0000","last_active":"2024-03-04T08:50:39.394201+0000","last_peered":"2024-03-04T08:50:39.394201+0000","last_clean":"2024-03-04T08:50:39.394201+0000","last_became_active":"2024-03-04T08:50:37.356167+0000","last_became_peered":"2024-03-04T08:50:37.356167+0000","last_unstale":"2024-03-04T08:50:39.394201+0000","last_undegraded":"2024-03-04T08:50:39.394201+0000","last_fullsized":"2024-03-04T08:50:39.394201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762253+0000","last_change":"2024-03-04T08:50:38.372905+0000","last_active":"2024-03-04T08:50:41.762253+0000","last_peered":"2024-03-04T08:50:41.762253+0000","last_clean":"2024-03-04T08:50:41.762253+0000","last_became_active":"2024-03-04T08:50:38.371431+0000","last_became_peered":"2024-03-04T08:50:38.371431+0000","last_unstale":"2024-03-04T08:50:41.762253+0000","last_undegraded":"2024-03-04T08:50:41.762253+0000","last_fullsized":"2024-03-04T08:50:41.762253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514853+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:40.514853+0000","last_peered":"2024-03-04T08:50:40.514853+0000","last_clean":"2024-03-04T08:50:40.514853+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:40.514853+0000","last_undegraded":"2024-03-04T08:50:40.514853+0000","last_fullsized":"2024-03-04T08:50:40.514853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762561+0000","last_change":"2024-03-04T08:50:38.372063+0000","last_active":"2024-03-04T08:50:41.762561+0000","last_peered":"2024-03-04T08:50:41.762561+0000","last_clean":"2024-03-04T08:50:41.762561+0000","last_became_active":"2024-03-04T08:50:38.371539+0000","last_became_peered":"2024-03-04T08:50:38.371539+0000","last_unstale":"2024-03-04T08:50:41.762561+0000","last_undegraded":"2024-03-04T08:50:41.762561+0000","last_fullsized":"2024-03-04T08:50:41.762561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394382+0000","last_change":"2024-03-04T08:50:37.350563+0000","last_active":"2024-03-04T08:50:39.394382+0000","last_peered":"2024-03-04T08:50:39.394382+0000","last_clean":"2024-03-04T08:50:39.394382+0000","last_became_active":"2024-03-04T08:50:37.350303+0000","last_became_peered":"2024-03-04T08:50:37.350303+0000","last_unstale":"2024-03-04T08:50:39.394382+0000","last_undegraded":"2024-03-04T08:50:39.394382+0000","last_fullsized":"2024-03-04T08:50:39.394382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762700+0000","last_change":"2024-03-04T08:50:38.373725+0000","last_active":"2024-03-04T08:50:41.762700+0000","last_peered":"2024-03-04T08:50:41.762700+0000","last_clean":"2024-03-04T08:50:41.762700+0000","last_became_active":"2024-03-04T08:50:38.372170+0000","last_became_peered":"2024-03-04T08:50:38.372170+0000","last_unstale":"2024-03-04T08:50:41.762700+0000","last_undegraded":"2024-03-04T08:50:41.762700+0000","last_fullsized":"2024-03-04T08:50:41.762700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:00.038272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361451+0000","last_change":"2024-03-04T08:50:38.365801+0000","last_active":"2024-03-04T08:50:39.361451+0000","last_peered":"2024-03-04T08:50:39.361451+0000","last_clean":"2024-03-04T08:50:39.361451+0000","last_became_active":"2024-03-04T08:50:38.365312+0000","last_became_peered":"2024-03-04T08:50:38.365312+0000","last_unstale":"2024-03-04T08:50:39.361451+0000","last_undegraded":"2024-03-04T08:50:39.361451+0000","last_fullsized":"2024-03-04T08:50:39.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394416+0000","last_change":"2024-03-04T08:50:37.357282+0000","last_active":"2024-03-04T08:50:39.394416+0000","last_peered":"2024-03-04T08:50:39.394416+0000","last_clean":"2024-03-04T08:50:39.394416+0000","last_became_active":"2024-03-04T08:50:37.356970+0000","last_became_peered":"2024-03-04T08:50:37.356970+0000","last_unstale":"2024-03-04T08:50:39.394416+0000","last_undegraded":"2024-03-04T08:50:39.394416+0000","last_fullsized":"2024-03-04T08:50:39.394416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762501+0000","last_change":"2024-03-04T08:50:38.373876+0000","last_active":"2024-03-04T08:50:41.762501+0000","last_peered":"2024-03-04T08:50:41.762501+0000","last_clean":"2024-03-04T08:50:41.762501+0000","last_became_active":"2024-03-04T08:50:38.373349+0000","last_became_peered":"2024-03-04T08:50:38.373349+0000","last_unstale":"2024-03-04T08:50:41.762501+0000","last_undegraded":"2024-03-04T08:50:41.762501+0000","last_fullsized":"2024-03-04T08:50:41.762501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762019+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:41.762019+0000","last_peered":"2024-03-04T08:50:41.762019+0000","last_clean":"2024-03-04T08:50:41.762019+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:41.762019+0000","last_undegraded":"2024-03-04T08:50:41.762019+0000","last_fullsized":"2024-03-04T08:50:41.762019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360752+0000","last_change":"2024-03-04T08:50:37.356373+0000","last_active":"2024-03-04T08:50:39.360752+0000","last_peered":"2024-03-04T08:50:39.360752+0000","last_clean":"2024-03-04T08:50:39.360752+0000","last_became_active":"2024-03-04T08:50:37.356102+0000","last_became_peered":"2024-03-04T08:50:37.356102+0000","last_unstale":"2024-03-04T08:50:39.360752+0000","last_undegraded":"2024-03-04T08:50:39.360752+0000","last_fullsized":"2024-03-04T08:50:39.360752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358993+0000","last_change":"2024-03-04T08:50:38.369654+0000","last_active":"2024-03-04T08:50:39.358993+0000","last_peered":"2024-03-04T08:50:39.358993+0000","last_clean":"2024-03-04T08:50:39.358993+0000","last_became_active":"2024-03-04T08:50:38.369253+0000","last_became_peered":"2024-03-04T08:50:38.369253+0000","last_unstale":"2024-03-04T08:50:39.358993+0000","last_undegraded":"2024-03-04T08:50:39.358993+0000","last_fullsized":"2024-03-04T08:50:39.358993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762136+0000","last_change":"2024-03-04T08:50:37.358364+0000","last_active":"2024-03-04T08:50:41.762136+0000","last_peered":"2024-03-04T08:50:41.762136+0000","last_clean":"2024-03-04T08:50:41.762136+0000","last_became_active":"2024-03-04T08:50:37.358020+0000","last_became_peered":"2024-03-04T08:50:37.358020+0000","last_unstale":"2024-03-04T08:50:41.762136+0000","last_undegraded":"2024-03-04T08:50:41.762136+0000","last_fullsized":"2024-03-04T08:50:41.762136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:49.927169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854875+0000","last_change":"2024-03-04T08:50:38.349604+0000","last_active":"2024-03-04T08:50:39.854875+0000","last_peered":"2024-03-04T08:50:39.854875+0000","last_clean":"2024-03-04T08:50:39.854875+0000","last_became_active":"2024-03-04T08:50:38.349258+0000","last_became_peered":"2024-03-04T08:50:38.349258+0000","last_unstale":"2024-03-04T08:50:39.854875+0000","last_undegraded":"2024-03-04T08:50:39.854875+0000","last_fullsized":"2024-03-04T08:50:39.854875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:24:43.330397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394293+0000","last_change":"2024-03-04T08:50:37.350362+0000","last_active":"2024-03-04T08:50:39.394293+0000","last_peered":"2024-03-04T08:50:39.394293+0000","last_clean":"2024-03-04T08:50:39.394293+0000","last_became_active":"2024-03-04T08:50:37.350066+0000","last_became_peered":"2024-03-04T08:50:37.350066+0000","last_unstale":"2024-03-04T08:50:39.394293+0000","last_undegraded":"2024-03-04T08:50:39.394293+0000","last_fullsized":"2024-03-04T08:50:39.394293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361102+0000","last_change":"2024-03-04T08:50:37.359035+0000","last_active":"2024-03-04T08:50:39.361102+0000","last_peered":"2024-03-04T08:50:39.361102+0000","last_clean":"2024-03-04T08:50:39.361102+0000","last_became_active":"2024-03-04T08:50:37.358433+0000","last_became_peered":"2024-03-04T08:50:37.358433+0000","last_unstale":"2024-03-04T08:50:39.361102+0000","last_undegraded":"2024-03-04T08:50:39.361102+0000","last_fullsized":"2024-03-04T08:50:39.361102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514747+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:40.514747+0000","last_peered":"2024-03-04T08:50:40.514747+0000","last_clean":"2024-03-04T08:50:40.514747+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:40.514747+0000","last_undegraded":"2024-03-04T08:50:40.514747+0000","last_fullsized":"2024-03-04T08:50:40.514747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:06.980599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361386+0000","last_change":"2024-03-04T08:50:38.366605+0000","last_active":"2024-03-04T08:50:39.361386+0000","last_peered":"2024-03-04T08:50:39.361386+0000","last_clean":"2024-03-04T08:50:39.361386+0000","last_became_active":"2024-03-04T08:50:38.366328+0000","last_became_peered":"2024-03-04T08:50:38.366328+0000","last_unstale":"2024-03-04T08:50:39.361386+0000","last_undegraded":"2024-03-04T08:50:39.361386+0000","last_fullsized":"2024-03-04T08:50:39.361386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762564+0000","last_change":"2024-03-04T08:50:37.360537+0000","last_active":"2024-03-04T08:50:41.762564+0000","last_peered":"2024-03-04T08:50:41.762564+0000","last_clean":"2024-03-04T08:50:41.762564+0000","last_became_active":"2024-03-04T08:50:37.360242+0000","last_became_peered":"2024-03-04T08:50:37.360242+0000","last_unstale":"2024-03-04T08:50:41.762564+0000","last_undegraded":"2024-03-04T08:50:41.762564+0000","last_fullsized":"2024-03-04T08:50:41.762564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:57.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.148899+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:40.148899+0000","last_peered":"2024-03-04T08:50:40.148899+0000","last_clean":"2024-03-04T08:50:40.148899+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:40.148899+0000","last_undegraded":"2024-03-04T08:50:40.148899+0000","last_fullsized":"2024-03-04T08:50:40.148899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359145+0000","last_change":"2024-03-04T08:50:38.361565+0000","last_active":"2024-03-04T08:50:39.359145+0000","last_peered":"2024-03-04T08:50:39.359145+0000","last_clean":"2024-03-04T08:50:39.359145+0000","last_became_active":"2024-03-04T08:50:38.361273+0000","last_became_peered":"2024-03-04T08:50:38.361273+0000","last_unstale":"2024-03-04T08:50:39.359145+0000","last_undegraded":"2024-03-04T08:50:39.359145+0000","last_fullsized":"2024-03-04T08:50:39.359145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346274+0000","last_change":"2024-03-04T08:50:37.359717+0000","last_active":"2024-03-04T08:50:40.346274+0000","last_peered":"2024-03-04T08:50:40.346274+0000","last_clean":"2024-03-04T08:50:40.346274+0000","last_became_active":"2024-03-04T08:50:37.359245+0000","last_became_peered":"2024-03-04T08:50:37.359245+0000","last_unstale":"2024-03-04T08:50:40.346274+0000","last_undegraded":"2024-03-04T08:50:40.346274+0000","last_fullsized":"2024-03-04T08:50:40.346274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855169+0000","last_change":"2024-03-04T08:50:38.352594+0000","last_active":"2024-03-04T08:50:39.855169+0000","last_peered":"2024-03-04T08:50:39.855169+0000","last_clean":"2024-03-04T08:50:39.855169+0000","last_became_active":"2024-03-04T08:50:38.352332+0000","last_became_peered":"2024-03-04T08:50:38.352332+0000","last_unstale":"2024-03-04T08:50:39.855169+0000","last_undegraded":"2024-03-04T08:50:39.855169+0000","last_fullsized":"2024-03-04T08:50:39.855169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762053+0000","last_change":"2024-03-04T08:50:37.360157+0000","last_active":"2024-03-04T08:50:41.762053+0000","last_peered":"2024-03-04T08:50:41.762053+0000","last_clean":"2024-03-04T08:50:41.762053+0000","last_became_active":"2024-03-04T08:50:37.359874+0000","last_became_peered":"2024-03-04T08:50:37.359874+0000","last_unstale":"2024-03-04T08:50:41.762053+0000","last_undegraded":"2024-03-04T08:50:41.762053+0000","last_fullsized":"2024-03-04T08:50:41.762053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:11.606336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514579+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:40.514579+0000","last_peered":"2024-03-04T08:50:40.514579+0000","last_clean":"2024-03-04T08:50:40.514579+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:40.514579+0000","last_undegraded":"2024-03-04T08:50:40.514579+0000","last_fullsized":"2024-03-04T08:50:40.514579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:26.642248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358708+0000","last_change":"2024-03-04T08:50:38.351791+0000","last_active":"2024-03-04T08:50:39.358708+0000","last_peered":"2024-03-04T08:50:39.358708+0000","last_clean":"2024-03-04T08:50:39.358708+0000","last_became_active":"2024-03-04T08:50:38.351453+0000","last_became_peered":"2024-03-04T08:50:38.351453+0000","last_unstale":"2024-03-04T08:50:39.358708+0000","last_undegraded":"2024-03-04T08:50:39.358708+0000","last_fullsized":"2024-03-04T08:50:39.358708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359031+0000","last_change":"2024-03-04T08:50:38.358946+0000","last_active":"2024-03-04T08:50:39.359031+0000","last_peered":"2024-03-04T08:50:39.359031+0000","last_clean":"2024-03-04T08:50:39.359031+0000","last_became_active":"2024-03-04T08:50:38.357473+0000","last_became_peered":"2024-03-04T08:50:38.357473+0000","last_unstale":"2024-03-04T08:50:39.359031+0000","last_undegraded":"2024-03-04T08:50:39.359031+0000","last_fullsized":"2024-03-04T08:50:39.359031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762489+0000","last_change":"2024-03-04T08:50:37.354833+0000","last_active":"2024-03-04T08:50:41.762489+0000","last_peered":"2024-03-04T08:50:41.762489+0000","last_clean":"2024-03-04T08:50:41.762489+0000","last_became_active":"2024-03-04T08:50:37.354239+0000","last_became_peered":"2024-03-04T08:50:37.354239+0000","last_unstale":"2024-03-04T08:50:41.762489+0000","last_undegraded":"2024-03-04T08:50:41.762489+0000","last_fullsized":"2024-03-04T08:50:41.762489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346287+0000","last_change":"2024-03-04T08:50:38.361714+0000","last_active":"2024-03-04T08:50:40.346287+0000","last_peered":"2024-03-04T08:50:40.346287+0000","last_clean":"2024-03-04T08:50:40.346287+0000","last_became_active":"2024-03-04T08:50:38.361376+0000","last_became_peered":"2024-03-04T08:50:38.361376+0000","last_unstale":"2024-03-04T08:50:40.346287+0000","last_undegraded":"2024-03-04T08:50:40.346287+0000","last_fullsized":"2024-03-04T08:50:40.346287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361371+0000","last_change":"2024-03-04T08:50:38.365933+0000","last_active":"2024-03-04T08:50:39.361371+0000","last_peered":"2024-03-04T08:50:39.361371+0000","last_clean":"2024-03-04T08:50:39.361371+0000","last_became_active":"2024-03-04T08:50:38.365628+0000","last_became_peered":"2024-03-04T08:50:38.365628+0000","last_unstale":"2024-03-04T08:50:39.361371+0000","last_undegraded":"2024-03-04T08:50:39.361371+0000","last_fullsized":"2024-03-04T08:50:39.361371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762331+0000","last_change":"2024-03-04T08:50:37.359532+0000","last_active":"2024-03-04T08:50:41.762331+0000","last_peered":"2024-03-04T08:50:41.762331+0000","last_clean":"2024-03-04T08:50:41.762331+0000","last_became_active":"2024-03-04T08:50:37.359226+0000","last_became_peered":"2024-03-04T08:50:37.359226+0000","last_unstale":"2024-03-04T08:50:41.762331+0000","last_undegraded":"2024-03-04T08:50:41.762331+0000","last_fullsized":"2024-03-04T08:50:41.762331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361119+0000","last_change":"2024-03-04T08:50:38.365556+0000","last_active":"2024-03-04T08:50:39.361119+0000","last_peered":"2024-03-04T08:50:39.361119+0000","last_clean":"2024-03-04T08:50:39.361119+0000","last_became_active":"2024-03-04T08:50:38.364736+0000","last_became_peered":"2024-03-04T08:50:38.364736+0000","last_unstale":"2024-03-04T08:50:39.361119+0000","last_undegraded":"2024-03-04T08:50:39.361119+0000","last_fullsized":"2024-03-04T08:50:39.361119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762390+0000","last_change":"2024-03-04T08:50:37.362398+0000","last_active":"2024-03-04T08:50:41.762390+0000","last_peered":"2024-03-04T08:50:41.762390+0000","last_clean":"2024-03-04T08:50:41.762390+0000","last_became_active":"2024-03-04T08:50:37.362117+0000","last_became_peered":"2024-03-04T08:50:37.362117+0000","last_unstale":"2024-03-04T08:50:41.762390+0000","last_undegraded":"2024-03-04T08:50:41.762390+0000","last_fullsized":"2024-03-04T08:50:41.762390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:13:00.335926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855227+0000","last_change":"2024-03-04T08:50:38.365989+0000","last_active":"2024-03-04T08:50:39.855227+0000","last_peered":"2024-03-04T08:50:39.855227+0000","last_clean":"2024-03-04T08:50:39.855227+0000","last_became_active":"2024-03-04T08:50:38.365578+0000","last_became_peered":"2024-03-04T08:50:38.365578+0000","last_unstale":"2024-03-04T08:50:39.855227+0000","last_undegraded":"2024-03-04T08:50:39.855227+0000","last_fullsized":"2024-03-04T08:50:39.855227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358915+0000","last_change":"2024-03-04T08:50:37.348349+0000","last_active":"2024-03-04T08:50:39.358915+0000","last_peered":"2024-03-04T08:50:39.358915+0000","last_clean":"2024-03-04T08:50:39.358915+0000","last_became_active":"2024-03-04T08:50:37.348047+0000","last_became_peered":"2024-03-04T08:50:37.348047+0000","last_unstale":"2024-03-04T08:50:39.358915+0000","last_undegraded":"2024-03-04T08:50:39.358915+0000","last_fullsized":"2024-03-04T08:50:39.358915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359023+0000","last_change":"2024-03-04T08:50:38.361937+0000","last_active":"2024-03-04T08:50:39.359023+0000","last_peered":"2024-03-04T08:50:39.359023+0000","last_clean":"2024-03-04T08:50:39.359023+0000","last_became_active":"2024-03-04T08:50:38.360865+0000","last_became_peered":"2024-03-04T08:50:38.360865+0000","last_unstale":"2024-03-04T08:50:39.359023+0000","last_undegraded":"2024-03-04T08:50:39.359023+0000","last_fullsized":"2024-03-04T08:50:39.359023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855261+0000","last_change":"2024-03-04T08:50:37.356168+0000","last_active":"2024-03-04T08:50:39.855261+0000","last_peered":"2024-03-04T08:50:39.855261+0000","last_clean":"2024-03-04T08:50:39.855261+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.855261+0000","last_undegraded":"2024-03-04T08:50:39.855261+0000","last_fullsized":"2024-03-04T08:50:39.855261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:46.059440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":664083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":664139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:50.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:50:50.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.297+0000 7f60b1284640 1 Processor -- start 2024-03-04T08:50:50.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.297+0000 7f60b1284640 1 -- start start 2024-03-04T08:50:50.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60b1284640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ac0d2920 0x7f60ac0d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60b1284640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac0d0650 0x7f60ac0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60b1284640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac15e470 con 0x7f60ac15e090 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60b1284640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0d18f0 con 0x7f60ac0d2920 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60b1284640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0b3cf0 con 0x7f60ac0d0650 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ac0d2920 0x7f60ac0d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60aaffd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f60ac15e090 0x7f60ac0b35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:55366/0 (socket says 172.21.15.19:55366) 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60ac0d2920 0x7f60ac0d47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37212/0 (socket says 172.21.15.19:37212) 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60aaffd640 1 -- 172.21.15.19:0/2627097797 learned_addr learned my addr 172.21.15.19:0/2627097797 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60ab7fe640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac0d0650 0x7f60ac0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 -- 172.21.15.19:0/2627097797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac0d0650 msgr2=0x7f60ac0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac0d0650 0x7f60ac0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 -- 172.21.15.19:0/2627097797 >> v1:172.21.15.204:6789/0 conn(0x7f60ac15e090 legacy=0x7f60ac0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60aa7fc640 1 -- 172.21.15.19:0/2627097797 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134168276 0 0) 0x7f60ac15e470 con 0x7f60ac15e090 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.298+0000 7f60a3fff640 1 -- 172.21.15.19:0/2627097797 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0d1b90 con 0x7f60ac0d2920 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.299+0000 7f60a3fff640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0d47a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60940097a0 tx=0x7f609402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf85f8c98b44952 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.299+0000 7f60aa7fc640 1 -- 172.21.15.19:0/2627097797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094035020 con 0x7f60ac0d2920 2024-03-04T08:50:50.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.299+0000 7f60aa7fc640 1 -- 172.21.15.19:0/2627097797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094031830 con 0x7f60ac0d2920 2024-03-04T08:50:50.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.299+0000 7f60aa7fc640 1 -- 172.21.15.19:0/2627097797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094031c00 con 0x7f60ac0d2920 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 -- 172.21.15.19:0/2627097797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 msgr2=0x7f60ac0d47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0d47a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60940097a0 tx=0x7f609402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 -- 172.21.15.19:0/2627097797 shutdown_connections 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac0d0650 0x7f60ac0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 --2- 172.21.15.19:0/2627097797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0d47a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 -- 172.21.15.19:0/2627097797 >> 172.21.15.19:0/2627097797 conn(0x7f60ac0d3c80 msgr2=0x7f60ac0d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 -- 172.21.15.19:0/2627097797 shutdown_connections 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.300+0000 7f60b1284640 1 -- 172.21.15.19:0/2627097797 wait complete. 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.301+0000 7f60b1284640 1 Processor -- start 2024-03-04T08:50:50.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.301+0000 7f60b1284640 1 -- start start 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60ac0d0650 0x7f60ac160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac15e090 0x7f60ac0b8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0b2df0 con 0x7f60ac0d2920 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0cee30 con 0x7f60ac0d0650 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0ce800 con 0x7f60ac15e090 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37216/0 (socket says 172.21.15.19:37216) 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 -- 172.21.15.19:0/3879246818 learned_addr learned my addr 172.21.15.19:0/3879246818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60aaffd640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60ac0d0650 0x7f60ac160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60ab7fe640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac15e090 0x7f60ac0b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 -- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac15e090 msgr2=0x7f60ac0b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac15e090 0x7f60ac0b8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 -- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60ac0d0650 msgr2=0x7f60ac160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60ac0d0650 0x7f60ac160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 -- 172.21.15.19:0/3879246818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0b8e90 con 0x7f60ac0d2920 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a3fff640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60940096f0 tx=0x7f60940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094040070 con 0x7f60ac0d2920 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609403a910 con 0x7f60ac0d2920 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094035040 con 0x7f60ac0d2920 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac0b6a20 con 0x7f60ac0d2920 2024-03-04T08:50:50.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.302+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac0b6fe0 con 0x7f60ac0d2920 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.303+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac04f330 con 0x7f60ac0d2920 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.304+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f609404b060 con 0x7f60ac0d2920 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.304+0000 7f60a37fe640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 0x7f608c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.304+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60940ab7b0 con 0x7f60ac0d2920 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.304+0000 7f60aaffd640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 0x7f608c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.305+0000 7f60aaffd640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 0x7f608c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f609c000f60 tx=0x7f609c007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.309+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f609407a070 con 0x7f60ac0d2920 2024-03-04T08:50:50.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.488+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60ac0d1230 con 0x7f608c06b4d0 2024-03-04T08:50:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.494+0000 7f60a37fe640 1 -- 172.21.15.19:0/3879246818 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f60ac0d1230 con 0x7f608c06b4d0 2024-03-04T08:50:50.493 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 msgr2=0x7f608c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 0x7f608c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f609c000f60 tx=0x7f609c007e40 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 msgr2=0x7f60ac0b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60940096f0 tx=0x7f60940046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 shutdown_connections 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60ac15e090 0x7f60ac0b8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60ac0d2920 0x7f60ac0b8410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f608c06b4d0 0x7f608c06d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 --2- 172.21.15.19:0/3879246818 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60ac0d0650 0x7f60ac160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.497+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 >> 172.21.15.19:0/3879246818 conn(0x7f60ac0d3c80 msgr2=0x7f60ac06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.498+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 shutdown_connections 2024-03-04T08:50:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.498+0000 7f60b1284640 1 -- 172.21.15.19:0/3879246818 wait complete. 2024-03-04T08:50:50.504 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-04T08:50:49.141230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219028,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755692,"statfs":{"total":773094113280,"available":772869828608,"internally_reserved":0,"allocated":2924544,"data_stored":1770620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762604+0000","last_change":"2024-03-04T08:50:38.374441+0000","last_active":"2024-03-04T08:50:41.762604+0000","last_peered":"2024-03-04T08:50:41.762604+0000","last_clean":"2024-03-04T08:50:41.762604+0000","last_became_active":"2024-03-04T08:50:38.373591+0000","last_became_peered":"2024-03-04T08:50:38.373591+0000","last_unstale":"2024-03-04T08:50:41.762604+0000","last_undegraded":"2024-03-04T08:50:41.762604+0000","last_fullsized":"2024-03-04T08:50:41.762604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355943+0000","last_change":"2024-03-04T08:50:38.355454+0000","last_active":"2024-03-04T08:50:39.355943+0000","last_peered":"2024-03-04T08:50:39.355943+0000","last_clean":"2024-03-04T08:50:39.355943+0000","last_became_active":"2024-03-04T08:50:38.355131+0000","last_became_peered":"2024-03-04T08:50:38.355131+0000","last_unstale":"2024-03-04T08:50:39.355943+0000","last_undegraded":"2024-03-04T08:50:39.355943+0000","last_fullsized":"2024-03-04T08:50:39.355943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:18.202626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855140+0000","last_change":"2024-03-04T08:50:38.358053+0000","last_active":"2024-03-04T08:50:39.855140+0000","last_peered":"2024-03-04T08:50:39.855140+0000","last_clean":"2024-03-04T08:50:39.855140+0000","last_became_active":"2024-03-04T08:50:38.357255+0000","last_became_peered":"2024-03-04T08:50:38.357255+0000","last_unstale":"2024-03-04T08:50:39.855140+0000","last_undegraded":"2024-03-04T08:50:39.855140+0000","last_fullsized":"2024-03-04T08:50:39.855140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361037+0000","last_change":"2024-03-04T08:50:38.366948+0000","last_active":"2024-03-04T08:50:39.361037+0000","last_peered":"2024-03-04T08:50:39.361037+0000","last_clean":"2024-03-04T08:50:39.361037+0000","last_became_active":"2024-03-04T08:50:38.366208+0000","last_became_peered":"2024-03-04T08:50:38.366208+0000","last_unstale":"2024-03-04T08:50:39.361037+0000","last_undegraded":"2024-03-04T08:50:39.361037+0000","last_fullsized":"2024-03-04T08:50:39.361037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762315+0000","last_change":"2024-03-04T08:50:38.368966+0000","last_active":"2024-03-04T08:50:41.762315+0000","last_peered":"2024-03-04T08:50:41.762315+0000","last_clean":"2024-03-04T08:50:41.762315+0000","last_became_active":"2024-03-04T08:50:38.368654+0000","last_became_peered":"2024-03-04T08:50:38.368654+0000","last_unstale":"2024-03-04T08:50:41.762315+0000","last_undegraded":"2024-03-04T08:50:41.762315+0000","last_fullsized":"2024-03-04T08:50:41.762315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360847+0000","last_change":"2024-03-04T08:50:38.367968+0000","last_active":"2024-03-04T08:50:39.360847+0000","last_peered":"2024-03-04T08:50:39.360847+0000","last_clean":"2024-03-04T08:50:39.360847+0000","last_became_active":"2024-03-04T08:50:38.367016+0000","last_became_peered":"2024-03-04T08:50:38.367016+0000","last_unstale":"2024-03-04T08:50:39.360847+0000","last_undegraded":"2024-03-04T08:50:39.360847+0000","last_fullsized":"2024-03-04T08:50:39.360847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762203+0000","last_change":"2024-03-04T08:50:38.369638+0000","last_active":"2024-03-04T08:50:41.762203+0000","last_peered":"2024-03-04T08:50:41.762203+0000","last_clean":"2024-03-04T08:50:41.762203+0000","last_became_active":"2024-03-04T08:50:38.369312+0000","last_became_peered":"2024-03-04T08:50:38.369312+0000","last_unstale":"2024-03-04T08:50:41.762203+0000","last_undegraded":"2024-03-04T08:50:41.762203+0000","last_fullsized":"2024-03-04T08:50:41.762203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358569+0000","last_change":"2024-03-04T08:50:38.366361+0000","last_active":"2024-03-04T08:50:39.358569+0000","last_peered":"2024-03-04T08:50:39.358569+0000","last_clean":"2024-03-04T08:50:39.358569+0000","last_became_active":"2024-03-04T08:50:38.366068+0000","last_became_peered":"2024-03-04T08:50:38.366068+0000","last_unstale":"2024-03-04T08:50:39.358569+0000","last_undegraded":"2024-03-04T08:50:39.358569+0000","last_fullsized":"2024-03-04T08:50:39.358569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762627+0000","last_change":"2024-03-04T08:50:38.374220+0000","last_active":"2024-03-04T08:50:41.762627+0000","last_peered":"2024-03-04T08:50:41.762627+0000","last_clean":"2024-03-04T08:50:41.762627+0000","last_became_active":"2024-03-04T08:50:38.373445+0000","last_became_peered":"2024-03-04T08:50:38.373445+0000","last_unstale":"2024-03-04T08:50:41.762627+0000","last_undegraded":"2024-03-04T08:50:41.762627+0000","last_fullsized":"2024-03-04T08:50:41.762627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:10.678854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346401+0000","last_change":"2024-03-04T08:50:38.367714+0000","last_active":"2024-03-04T08:50:40.346401+0000","last_peered":"2024-03-04T08:50:40.346401+0000","last_clean":"2024-03-04T08:50:40.346401+0000","last_became_active":"2024-03-04T08:50:38.366771+0000","last_became_peered":"2024-03-04T08:50:38.366771+0000","last_unstale":"2024-03-04T08:50:40.346401+0000","last_undegraded":"2024-03-04T08:50:40.346401+0000","last_fullsized":"2024-03-04T08:50:40.346401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346207+0000","last_change":"2024-03-04T08:50:38.368524+0000","last_active":"2024-03-04T08:50:40.346207+0000","last_peered":"2024-03-04T08:50:40.346207+0000","last_clean":"2024-03-04T08:50:40.346207+0000","last_became_active":"2024-03-04T08:50:38.368245+0000","last_became_peered":"2024-03-04T08:50:38.368245+0000","last_unstale":"2024-03-04T08:50:40.346207+0000","last_undegraded":"2024-03-04T08:50:40.346207+0000","last_fullsized":"2024-03-04T08:50:40.346207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514841+0000","last_change":"2024-03-04T08:50:38.363427+0000","last_active":"2024-03-04T08:50:40.514841+0000","last_peered":"2024-03-04T08:50:40.514841+0000","last_clean":"2024-03-04T08:50:40.514841+0000","last_became_active":"2024-03-04T08:50:38.363142+0000","last_became_peered":"2024-03-04T08:50:38.363142+0000","last_unstale":"2024-03-04T08:50:40.514841+0000","last_undegraded":"2024-03-04T08:50:40.514841+0000","last_fullsized":"2024-03-04T08:50:40.514841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:16.616308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358986+0000","last_change":"2024-03-04T08:50:38.362814+0000","last_active":"2024-03-04T08:50:39.358986+0000","last_peered":"2024-03-04T08:50:39.358986+0000","last_clean":"2024-03-04T08:50:39.358986+0000","last_became_active":"2024-03-04T08:50:38.362485+0000","last_became_peered":"2024-03-04T08:50:38.362485+0000","last_unstale":"2024-03-04T08:50:39.358986+0000","last_undegraded":"2024-03-04T08:50:39.358986+0000","last_fullsized":"2024-03-04T08:50:39.358986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854913+0000","last_change":"2024-03-04T08:50:38.351189+0000","last_active":"2024-03-04T08:50:39.854913+0000","last_peered":"2024-03-04T08:50:39.854913+0000","last_clean":"2024-03-04T08:50:39.854913+0000","last_became_active":"2024-03-04T08:50:38.350891+0000","last_became_peered":"2024-03-04T08:50:38.350891+0000","last_unstale":"2024-03-04T08:50:39.854913+0000","last_undegraded":"2024-03-04T08:50:39.854913+0000","last_fullsized":"2024-03-04T08:50:39.854913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:42.937210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355813+0000","last_change":"2024-03-04T08:50:38.358554+0000","last_active":"2024-03-04T08:50:39.355813+0000","last_peered":"2024-03-04T08:50:39.355813+0000","last_clean":"2024-03-04T08:50:39.355813+0000","last_became_active":"2024-03-04T08:50:38.358280+0000","last_became_peered":"2024-03-04T08:50:38.358280+0000","last_unstale":"2024-03-04T08:50:39.355813+0000","last_undegraded":"2024-03-04T08:50:39.355813+0000","last_fullsized":"2024-03-04T08:50:39.355813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:47:53.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360695+0000","last_change":"2024-03-04T08:50:38.367551+0000","last_active":"2024-03-04T08:50:39.360695+0000","last_peered":"2024-03-04T08:50:39.360695+0000","last_clean":"2024-03-04T08:50:39.360695+0000","last_became_active":"2024-03-04T08:50:38.367313+0000","last_became_peered":"2024-03-04T08:50:38.367313+0000","last_unstale":"2024-03-04T08:50:39.360695+0000","last_undegraded":"2024-03-04T08:50:39.360695+0000","last_fullsized":"2024-03-04T08:50:39.360695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361629+0000","last_change":"2024-03-04T08:50:38.368986+0000","last_active":"2024-03-04T08:50:39.361629+0000","last_peered":"2024-03-04T08:50:39.361629+0000","last_clean":"2024-03-04T08:50:39.361629+0000","last_became_active":"2024-03-04T08:50:38.368733+0000","last_became_peered":"2024-03-04T08:50:38.368733+0000","last_unstale":"2024-03-04T08:50:39.361629+0000","last_undegraded":"2024-03-04T08:50:39.361629+0000","last_fullsized":"2024-03-04T08:50:39.361629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394395+0000","last_change":"2024-03-04T08:50:38.360761+0000","last_active":"2024-03-04T08:50:39.394395+0000","last_peered":"2024-03-04T08:50:39.394395+0000","last_clean":"2024-03-04T08:50:39.394395+0000","last_became_active":"2024-03-04T08:50:38.360455+0000","last_became_peered":"2024-03-04T08:50:38.360455+0000","last_unstale":"2024-03-04T08:50:39.394395+0000","last_undegraded":"2024-03-04T08:50:39.394395+0000","last_fullsized":"2024-03-04T08:50:39.394395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:12.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762612+0000","last_change":"2024-03-04T08:50:38.370011+0000","last_active":"2024-03-04T08:50:41.762612+0000","last_peered":"2024-03-04T08:50:41.762612+0000","last_clean":"2024-03-04T08:50:41.762612+0000","last_became_active":"2024-03-04T08:50:38.369378+0000","last_became_peered":"2024-03-04T08:50:38.369378+0000","last_unstale":"2024-03-04T08:50:41.762612+0000","last_undegraded":"2024-03-04T08:50:41.762612+0000","last_fullsized":"2024-03-04T08:50:41.762612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:31.681098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346113+0000","last_change":"2024-03-04T08:50:38.358855+0000","last_active":"2024-03-04T08:50:40.346113+0000","last_peered":"2024-03-04T08:50:40.346113+0000","last_clean":"2024-03-04T08:50:40.346113+0000","last_became_active":"2024-03-04T08:50:38.358588+0000","last_became_peered":"2024-03-04T08:50:38.358588+0000","last_unstale":"2024-03-04T08:50:40.346113+0000","last_undegraded":"2024-03-04T08:50:40.346113+0000","last_fullsized":"2024-03-04T08:50:40.346113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855044+0000","last_change":"2024-03-04T08:50:38.358718+0000","last_active":"2024-03-04T08:50:39.855044+0000","last_peered":"2024-03-04T08:50:39.855044+0000","last_clean":"2024-03-04T08:50:39.855044+0000","last_became_active":"2024-03-04T08:50:38.358117+0000","last_became_peered":"2024-03-04T08:50:38.358117+0000","last_unstale":"2024-03-04T08:50:39.855044+0000","last_undegraded":"2024-03-04T08:50:39.855044+0000","last_fullsized":"2024-03-04T08:50:39.855044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360927+0000","last_change":"2024-03-04T08:50:38.369801+0000","last_active":"2024-03-04T08:50:39.360927+0000","last_peered":"2024-03-04T08:50:39.360927+0000","last_clean":"2024-03-04T08:50:39.360927+0000","last_became_active":"2024-03-04T08:50:38.369294+0000","last_became_peered":"2024-03-04T08:50:38.369294+0000","last_unstale":"2024-03-04T08:50:39.360927+0000","last_undegraded":"2024-03-04T08:50:39.360927+0000","last_fullsized":"2024-03-04T08:50:39.360927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358684+0000","last_change":"2024-03-04T08:50:38.357671+0000","last_active":"2024-03-04T08:50:39.358684+0000","last_peered":"2024-03-04T08:50:39.358684+0000","last_clean":"2024-03-04T08:50:39.358684+0000","last_became_active":"2024-03-04T08:50:38.355946+0000","last_became_peered":"2024-03-04T08:50:38.355946+0000","last_unstale":"2024-03-04T08:50:39.358684+0000","last_undegraded":"2024-03-04T08:50:39.358684+0000","last_fullsized":"2024-03-04T08:50:39.358684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360776+0000","last_change":"2024-03-04T08:50:38.365190+0000","last_active":"2024-03-04T08:50:39.360776+0000","last_peered":"2024-03-04T08:50:39.360776+0000","last_clean":"2024-03-04T08:50:39.360776+0000","last_became_active":"2024-03-04T08:50:38.364935+0000","last_became_peered":"2024-03-04T08:50:38.364935+0000","last_unstale":"2024-03-04T08:50:39.360776+0000","last_undegraded":"2024-03-04T08:50:39.360776+0000","last_fullsized":"2024-03-04T08:50:39.360776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359096+0000","last_change":"2024-03-04T08:50:38.354934+0000","last_active":"2024-03-04T08:50:39.359096+0000","last_peered":"2024-03-04T08:50:39.359096+0000","last_clean":"2024-03-04T08:50:39.359096+0000","last_became_active":"2024-03-04T08:50:38.354640+0000","last_became_peered":"2024-03-04T08:50:38.354640+0000","last_unstale":"2024-03-04T08:50:39.359096+0000","last_undegraded":"2024-03-04T08:50:39.359096+0000","last_fullsized":"2024-03-04T08:50:39.359096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:03.217041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346441+0000","last_change":"2024-03-04T08:50:38.371561+0000","last_active":"2024-03-04T08:50:40.346441+0000","last_peered":"2024-03-04T08:50:40.346441+0000","last_clean":"2024-03-04T08:50:40.346441+0000","last_became_active":"2024-03-04T08:50:38.371294+0000","last_became_peered":"2024-03-04T08:50:38.371294+0000","last_unstale":"2024-03-04T08:50:40.346441+0000","last_undegraded":"2024-03-04T08:50:40.346441+0000","last_fullsized":"2024-03-04T08:50:40.346441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356144+0000","last_change":"2024-03-04T08:50:38.361582+0000","last_active":"2024-03-04T08:50:39.356144+0000","last_peered":"2024-03-04T08:50:39.356144+0000","last_clean":"2024-03-04T08:50:39.356144+0000","last_became_active":"2024-03-04T08:50:38.361292+0000","last_became_peered":"2024-03-04T08:50:38.361292+0000","last_unstale":"2024-03-04T08:50:39.356144+0000","last_undegraded":"2024-03-04T08:50:39.356144+0000","last_fullsized":"2024-03-04T08:50:39.356144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:36.057848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358972+0000","last_change":"2024-03-04T08:50:38.351562+0000","last_active":"2024-03-04T08:50:39.358972+0000","last_peered":"2024-03-04T08:50:39.358972+0000","last_clean":"2024-03-04T08:50:39.358972+0000","last_became_active":"2024-03-04T08:50:38.351257+0000","last_became_peered":"2024-03-04T08:50:38.351257+0000","last_unstale":"2024-03-04T08:50:39.358972+0000","last_undegraded":"2024-03-04T08:50:39.358972+0000","last_fullsized":"2024-03-04T08:50:39.358972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855063+0000","last_change":"2024-03-04T08:50:38.359297+0000","last_active":"2024-03-04T08:50:39.855063+0000","last_peered":"2024-03-04T08:50:39.855063+0000","last_clean":"2024-03-04T08:50:39.855063+0000","last_became_active":"2024-03-04T08:50:38.358979+0000","last_became_peered":"2024-03-04T08:50:38.358979+0000","last_unstale":"2024-03-04T08:50:39.855063+0000","last_undegraded":"2024-03-04T08:50:39.855063+0000","last_fullsized":"2024-03-04T08:50:39.855063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361039+0000","last_change":"2024-03-04T08:50:38.367261+0000","last_active":"2024-03-04T08:50:39.361039+0000","last_peered":"2024-03-04T08:50:39.361039+0000","last_clean":"2024-03-04T08:50:39.361039+0000","last_became_active":"2024-03-04T08:50:38.366669+0000","last_became_peered":"2024-03-04T08:50:38.366669+0000","last_unstale":"2024-03-04T08:50:39.361039+0000","last_undegraded":"2024-03-04T08:50:39.361039+0000","last_fullsized":"2024-03-04T08:50:39.361039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394336+0000","last_change":"2024-03-04T08:50:38.363033+0000","last_active":"2024-03-04T08:50:39.394336+0000","last_peered":"2024-03-04T08:50:39.394336+0000","last_clean":"2024-03-04T08:50:39.394336+0000","last_became_active":"2024-03-04T08:50:38.362766+0000","last_became_peered":"2024-03-04T08:50:38.362766+0000","last_unstale":"2024-03-04T08:50:39.394336+0000","last_undegraded":"2024-03-04T08:50:39.394336+0000","last_fullsized":"2024-03-04T08:50:39.394336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:58.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346206+0000","last_change":"2024-03-04T08:50:38.368924+0000","last_active":"2024-03-04T08:50:40.346206+0000","last_peered":"2024-03-04T08:50:40.346206+0000","last_clean":"2024-03-04T08:50:40.346206+0000","last_became_active":"2024-03-04T08:50:38.368637+0000","last_became_peered":"2024-03-04T08:50:38.368637+0000","last_unstale":"2024-03-04T08:50:40.346206+0000","last_undegraded":"2024-03-04T08:50:40.346206+0000","last_fullsized":"2024-03-04T08:50:40.346206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:22.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514579+0000","last_change":"2024-03-04T08:50:38.351903+0000","last_active":"2024-03-04T08:50:40.514579+0000","last_peered":"2024-03-04T08:50:40.514579+0000","last_clean":"2024-03-04T08:50:40.514579+0000","last_became_active":"2024-03-04T08:50:38.350956+0000","last_became_peered":"2024-03-04T08:50:38.350956+0000","last_unstale":"2024-03-04T08:50:40.514579+0000","last_undegraded":"2024-03-04T08:50:40.514579+0000","last_fullsized":"2024-03-04T08:50:40.514579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:21.382564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359083+0000","last_change":"2024-03-04T08:50:37.354227+0000","last_active":"2024-03-04T08:50:39.359083+0000","last_peered":"2024-03-04T08:50:39.359083+0000","last_clean":"2024-03-04T08:50:39.359083+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.359083+0000","last_undegraded":"2024-03-04T08:50:39.359083+0000","last_fullsized":"2024-03-04T08:50:39.359083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855222+0000","last_change":"2024-03-04T08:50:38.349460+0000","last_active":"2024-03-04T08:50:39.855222+0000","last_peered":"2024-03-04T08:50:39.855222+0000","last_clean":"2024-03-04T08:50:39.855222+0000","last_became_active":"2024-03-04T08:50:38.349165+0000","last_became_peered":"2024-03-04T08:50:38.349165+0000","last_unstale":"2024-03-04T08:50:39.855222+0000","last_undegraded":"2024-03-04T08:50:39.855222+0000","last_fullsized":"2024-03-04T08:50:39.855222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345975+0000","last_change":"2024-03-04T08:50:37.357596+0000","last_active":"2024-03-04T08:50:40.345975+0000","last_peered":"2024-03-04T08:50:40.345975+0000","last_clean":"2024-03-04T08:50:40.345975+0000","last_became_active":"2024-03-04T08:50:37.357184+0000","last_became_peered":"2024-03-04T08:50:37.357184+0000","last_unstale":"2024-03-04T08:50:40.345975+0000","last_undegraded":"2024-03-04T08:50:40.345975+0000","last_fullsized":"2024-03-04T08:50:40.345975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358596+0000","last_change":"2024-03-04T08:50:37.360184+0000","last_active":"2024-03-04T08:50:39.358596+0000","last_peered":"2024-03-04T08:50:39.358596+0000","last_clean":"2024-03-04T08:50:39.358596+0000","last_became_active":"2024-03-04T08:50:37.359861+0000","last_became_peered":"2024-03-04T08:50:37.359861+0000","last_unstale":"2024-03-04T08:50:39.358596+0000","last_undegraded":"2024-03-04T08:50:39.358596+0000","last_fullsized":"2024-03-04T08:50:39.358596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358627+0000","last_change":"2024-03-04T08:50:38.357592+0000","last_active":"2024-03-04T08:50:39.358627+0000","last_peered":"2024-03-04T08:50:39.358627+0000","last_clean":"2024-03-04T08:50:39.358627+0000","last_became_active":"2024-03-04T08:50:38.357281+0000","last_became_peered":"2024-03-04T08:50:38.357281+0000","last_unstale":"2024-03-04T08:50:39.358627+0000","last_undegraded":"2024-03-04T08:50:39.358627+0000","last_fullsized":"2024-03-04T08:50:39.358627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:39.178588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360880+0000","last_change":"2024-03-04T08:50:37.354365+0000","last_active":"2024-03-04T08:50:39.360880+0000","last_peered":"2024-03-04T08:50:39.360880+0000","last_clean":"2024-03-04T08:50:39.360880+0000","last_became_active":"2024-03-04T08:50:37.354030+0000","last_became_peered":"2024-03-04T08:50:37.354030+0000","last_unstale":"2024-03-04T08:50:39.360880+0000","last_undegraded":"2024-03-04T08:50:39.360880+0000","last_fullsized":"2024-03-04T08:50:39.360880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355789+0000","last_change":"2024-03-04T08:50:38.362707+0000","last_active":"2024-03-04T08:50:39.355789+0000","last_peered":"2024-03-04T08:50:39.355789+0000","last_clean":"2024-03-04T08:50:39.355789+0000","last_became_active":"2024-03-04T08:50:38.362059+0000","last_became_peered":"2024-03-04T08:50:38.362059+0000","last_unstale":"2024-03-04T08:50:39.355789+0000","last_undegraded":"2024-03-04T08:50:39.355789+0000","last_fullsized":"2024-03-04T08:50:39.355789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:59.952121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346201+0000","last_change":"2024-03-04T08:50:37.360991+0000","last_active":"2024-03-04T08:50:40.346201+0000","last_peered":"2024-03-04T08:50:40.346201+0000","last_clean":"2024-03-04T08:50:40.346201+0000","last_became_active":"2024-03-04T08:50:37.360694+0000","last_became_peered":"2024-03-04T08:50:37.360694+0000","last_unstale":"2024-03-04T08:50:40.346201+0000","last_undegraded":"2024-03-04T08:50:40.346201+0000","last_fullsized":"2024-03-04T08:50:40.346201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361659+0000","last_change":"2024-03-04T08:50:38.369004+0000","last_active":"2024-03-04T08:50:39.361659+0000","last_peered":"2024-03-04T08:50:39.361659+0000","last_clean":"2024-03-04T08:50:39.361659+0000","last_became_active":"2024-03-04T08:50:38.368693+0000","last_became_peered":"2024-03-04T08:50:38.368693+0000","last_unstale":"2024-03-04T08:50:39.361659+0000","last_undegraded":"2024-03-04T08:50:39.361659+0000","last_fullsized":"2024-03-04T08:50:39.361659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:49.484063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361605+0000","last_change":"2024-03-04T08:50:37.362455+0000","last_active":"2024-03-04T08:50:39.361605+0000","last_peered":"2024-03-04T08:50:39.361605+0000","last_clean":"2024-03-04T08:50:39.361605+0000","last_became_active":"2024-03-04T08:50:37.362158+0000","last_became_peered":"2024-03-04T08:50:37.362158+0000","last_unstale":"2024-03-04T08:50:39.361605+0000","last_undegraded":"2024-03-04T08:50:39.361605+0000","last_fullsized":"2024-03-04T08:50:39.361605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855246+0000","last_change":"2024-03-04T08:50:38.365240+0000","last_active":"2024-03-04T08:50:39.855246+0000","last_peered":"2024-03-04T08:50:39.855246+0000","last_clean":"2024-03-04T08:50:39.855246+0000","last_became_active":"2024-03-04T08:50:38.364917+0000","last_became_peered":"2024-03-04T08:50:38.364917+0000","last_unstale":"2024-03-04T08:50:39.855246+0000","last_undegraded":"2024-03-04T08:50:39.855246+0000","last_fullsized":"2024-03-04T08:50:39.855246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:19.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356234+0000","last_change":"2024-03-04T08:50:37.359908+0000","last_active":"2024-03-04T08:50:39.356234+0000","last_peered":"2024-03-04T08:50:39.356234+0000","last_clean":"2024-03-04T08:50:39.356234+0000","last_became_active":"2024-03-04T08:50:37.359609+0000","last_became_peered":"2024-03-04T08:50:37.359609+0000","last_unstale":"2024-03-04T08:50:39.356234+0000","last_undegraded":"2024-03-04T08:50:39.356234+0000","last_fullsized":"2024-03-04T08:50:39.356234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:39.805650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514952+0000","last_change":"2024-03-04T08:50:38.363884+0000","last_active":"2024-03-04T08:50:40.514952+0000","last_peered":"2024-03-04T08:50:40.514952+0000","last_clean":"2024-03-04T08:50:40.514952+0000","last_became_active":"2024-03-04T08:50:38.363610+0000","last_became_peered":"2024-03-04T08:50:38.363610+0000","last_unstale":"2024-03-04T08:50:40.514952+0000","last_undegraded":"2024-03-04T08:50:40.514952+0000","last_fullsized":"2024-03-04T08:50:40.514952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:03:01.506515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346169+0000","last_change":"2024-03-04T08:50:37.359849+0000","last_active":"2024-03-04T08:50:40.346169+0000","last_peered":"2024-03-04T08:50:40.346169+0000","last_clean":"2024-03-04T08:50:40.346169+0000","last_became_active":"2024-03-04T08:50:37.359576+0000","last_became_peered":"2024-03-04T08:50:37.359576+0000","last_unstale":"2024-03-04T08:50:40.346169+0000","last_undegraded":"2024-03-04T08:50:40.346169+0000","last_fullsized":"2024-03-04T08:50:40.346169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762329+0000","last_change":"2024-03-04T08:50:38.369740+0000","last_active":"2024-03-04T08:50:41.762329+0000","last_peered":"2024-03-04T08:50:41.762329+0000","last_clean":"2024-03-04T08:50:41.762329+0000","last_became_active":"2024-03-04T08:50:38.369073+0000","last_became_peered":"2024-03-04T08:50:38.369073+0000","last_unstale":"2024-03-04T08:50:41.762329+0000","last_undegraded":"2024-03-04T08:50:41.762329+0000","last_fullsized":"2024-03-04T08:50:41.762329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855159+0000","last_change":"2024-03-04T08:50:37.354223+0000","last_active":"2024-03-04T08:50:39.855159+0000","last_peered":"2024-03-04T08:50:39.855159+0000","last_clean":"2024-03-04T08:50:39.855159+0000","last_became_active":"2024-03-04T08:50:37.353906+0000","last_became_peered":"2024-03-04T08:50:37.353906+0000","last_unstale":"2024-03-04T08:50:39.855159+0000","last_undegraded":"2024-03-04T08:50:39.855159+0000","last_fullsized":"2024-03-04T08:50:39.855159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:56.214774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854976+0000","last_change":"2024-03-04T08:50:38.360076+0000","last_active":"2024-03-04T08:50:39.854976+0000","last_peered":"2024-03-04T08:50:39.854976+0000","last_clean":"2024-03-04T08:50:39.854976+0000","last_became_active":"2024-03-04T08:50:38.359714+0000","last_became_peered":"2024-03-04T08:50:38.359714+0000","last_unstale":"2024-03-04T08:50:39.854976+0000","last_undegraded":"2024-03-04T08:50:39.854976+0000","last_fullsized":"2024-03-04T08:50:39.854976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360992+0000","last_change":"2024-03-04T08:50:37.353826+0000","last_active":"2024-03-04T08:50:39.360992+0000","last_peered":"2024-03-04T08:50:39.360992+0000","last_clean":"2024-03-04T08:50:39.360992+0000","last_became_active":"2024-03-04T08:50:37.353132+0000","last_became_peered":"2024-03-04T08:50:37.353132+0000","last_unstale":"2024-03-04T08:50:39.360992+0000","last_undegraded":"2024-03-04T08:50:39.360992+0000","last_fullsized":"2024-03-04T08:50:39.360992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:03:08.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762394+0000","last_change":"2024-03-04T08:50:38.373171+0000","last_active":"2024-03-04T08:50:41.762394+0000","last_peered":"2024-03-04T08:50:41.762394+0000","last_clean":"2024-03-04T08:50:41.762394+0000","last_became_active":"2024-03-04T08:50:38.370738+0000","last_became_peered":"2024-03-04T08:50:38.370738+0000","last_unstale":"2024-03-04T08:50:41.762394+0000","last_undegraded":"2024-03-04T08:50:41.762394+0000","last_fullsized":"2024-03-04T08:50:41.762394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.345970+0000","last_change":"2024-03-04T08:50:37.359455+0000","last_active":"2024-03-04T08:50:40.345970+0000","last_peered":"2024-03-04T08:50:40.345970+0000","last_clean":"2024-03-04T08:50:40.345970+0000","last_became_active":"2024-03-04T08:50:37.359137+0000","last_became_peered":"2024-03-04T08:50:37.359137+0000","last_unstale":"2024-03-04T08:50:40.345970+0000","last_undegraded":"2024-03-04T08:50:40.345970+0000","last_fullsized":"2024-03-04T08:50:40.345970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346243+0000","last_change":"2024-03-04T08:50:38.367626+0000","last_active":"2024-03-04T08:50:40.346243+0000","last_peered":"2024-03-04T08:50:40.346243+0000","last_clean":"2024-03-04T08:50:40.346243+0000","last_became_active":"2024-03-04T08:50:38.367277+0000","last_became_peered":"2024-03-04T08:50:38.367277+0000","last_unstale":"2024-03-04T08:50:40.346243+0000","last_undegraded":"2024-03-04T08:50:40.346243+0000","last_fullsized":"2024-03-04T08:50:40.346243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:10.804770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394201+0000","last_change":"2024-03-04T08:50:37.356475+0000","last_active":"2024-03-04T08:50:39.394201+0000","last_peered":"2024-03-04T08:50:39.394201+0000","last_clean":"2024-03-04T08:50:39.394201+0000","last_became_active":"2024-03-04T08:50:37.356167+0000","last_became_peered":"2024-03-04T08:50:37.356167+0000","last_unstale":"2024-03-04T08:50:39.394201+0000","last_undegraded":"2024-03-04T08:50:39.394201+0000","last_fullsized":"2024-03-04T08:50:39.394201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:04.317447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762253+0000","last_change":"2024-03-04T08:50:38.372905+0000","last_active":"2024-03-04T08:50:41.762253+0000","last_peered":"2024-03-04T08:50:41.762253+0000","last_clean":"2024-03-04T08:50:41.762253+0000","last_became_active":"2024-03-04T08:50:38.371431+0000","last_became_peered":"2024-03-04T08:50:38.371431+0000","last_unstale":"2024-03-04T08:50:41.762253+0000","last_undegraded":"2024-03-04T08:50:41.762253+0000","last_fullsized":"2024-03-04T08:50:41.762253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514853+0000","last_change":"2024-03-04T08:50:37.348431+0000","last_active":"2024-03-04T08:50:40.514853+0000","last_peered":"2024-03-04T08:50:40.514853+0000","last_clean":"2024-03-04T08:50:40.514853+0000","last_became_active":"2024-03-04T08:50:37.348149+0000","last_became_peered":"2024-03-04T08:50:37.348149+0000","last_unstale":"2024-03-04T08:50:40.514853+0000","last_undegraded":"2024-03-04T08:50:40.514853+0000","last_fullsized":"2024-03-04T08:50:40.514853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:29.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762561+0000","last_change":"2024-03-04T08:50:38.372063+0000","last_active":"2024-03-04T08:50:41.762561+0000","last_peered":"2024-03-04T08:50:41.762561+0000","last_clean":"2024-03-04T08:50:41.762561+0000","last_became_active":"2024-03-04T08:50:38.371539+0000","last_became_peered":"2024-03-04T08:50:38.371539+0000","last_unstale":"2024-03-04T08:50:41.762561+0000","last_undegraded":"2024-03-04T08:50:41.762561+0000","last_fullsized":"2024-03-04T08:50:41.762561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:04.270572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394382+0000","last_change":"2024-03-04T08:50:37.350563+0000","last_active":"2024-03-04T08:50:39.394382+0000","last_peered":"2024-03-04T08:50:39.394382+0000","last_clean":"2024-03-04T08:50:39.394382+0000","last_became_active":"2024-03-04T08:50:37.350303+0000","last_became_peered":"2024-03-04T08:50:37.350303+0000","last_unstale":"2024-03-04T08:50:39.394382+0000","last_undegraded":"2024-03-04T08:50:39.394382+0000","last_fullsized":"2024-03-04T08:50:39.394382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762700+0000","last_change":"2024-03-04T08:50:38.373725+0000","last_active":"2024-03-04T08:50:41.762700+0000","last_peered":"2024-03-04T08:50:41.762700+0000","last_clean":"2024-03-04T08:50:41.762700+0000","last_became_active":"2024-03-04T08:50:38.372170+0000","last_became_peered":"2024-03-04T08:50:38.372170+0000","last_unstale":"2024-03-04T08:50:41.762700+0000","last_undegraded":"2024-03-04T08:50:41.762700+0000","last_fullsized":"2024-03-04T08:50:41.762700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:00.038272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356317+0000","last_change":"2024-03-04T08:50:37.361906+0000","last_active":"2024-03-04T08:50:39.356317+0000","last_peered":"2024-03-04T08:50:39.356317+0000","last_clean":"2024-03-04T08:50:39.356317+0000","last_became_active":"2024-03-04T08:50:37.361573+0000","last_became_peered":"2024-03-04T08:50:37.361573+0000","last_unstale":"2024-03-04T08:50:39.356317+0000","last_undegraded":"2024-03-04T08:50:39.356317+0000","last_fullsized":"2024-03-04T08:50:39.356317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:36.835486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361451+0000","last_change":"2024-03-04T08:50:38.365801+0000","last_active":"2024-03-04T08:50:39.361451+0000","last_peered":"2024-03-04T08:50:39.361451+0000","last_clean":"2024-03-04T08:50:39.361451+0000","last_became_active":"2024-03-04T08:50:38.365312+0000","last_became_peered":"2024-03-04T08:50:38.365312+0000","last_unstale":"2024-03-04T08:50:39.361451+0000","last_undegraded":"2024-03-04T08:50:39.361451+0000","last_fullsized":"2024-03-04T08:50:39.361451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394416+0000","last_change":"2024-03-04T08:50:37.357282+0000","last_active":"2024-03-04T08:50:39.394416+0000","last_peered":"2024-03-04T08:50:39.394416+0000","last_clean":"2024-03-04T08:50:39.394416+0000","last_became_active":"2024-03-04T08:50:37.356970+0000","last_became_peered":"2024-03-04T08:50:37.356970+0000","last_unstale":"2024-03-04T08:50:39.394416+0000","last_undegraded":"2024-03-04T08:50:39.394416+0000","last_fullsized":"2024-03-04T08:50:39.394416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762501+0000","last_change":"2024-03-04T08:50:38.373876+0000","last_active":"2024-03-04T08:50:41.762501+0000","last_peered":"2024-03-04T08:50:41.762501+0000","last_clean":"2024-03-04T08:50:41.762501+0000","last_became_active":"2024-03-04T08:50:38.373349+0000","last_became_peered":"2024-03-04T08:50:38.373349+0000","last_unstale":"2024-03-04T08:50:41.762501+0000","last_undegraded":"2024-03-04T08:50:41.762501+0000","last_fullsized":"2024-03-04T08:50:41.762501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:03.689696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762019+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:50:41.762019+0000","last_peered":"2024-03-04T08:50:41.762019+0000","last_clean":"2024-03-04T08:50:41.762019+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:50:41.762019+0000","last_undegraded":"2024-03-04T08:50:41.762019+0000","last_fullsized":"2024-03-04T08:50:41.762019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.360752+0000","last_change":"2024-03-04T08:50:37.356373+0000","last_active":"2024-03-04T08:50:39.360752+0000","last_peered":"2024-03-04T08:50:39.360752+0000","last_clean":"2024-03-04T08:50:39.360752+0000","last_became_active":"2024-03-04T08:50:37.356102+0000","last_became_peered":"2024-03-04T08:50:37.356102+0000","last_unstale":"2024-03-04T08:50:39.360752+0000","last_undegraded":"2024-03-04T08:50:39.360752+0000","last_fullsized":"2024-03-04T08:50:39.360752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:46.880293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358993+0000","last_change":"2024-03-04T08:50:38.369654+0000","last_active":"2024-03-04T08:50:39.358993+0000","last_peered":"2024-03-04T08:50:39.358993+0000","last_clean":"2024-03-04T08:50:39.358993+0000","last_became_active":"2024-03-04T08:50:38.369253+0000","last_became_peered":"2024-03-04T08:50:38.369253+0000","last_unstale":"2024-03-04T08:50:39.358993+0000","last_undegraded":"2024-03-04T08:50:39.358993+0000","last_fullsized":"2024-03-04T08:50:39.358993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:11.357788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762136+0000","last_change":"2024-03-04T08:50:37.358364+0000","last_active":"2024-03-04T08:50:41.762136+0000","last_peered":"2024-03-04T08:50:41.762136+0000","last_clean":"2024-03-04T08:50:41.762136+0000","last_became_active":"2024-03-04T08:50:37.358020+0000","last_became_peered":"2024-03-04T08:50:37.358020+0000","last_unstale":"2024-03-04T08:50:41.762136+0000","last_undegraded":"2024-03-04T08:50:41.762136+0000","last_fullsized":"2024-03-04T08:50:41.762136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:49.927169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.854875+0000","last_change":"2024-03-04T08:50:38.349604+0000","last_active":"2024-03-04T08:50:39.854875+0000","last_peered":"2024-03-04T08:50:39.854875+0000","last_clean":"2024-03-04T08:50:39.854875+0000","last_became_active":"2024-03-04T08:50:38.349258+0000","last_became_peered":"2024-03-04T08:50:38.349258+0000","last_unstale":"2024-03-04T08:50:39.854875+0000","last_undegraded":"2024-03-04T08:50:39.854875+0000","last_fullsized":"2024-03-04T08:50:39.854875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:24:43.330397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.394293+0000","last_change":"2024-03-04T08:50:37.350362+0000","last_active":"2024-03-04T08:50:39.394293+0000","last_peered":"2024-03-04T08:50:39.394293+0000","last_clean":"2024-03-04T08:50:39.394293+0000","last_became_active":"2024-03-04T08:50:37.350066+0000","last_became_peered":"2024-03-04T08:50:37.350066+0000","last_unstale":"2024-03-04T08:50:39.394293+0000","last_undegraded":"2024-03-04T08:50:39.394293+0000","last_fullsized":"2024-03-04T08:50:39.394293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:00.716844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355805+0000","last_change":"2024-03-04T08:50:38.355177+0000","last_active":"2024-03-04T08:50:39.355805+0000","last_peered":"2024-03-04T08:50:39.355805+0000","last_clean":"2024-03-04T08:50:39.355805+0000","last_became_active":"2024-03-04T08:50:38.353910+0000","last_became_peered":"2024-03-04T08:50:38.353910+0000","last_unstale":"2024-03-04T08:50:39.355805+0000","last_undegraded":"2024-03-04T08:50:39.355805+0000","last_fullsized":"2024-03-04T08:50:39.355805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:25.269184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361102+0000","last_change":"2024-03-04T08:50:37.359035+0000","last_active":"2024-03-04T08:50:39.361102+0000","last_peered":"2024-03-04T08:50:39.361102+0000","last_clean":"2024-03-04T08:50:39.361102+0000","last_became_active":"2024-03-04T08:50:37.358433+0000","last_became_peered":"2024-03-04T08:50:37.358433+0000","last_unstale":"2024-03-04T08:50:39.361102+0000","last_undegraded":"2024-03-04T08:50:39.361102+0000","last_fullsized":"2024-03-04T08:50:39.361102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514747+0000","last_change":"2024-03-04T08:50:38.354649+0000","last_active":"2024-03-04T08:50:40.514747+0000","last_peered":"2024-03-04T08:50:40.514747+0000","last_clean":"2024-03-04T08:50:40.514747+0000","last_became_active":"2024-03-04T08:50:38.354373+0000","last_became_peered":"2024-03-04T08:50:38.354373+0000","last_unstale":"2024-03-04T08:50:40.514747+0000","last_undegraded":"2024-03-04T08:50:40.514747+0000","last_fullsized":"2024-03-04T08:50:40.514747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:06.980599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355981+0000","last_change":"2024-03-04T08:50:37.359394+0000","last_active":"2024-03-04T08:50:39.355981+0000","last_peered":"2024-03-04T08:50:39.355981+0000","last_clean":"2024-03-04T08:50:39.355981+0000","last_became_active":"2024-03-04T08:50:37.359074+0000","last_became_peered":"2024-03-04T08:50:37.359074+0000","last_unstale":"2024-03-04T08:50:39.355981+0000","last_undegraded":"2024-03-04T08:50:39.355981+0000","last_fullsized":"2024-03-04T08:50:39.355981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:05.975172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361386+0000","last_change":"2024-03-04T08:50:38.366605+0000","last_active":"2024-03-04T08:50:39.361386+0000","last_peered":"2024-03-04T08:50:39.361386+0000","last_clean":"2024-03-04T08:50:39.361386+0000","last_became_active":"2024-03-04T08:50:38.366328+0000","last_became_peered":"2024-03-04T08:50:38.366328+0000","last_unstale":"2024-03-04T08:50:39.361386+0000","last_undegraded":"2024-03-04T08:50:39.361386+0000","last_fullsized":"2024-03-04T08:50:39.361386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:29.595373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762564+0000","last_change":"2024-03-04T08:50:37.360537+0000","last_active":"2024-03-04T08:50:41.762564+0000","last_peered":"2024-03-04T08:50:41.762564+0000","last_clean":"2024-03-04T08:50:41.762564+0000","last_became_active":"2024-03-04T08:50:37.360242+0000","last_became_peered":"2024-03-04T08:50:37.360242+0000","last_unstale":"2024-03-04T08:50:41.762564+0000","last_undegraded":"2024-03-04T08:50:41.762564+0000","last_fullsized":"2024-03-04T08:50:41.762564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:57.217313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355894+0000","last_change":"2024-03-04T08:50:38.353570+0000","last_active":"2024-03-04T08:50:39.355894+0000","last_peered":"2024-03-04T08:50:39.355894+0000","last_clean":"2024-03-04T08:50:39.355894+0000","last_became_active":"2024-03-04T08:50:38.353295+0000","last_became_peered":"2024-03-04T08:50:38.353295+0000","last_unstale":"2024-03-04T08:50:39.355894+0000","last_undegraded":"2024-03-04T08:50:39.355894+0000","last_fullsized":"2024-03-04T08:50:39.355894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:50.638296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.148899+0000","last_change":"2024-03-04T08:50:37.361158+0000","last_active":"2024-03-04T08:50:40.148899+0000","last_peered":"2024-03-04T08:50:40.148899+0000","last_clean":"2024-03-04T08:50:40.148899+0000","last_became_active":"2024-03-04T08:50:37.360861+0000","last_became_peered":"2024-03-04T08:50:37.360861+0000","last_unstale":"2024-03-04T08:50:40.148899+0000","last_undegraded":"2024-03-04T08:50:40.148899+0000","last_fullsized":"2024-03-04T08:50:40.148899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:25.636822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359145+0000","last_change":"2024-03-04T08:50:38.361565+0000","last_active":"2024-03-04T08:50:39.359145+0000","last_peered":"2024-03-04T08:50:39.359145+0000","last_clean":"2024-03-04T08:50:39.359145+0000","last_became_active":"2024-03-04T08:50:38.361273+0000","last_became_peered":"2024-03-04T08:50:38.361273+0000","last_unstale":"2024-03-04T08:50:39.359145+0000","last_undegraded":"2024-03-04T08:50:39.359145+0000","last_fullsized":"2024-03-04T08:50:39.359145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:58.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346274+0000","last_change":"2024-03-04T08:50:37.359717+0000","last_active":"2024-03-04T08:50:40.346274+0000","last_peered":"2024-03-04T08:50:40.346274+0000","last_clean":"2024-03-04T08:50:40.346274+0000","last_became_active":"2024-03-04T08:50:37.359245+0000","last_became_peered":"2024-03-04T08:50:37.359245+0000","last_unstale":"2024-03-04T08:50:40.346274+0000","last_undegraded":"2024-03-04T08:50:40.346274+0000","last_fullsized":"2024-03-04T08:50:40.346274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855169+0000","last_change":"2024-03-04T08:50:38.352594+0000","last_active":"2024-03-04T08:50:39.855169+0000","last_peered":"2024-03-04T08:50:39.855169+0000","last_clean":"2024-03-04T08:50:39.855169+0000","last_became_active":"2024-03-04T08:50:38.352332+0000","last_became_peered":"2024-03-04T08:50:38.352332+0000","last_unstale":"2024-03-04T08:50:39.855169+0000","last_undegraded":"2024-03-04T08:50:39.855169+0000","last_fullsized":"2024-03-04T08:50:39.855169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762053+0000","last_change":"2024-03-04T08:50:37.360157+0000","last_active":"2024-03-04T08:50:41.762053+0000","last_peered":"2024-03-04T08:50:41.762053+0000","last_clean":"2024-03-04T08:50:41.762053+0000","last_became_active":"2024-03-04T08:50:37.359874+0000","last_became_peered":"2024-03-04T08:50:37.359874+0000","last_unstale":"2024-03-04T08:50:41.762053+0000","last_undegraded":"2024-03-04T08:50:41.762053+0000","last_fullsized":"2024-03-04T08:50:41.762053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:11.606336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.514579+0000","last_change":"2024-03-04T08:50:38.352761+0000","last_active":"2024-03-04T08:50:40.514579+0000","last_peered":"2024-03-04T08:50:40.514579+0000","last_clean":"2024-03-04T08:50:40.514579+0000","last_became_active":"2024-03-04T08:50:38.352495+0000","last_became_peered":"2024-03-04T08:50:38.352495+0000","last_unstale":"2024-03-04T08:50:40.514579+0000","last_undegraded":"2024-03-04T08:50:40.514579+0000","last_fullsized":"2024-03-04T08:50:40.514579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:26.642248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.355888+0000","last_change":"2024-03-04T08:50:37.354759+0000","last_active":"2024-03-04T08:50:39.355888+0000","last_peered":"2024-03-04T08:50:39.355888+0000","last_clean":"2024-03-04T08:50:39.355888+0000","last_became_active":"2024-03-04T08:50:37.354422+0000","last_became_peered":"2024-03-04T08:50:37.354422+0000","last_unstale":"2024-03-04T08:50:39.355888+0000","last_undegraded":"2024-03-04T08:50:39.355888+0000","last_fullsized":"2024-03-04T08:50:39.355888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:19.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358708+0000","last_change":"2024-03-04T08:50:38.351791+0000","last_active":"2024-03-04T08:50:39.358708+0000","last_peered":"2024-03-04T08:50:39.358708+0000","last_clean":"2024-03-04T08:50:39.358708+0000","last_became_active":"2024-03-04T08:50:38.351453+0000","last_became_peered":"2024-03-04T08:50:38.351453+0000","last_unstale":"2024-03-04T08:50:39.358708+0000","last_undegraded":"2024-03-04T08:50:39.358708+0000","last_fullsized":"2024-03-04T08:50:39.358708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:12.854933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.356200+0000","last_change":"2024-03-04T08:50:37.359334+0000","last_active":"2024-03-04T08:50:39.356200+0000","last_peered":"2024-03-04T08:50:39.356200+0000","last_clean":"2024-03-04T08:50:39.356200+0000","last_became_active":"2024-03-04T08:50:37.358920+0000","last_became_peered":"2024-03-04T08:50:37.358920+0000","last_unstale":"2024-03-04T08:50:39.356200+0000","last_undegraded":"2024-03-04T08:50:39.356200+0000","last_fullsized":"2024-03-04T08:50:39.356200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:20.377137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359031+0000","last_change":"2024-03-04T08:50:38.358946+0000","last_active":"2024-03-04T08:50:39.359031+0000","last_peered":"2024-03-04T08:50:39.359031+0000","last_clean":"2024-03-04T08:50:39.359031+0000","last_became_active":"2024-03-04T08:50:38.357473+0000","last_became_peered":"2024-03-04T08:50:38.357473+0000","last_unstale":"2024-03-04T08:50:39.359031+0000","last_undegraded":"2024-03-04T08:50:39.359031+0000","last_fullsized":"2024-03-04T08:50:39.359031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762489+0000","last_change":"2024-03-04T08:50:37.354833+0000","last_active":"2024-03-04T08:50:41.762489+0000","last_peered":"2024-03-04T08:50:41.762489+0000","last_clean":"2024-03-04T08:50:41.762489+0000","last_became_active":"2024-03-04T08:50:37.354239+0000","last_became_peered":"2024-03-04T08:50:37.354239+0000","last_unstale":"2024-03-04T08:50:41.762489+0000","last_undegraded":"2024-03-04T08:50:41.762489+0000","last_fullsized":"2024-03-04T08:50:41.762489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.516522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:40.346287+0000","last_change":"2024-03-04T08:50:38.361714+0000","last_active":"2024-03-04T08:50:40.346287+0000","last_peered":"2024-03-04T08:50:40.346287+0000","last_clean":"2024-03-04T08:50:40.346287+0000","last_became_active":"2024-03-04T08:50:38.361376+0000","last_became_peered":"2024-03-04T08:50:38.361376+0000","last_unstale":"2024-03-04T08:50:40.346287+0000","last_undegraded":"2024-03-04T08:50:40.346287+0000","last_fullsized":"2024-03-04T08:50:40.346287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:51:31.896479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361371+0000","last_change":"2024-03-04T08:50:38.365933+0000","last_active":"2024-03-04T08:50:39.361371+0000","last_peered":"2024-03-04T08:50:39.361371+0000","last_clean":"2024-03-04T08:50:39.361371+0000","last_became_active":"2024-03-04T08:50:38.365628+0000","last_became_peered":"2024-03-04T08:50:38.365628+0000","last_unstale":"2024-03-04T08:50:39.361371+0000","last_undegraded":"2024-03-04T08:50:39.361371+0000","last_fullsized":"2024-03-04T08:50:39.361371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:54.537176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762331+0000","last_change":"2024-03-04T08:50:37.359532+0000","last_active":"2024-03-04T08:50:41.762331+0000","last_peered":"2024-03-04T08:50:41.762331+0000","last_clean":"2024-03-04T08:50:41.762331+0000","last_became_active":"2024-03-04T08:50:37.359226+0000","last_became_peered":"2024-03-04T08:50:37.359226+0000","last_unstale":"2024-03-04T08:50:41.762331+0000","last_undegraded":"2024-03-04T08:50:41.762331+0000","last_fullsized":"2024-03-04T08:50:41.762331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:43:46.282773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.361119+0000","last_change":"2024-03-04T08:50:38.365556+0000","last_active":"2024-03-04T08:50:39.361119+0000","last_peered":"2024-03-04T08:50:39.361119+0000","last_clean":"2024-03-04T08:50:39.361119+0000","last_became_active":"2024-03-04T08:50:38.364736+0000","last_became_peered":"2024-03-04T08:50:38.364736+0000","last_unstale":"2024-03-04T08:50:39.361119+0000","last_undegraded":"2024-03-04T08:50:39.361119+0000","last_fullsized":"2024-03-04T08:50:39.361119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:55.860562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:41.762390+0000","last_change":"2024-03-04T08:50:37.362398+0000","last_active":"2024-03-04T08:50:41.762390+0000","last_peered":"2024-03-04T08:50:41.762390+0000","last_clean":"2024-03-04T08:50:41.762390+0000","last_became_active":"2024-03-04T08:50:37.362117+0000","last_became_peered":"2024-03-04T08:50:37.362117+0000","last_unstale":"2024-03-04T08:50:41.762390+0000","last_undegraded":"2024-03-04T08:50:41.762390+0000","last_fullsized":"2024-03-04T08:50:41.762390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:13:00.335926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855227+0000","last_change":"2024-03-04T08:50:38.365989+0000","last_active":"2024-03-04T08:50:39.855227+0000","last_peered":"2024-03-04T08:50:39.855227+0000","last_clean":"2024-03-04T08:50:39.855227+0000","last_became_active":"2024-03-04T08:50:38.365578+0000","last_became_peered":"2024-03-04T08:50:38.365578+0000","last_unstale":"2024-03-04T08:50:39.855227+0000","last_undegraded":"2024-03-04T08:50:39.855227+0000","last_fullsized":"2024-03-04T08:50:39.855227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:08:44.064640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.358915+0000","last_change":"2024-03-04T08:50:37.348349+0000","last_active":"2024-03-04T08:50:39.358915+0000","last_peered":"2024-03-04T08:50:39.358915+0000","last_clean":"2024-03-04T08:50:39.358915+0000","last_became_active":"2024-03-04T08:50:37.348047+0000","last_became_peered":"2024-03-04T08:50:37.348047+0000","last_unstale":"2024-03-04T08:50:39.358915+0000","last_undegraded":"2024-03-04T08:50:39.358915+0000","last_fullsized":"2024-03-04T08:50:39.358915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:50:42.734346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.359023+0000","last_change":"2024-03-04T08:50:38.361937+0000","last_active":"2024-03-04T08:50:39.359023+0000","last_peered":"2024-03-04T08:50:39.359023+0000","last_clean":"2024-03-04T08:50:39.359023+0000","last_became_active":"2024-03-04T08:50:38.360865+0000","last_became_peered":"2024-03-04T08:50:38.360865+0000","last_unstale":"2024-03-04T08:50:39.359023+0000","last_undegraded":"2024-03-04T08:50:39.359023+0000","last_fullsized":"2024-03-04T08:50:39.359023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:37.331491+0000","last_clean_scrub_stamp":"2024-03-04T08:50:37.331491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:58:26.607498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-04T08:50:39.855261+0000","last_change":"2024-03-04T08:50:37.356168+0000","last_active":"2024-03-04T08:50:39.855261+0000","last_peered":"2024-03-04T08:50:39.855261+0000","last_clean":"2024-03-04T08:50:39.855261+0000","last_became_active":"2024-03-04T08:50:37.353917+0000","last_became_peered":"2024-03-04T08:50:37.353917+0000","last_unstale":"2024-03-04T08:50:39.855261+0000","last_undegraded":"2024-03-04T08:50:39.855261+0000","last_fullsized":"2024-03-04T08:50:39.855261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:36.326065+0000","last_clean_scrub_stamp":"2024-03-04T08:50:36.326065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:46.059440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":664083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":664139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:50:50.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T08:50:50.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T08:50:50.508 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-04T08:50:50.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-04T08:50:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.649+0000 7f4f6c2c9640 1 Processor -- start 2024-03-04T08:50:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.649+0000 7f4f6c2c9640 1 -- start start 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6c2c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 0x7f4f64168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6c2c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640ce510 con 0x7f4f641586c0 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6c2c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f64161cf0 con 0x7f4f640b0240 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6c2c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64158aa0 con 0x7f4f6406b6c0 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6a065640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f641586c0 0x7f4f6415efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42964/0 (socket says 172.21.15.19:42964) 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6a065640 1 -- 172.21.15.19:0/826074827 learned_addr learned my addr 172.21.15.19:0/826074827 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6a866640 1 --2- 172.21.15.19:0/826074827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 0x7f4f64168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462201614 0 0) 0x7f4f640ce510 con 0x7f4f641586c0 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f50003520 con 0x7f4f641586c0 2024-03-04T08:50:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708213167 0 0) 0x7f4f64161cf0 con 0x7f4f640b0240 2024-03-04T08:50:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f640ce510 con 0x7f4f640b0240 2024-03-04T08:50:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.650+0000 7f4f6a866640 1 -- 172.21.15.19:0/826074827 >> v1:172.21.15.204:6789/0 conn(0x7f4f640b0240 legacy=0x7f4f6406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f6a866640 1 -- 172.21.15.19:0/826074827 >> v1:172.21.15.19:6789/0 conn(0x7f4f641586c0 legacy=0x7f4f6415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f6a866640 1 -- 172.21.15.19:0/826074827 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64161fd0 con 0x7f4f6406b6c0 2024-03-04T08:50:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f6a866640 1 --2- 172.21.15.19:0/826074827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 0x7f4f64168ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009dc0 tx=0x7f4f6002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5284c25c49d6df7b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60039070 con 0x7f4f6406b6c0 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6002ccd0 con 0x7f4f6406b6c0 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.651+0000 7f4f69063640 1 -- 172.21.15.19:0/826074827 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60034660 con 0x7f4f6406b6c0 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/826074827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 msgr2=0x7f4f64168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/826074827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 0x7f4f64168ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009dc0 tx=0x7f4f6002bf20 comp rx=0 tx=0).stop 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/826074827 shutdown_connections 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/826074827 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f6406b6c0 0x7f4f64168ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/826074827 >> 172.21.15.19:0/826074827 conn(0x7f4f640d09d0 msgr2=0x7f4f640d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/826074827 shutdown_connections 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.652+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/826074827 wait complete. 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.653+0000 7f4f6c2c9640 1 Processor -- start 2024-03-04T08:50:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.653+0000 7f4f6c2c9640 1 -- start start 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6406b6c0 0x7f4f6414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f641586c0 0x7f4f640af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64162870 con 0x7f4f640b0240 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64162590 con 0x7f4f6406b6c0 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6c2c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640719e0 con 0x7f4f641586c0 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37230/0 (socket says 172.21.15.19:37230) 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 -- 172.21.15.19:0/1027488254 learned_addr learned my addr 172.21.15.19:0/1027488254 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6a065640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6406b6c0 0x7f4f6414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f6a866640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f641586c0 0x7f4f640af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 -- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f641586c0 msgr2=0x7f4f640af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f641586c0 0x7f4f640af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 -- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6406b6c0 msgr2=0x7f4f6414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6406b6c0 0x7f4f6414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.654+0000 7f4f69864640 1 -- 172.21.15.19:0/1027488254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f641e7ea0 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f69864640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c500 tx=0x7f4f5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540052d0 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54005490 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f641e8180 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54012870 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.655+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f64155720 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.656+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6404f330 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.656+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f54012a10 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.657+0000 7f4f5affd640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 0x7f4f4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.657+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f54089da0 con 0x7f4f640b0240 2024-03-04T08:50:50.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.657+0000 7f4f6a065640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 0x7f4f4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.657+0000 7f4f6a065640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 0x7f4f4806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0011e0 tx=0x7f4f5c007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.661+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f540585e0 con 0x7f4f640b0240 2024-03-04T08:50:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.883+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f64157ad0 con 0x7f4f640b0240 2024-03-04T08:50:50.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.883+0000 7f4f5affd640 1 -- 172.21.15.19:0/1027488254 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4f5405c680 con 0x7f4f640b0240 2024-03-04T08:50:50.880 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:50.880 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 msgr2=0x7f4f4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 0x7f4f4806d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0011e0 tx=0x7f4f5c007d30 comp rx=0 tx=0).stop 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 msgr2=0x7f4f640aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c500 tx=0x7f4f5400c9c0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 shutdown_connections 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4f641586c0 0x7f4f640af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f640b0240 0x7f4f640aecf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f4806b4d0 0x7f4f4806d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 --2- 172.21.15.19:0/1027488254 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4f6406b6c0 0x7f4f6414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 >> 172.21.15.19:0/1027488254 conn(0x7f4f640d09d0 msgr2=0x7f4f6406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 shutdown_connections 2024-03-04T08:50:50.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.885+0000 7f4f6c2c9640 1 -- 172.21.15.19:0/1027488254 wait complete. 2024-03-04T08:50:50.892 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-04T08:50:50.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:50.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 Processor -- start 2024-03-04T08:50:50.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 -- start start 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faef015dfe0 0x7faef00cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00b3430 con 0x7faef00cf830 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00b3710 con 0x7faef00d29c0 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.998+0000 7faef6a64640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00b31e0 con 0x7faef015dfe0 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faef4800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faef015dfe0 0x7faef00cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faeeffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7faef00cf830 0x7faef00d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42974/0 (socket says 172.21.15.19:42974) 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faeeffff640 1 -- 172.21.15.19:0/2466148361 learned_addr learned my addr 172.21.15.19:0/2466148361 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faef4800640 1 -- 172.21.15.19:0/2466148361 >> v1:172.21.15.204:6789/0 conn(0x7faef00d29c0 legacy=0x7faef00b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faef4800640 1 -- 172.21.15.19:0/2466148361 >> v1:172.21.15.19:6789/0 conn(0x7faef00cf830 legacy=0x7faef00d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faef4800640 1 -- 172.21.15.19:0/2466148361 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00b39f0 con 0x7faef015dfe0 2024-03-04T08:50:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:50.999+0000 7faeef7fe640 1 -- 172.21.15.19:0/2466148361 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617779300 0 0) 0x7faef00b3430 con 0x7faef00cf830 2024-03-04T08:50:50.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef4800640 1 --2- 172.21.15.19:0/2466148361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef015dfe0 0x7faef00cf2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faef00b3360 tx=0x7faee802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fa7c700817adc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:50.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faeef7fe640 1 -- 172.21.15.19:0/2466148361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8039070 con 0x7faef015dfe0 2024-03-04T08:50:50.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faeef7fe640 1 -- 172.21.15.19:0/2466148361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee802cce0 con 0x7faef015dfe0 2024-03-04T08:50:50.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faeef7fe640 1 -- 172.21.15.19:0/2466148361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8034660 con 0x7faef015dfe0 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 -- 172.21.15.19:0/2466148361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef015dfe0 msgr2=0x7faef00cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 --2- 172.21.15.19:0/2466148361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef015dfe0 0x7faef00cf2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faef00b3360 tx=0x7faee802bf30 comp rx=0 tx=0).stop 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 -- 172.21.15.19:0/2466148361 shutdown_connections 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 --2- 172.21.15.19:0/2466148361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef015dfe0 0x7faef00cf2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 -- 172.21.15.19:0/2466148361 >> 172.21.15.19:0/2466148361 conn(0x7faef00d3cd0 msgr2=0x7faef00d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 -- 172.21.15.19:0/2466148361 shutdown_connections 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.000+0000 7faef6a64640 1 -- 172.21.15.19:0/2466148361 wait complete. 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.001+0000 7faef6a64640 1 Processor -- start 2024-03-04T08:50:50.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.001+0000 7faef6a64640 1 -- start start 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef00cf830 0x7faef00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef015dfe0 0x7faef01f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef015e3c0 con 0x7faef00d29c0 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00b3d60 con 0x7faef00cf830 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef6a64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef015e540 con 0x7faef015dfe0 2024-03-04T08:50:51.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faeeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faeeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37244/0 (socket says 172.21.15.19:37244) 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faeeffff640 1 -- 172.21.15.19:0/4036791837 learned_addr learned my addr 172.21.15.19:0/4036791837 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.002+0000 7faef4800640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef00cf830 0x7faef00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faef5001640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef015dfe0 0x7faef01f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 -- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef015dfe0 msgr2=0x7faef01f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef015dfe0 0x7faef01f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 -- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef00cf830 msgr2=0x7faef00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef00cf830 0x7faef00cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 -- 172.21.15.19:0/4036791837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00b81d0 con 0x7faef00d29c0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeeffff640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faee400c460 tx=0x7faee400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4018070 con 0x7faef00d29c0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4007520 con 0x7faef00d29c0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef00b84b0 con 0x7faef00d29c0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004a20 con 0x7faef00d29c0 2024-03-04T08:50:51.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.003+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef00b8a70 con 0x7faef00d29c0 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.004+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef004f330 con 0x7faef00d29c0 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.005+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faee401b070 con 0x7faef00d29c0 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.005+0000 7faeed7fa640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 0x7faedc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.005+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faee40894a0 con 0x7faef00d29c0 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.005+0000 7faef4800640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 0x7faedc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.006+0000 7faef4800640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 0x7faedc06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faee8036000 tx=0x7faee8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.009+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faee4057d60 con 0x7faef00d29c0 2024-03-04T08:50:51.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.192+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faef015d700 con 0x7faef00d29c0 2024-03-04T08:50:51.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.193+0000 7faeed7fa640 1 -- 172.21.15.19:0/4036791837 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7faee405be00 con 0x7faef00d29c0 2024-03-04T08:50:51.190 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:51.190 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 msgr2=0x7faedc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 0x7faedc06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faee8036000 tx=0x7faee8030000 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 msgr2=0x7faef00b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faee400c460 tx=0x7faee400c920 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 shutdown_connections 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faef015dfe0 0x7faef01f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef00d29c0 0x7faef00b1410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faedc06b4d0 0x7faedc06d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 --2- 172.21.15.19:0/4036791837 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faef00cf830 0x7faef00cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 >> 172.21.15.19:0/4036791837 conn(0x7faef00d3cd0 msgr2=0x7faef00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.195+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 shutdown_connections 2024-03-04T08:50:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.196+0000 7faef6a64640 1 -- 172.21.15.19:0/4036791837 wait complete. 2024-03-04T08:50:51.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:51.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:51.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.311+0000 7fed5684e640 1 Processor -- start 2024-03-04T08:50:51.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.311+0000 7fed5684e640 1 -- start start 2024-03-04T08:50:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed5684e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed500cf9a0 0x7fed500b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed5684e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed500b55e0 0x7fed500ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed5684e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5006b710 con 0x7fed50066d90 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed5684e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5006b150 con 0x7fed500b55e0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed5684e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5006b430 con 0x7fed500cf9a0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed54deb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed500b55e0 0x7fed500ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed4f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fed50066d90 0x7fed500b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42978/0 (socket says 172.21.15.19:42978) 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed4f7fe640 1 -- 172.21.15.19:0/1281933709 learned_addr learned my addr 172.21.15.19:0/1281933709 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed4ffff640 1 --2- 172.21.15.19:0/1281933709 >> v2:172.21.15.204:3300/0 conn(0x7fed500cf9a0 0x7fed500b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed54deb640 1 -- 172.21.15.19:0/1281933709 >> v2:172.21.15.204:3300/0 conn(0x7fed500cf9a0 msgr2=0x7fed500b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed54deb640 1 --2- 172.21.15.19:0/1281933709 >> v2:172.21.15.204:3300/0 conn(0x7fed500cf9a0 0x7fed500b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed54deb640 1 -- 172.21.15.19:0/1281933709 >> v1:172.21.15.19:6789/0 conn(0x7fed50066d90 legacy=0x7fed500b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed54deb640 1 -- 172.21.15.19:0/1281933709 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500b0970 con 0x7fed500b55e0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.312+0000 7fed4effd640 1 -- 172.21.15.19:0/1281933709 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276934412 0 0) 0x7fed5006b710 con 0x7fed50066d90 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.313+0000 7fed54deb640 1 --2- 172.21.15.19:0/1281933709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500b55e0 0x7fed500ce040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed500d1240 tx=0x7fed4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7bceae808ec27d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.313+0000 7fed4effd640 1 -- 172.21.15.19:0/1281933709 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48039070 con 0x7fed500b55e0 2024-03-04T08:50:51.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.313+0000 7fed4effd640 1 -- 172.21.15.19:0/1281933709 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4802cc80 con 0x7fed500b55e0 2024-03-04T08:50:51.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.313+0000 7fed4effd640 1 -- 172.21.15.19:0/1281933709 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48034660 con 0x7fed500b55e0 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 -- 172.21.15.19:0/1281933709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500b55e0 msgr2=0x7fed500ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 --2- 172.21.15.19:0/1281933709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500b55e0 0x7fed500ce040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed500d1240 tx=0x7fed4802bed0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 -- 172.21.15.19:0/1281933709 shutdown_connections 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 --2- 172.21.15.19:0/1281933709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500b55e0 0x7fed500ce040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 --2- 172.21.15.19:0/1281933709 >> v2:172.21.15.204:3300/0 conn(0x7fed500cf9a0 0x7fed500b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 -- 172.21.15.19:0/1281933709 >> 172.21.15.19:0/1281933709 conn(0x7fed500b1d70 msgr2=0x7fed500b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 -- 172.21.15.19:0/1281933709 shutdown_connections 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.314+0000 7fed5684e640 1 -- 172.21.15.19:0/1281933709 wait complete. 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.315+0000 7fed5684e640 1 Processor -- start 2024-03-04T08:50:51.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.315+0000 7fed5684e640 1 -- start start 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed50066d90 0x7fed500cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed500b55e0 0x7fed5015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500b6170 con 0x7fed500cf9a0 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500b5ff0 con 0x7fed50066d90 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed5684e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500cfd80 con 0x7fed500b55e0 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37264/0 (socket says 172.21.15.19:37264) 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 -- 172.21.15.19:0/1000756685 learned_addr learned my addr 172.21.15.19:0/1000756685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed4ffff640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed50066d90 0x7fed500cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed4f7fe640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed500b55e0 0x7fed5015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 -- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed500b55e0 msgr2=0x7fed5015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed500b55e0 0x7fed5015fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 -- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed50066d90 msgr2=0x7fed500cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed50066d90 0x7fed500cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.316+0000 7fed54deb640 1 -- 172.21.15.19:0/1000756685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50160d40 con 0x7fed500cf9a0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed54deb640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed48037040 tx=0x7fed48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48039050 con 0x7fed500cf9a0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed48045070 con 0x7fed500cf9a0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed500c7ca0 con 0x7fed500cf9a0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48009450 con 0x7fed500cf9a0 2024-03-04T08:50:51.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.317+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed500c8260 con 0x7fed500cf9a0 2024-03-04T08:50:51.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.318+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5009e3d0 con 0x7fed500cf9a0 2024-03-04T08:50:51.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.318+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed4803e850 con 0x7fed500cf9a0 2024-03-04T08:50:51.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.318+0000 7fed4cff9640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 0x7fed3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.319+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed480ad140 con 0x7fed500cf9a0 2024-03-04T08:50:51.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.319+0000 7fed4ffff640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 0x7fed3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.320+0000 7fed4ffff640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 0x7fed3c06d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed44009aa0 tx=0x7fed44009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.323+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed50160d40 con 0x7fed500cf9a0 2024-03-04T08:50:51.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.505+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed5006e900 con 0x7fed500cf9a0 2024-03-04T08:50:51.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.505+0000 7fed4cff9640 1 -- 172.21.15.19:0/1000756685 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed4807bb20 con 0x7fed500cf9a0 2024-03-04T08:50:51.502 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 msgr2=0x7fed3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 0x7fed3c06d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed44009aa0 tx=0x7fed44009190 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 msgr2=0x7fed5006d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed48037040 tx=0x7fed48004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 shutdown_connections 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed500cf9a0 0x7fed5006d4a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed500b55e0 0x7fed5015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed3c06b4d0 0x7fed3c06d990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 --2- 172.21.15.19:0/1000756685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed50066d90 0x7fed500cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 >> 172.21.15.19:0/1000756685 conn(0x7fed500b1d70 msgr2=0x7fed500b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 shutdown_connections 2024-03-04T08:50:51.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.507+0000 7fed5684e640 1 -- 172.21.15.19:0/1000756685 wait complete. 2024-03-04T08:50:51.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:50:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.622+0000 7fefe9335640 1 Processor -- start 2024-03-04T08:50:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.622+0000 7fefe9335640 1 -- start start 2024-03-04T08:50:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe9335640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fefe41614d0 0x7fefe40d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe9335640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 0x7fefe40d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe9335640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40d2740 con 0x7fefe40d22b0 2024-03-04T08:50:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe9335640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe41618b0 con 0x7fefe41614d0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe9335640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cf400 con 0x7fefe40d1910 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe2ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fefe41614d0 0x7fefe40d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 0x7fefe40d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe37fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fefe40d22b0 0x7fefe40d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:55384/0 (socket says 172.21.15.19:55384) 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe37fe640 1 -- 172.21.15.19:0/2597830619 learned_addr learned my addr 172.21.15.19:0/2597830619 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe2ffd640 1 -- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 msgr2=0x7fefe40d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe2ffd640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 0x7fefe40d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe2ffd640 1 -- 172.21.15.19:0/2597830619 >> v1:172.21.15.204:6789/0 conn(0x7fefe40d22b0 legacy=0x7fefe40d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe2ffd640 1 -- 172.21.15.19:0/2597830619 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cf6a0 con 0x7fefe41614d0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.623+0000 7fefe27fc640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 0x7fefe40d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.624+0000 7fefe2ffd640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe41614d0 0x7fefe40d4860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19b07143b6f6e5a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.624+0000 7fefe1ffb640 1 -- 172.21.15.19:0/2597830619 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4039070 con 0x7fefe41614d0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.624+0000 7fefe1ffb640 1 -- 172.21.15.19:0/2597830619 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd402cc50 con 0x7fefe41614d0 2024-03-04T08:50:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.624+0000 7fefe1ffb640 1 -- 172.21.15.19:0/2597830619 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4034440 con 0x7fefe41614d0 2024-03-04T08:50:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 -- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe41614d0 msgr2=0x7fefe40d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe41614d0 0x7fefe40d4860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd402bea0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 -- 172.21.15.19:0/2597830619 shutdown_connections 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d1910 0x7fefe40d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 --2- 172.21.15.19:0/2597830619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe41614d0 0x7fefe40d4860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 -- 172.21.15.19:0/2597830619 >> 172.21.15.19:0/2597830619 conn(0x7fefe40d3d40 msgr2=0x7fefe40d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 -- 172.21.15.19:0/2597830619 shutdown_connections 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.625+0000 7fefe9335640 1 -- 172.21.15.19:0/2597830619 wait complete. 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.626+0000 7fefe9335640 1 Processor -- start 2024-03-04T08:50:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.626+0000 7fefe9335640 1 -- start start 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe40d1910 0x7fefe40ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 0x7fefe414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40b0910 con 0x7fefe41614d0 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cfc60 con 0x7fefe40d1910 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe9335640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40b1e40 con 0x7fefe40d22b0 2024-03-04T08:50:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe2ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe40d1910 0x7fefe40ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe27fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 0x7fefe414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37280/0 (socket says 172.21.15.19:37280) 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 -- 172.21.15.19:0/1167238492 learned_addr learned my addr 172.21.15.19:0/1167238492 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 -- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 msgr2=0x7fefe414ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 0x7fefe414ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 -- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe40d1910 msgr2=0x7fefe40ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe40d1910 0x7fefe40ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe37fe640 1 -- 172.21.15.19:0/1167238492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cb250 con 0x7fefe41614d0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.627+0000 7fefe27fc640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 0x7fefe414ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefe37fe640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c420 tx=0x7fefdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc017070 con 0x7fefe41614d0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc005ce0 con 0x7fefe41614d0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40cb4f0 con 0x7fefe41614d0 2024-03-04T08:50:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0072d0 con 0x7fefe41614d0 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.628+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe414b280 con 0x7fefe41614d0 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.629+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe4068ff0 con 0x7fefe41614d0 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.629+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefdc01a070 con 0x7fefe41614d0 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.629+0000 7fefdb7fe640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 0x7fefc406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.630+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefdc089520 con 0x7fefe41614d0 2024-03-04T08:50:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.630+0000 7fefe2ffd640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 0x7fefc406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.630+0000 7fefe2ffd640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 0x7fefc406d9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefd4036000 tx=0x7fefd4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.634+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fefe40d2740 con 0x7fefe41614d0 2024-03-04T08:50:51.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.814+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefe4074530 con 0x7fefe41614d0 2024-03-04T08:50:51.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.814+0000 7fefdb7fe640 1 -- 172.21.15.19:0/1167238492 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefdc057cc0 con 0x7fefe41614d0 2024-03-04T08:50:51.810 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:50:51.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 msgr2=0x7fefc406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 0x7fefc406d9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefd4036000 tx=0x7fefd4030000 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 msgr2=0x7fefe40b9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00c420 tx=0x7fefdc00c8e0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 shutdown_connections 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefe41614d0 0x7fefe40b9650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fefe40d22b0 0x7fefe414ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fefc406b500 0x7fefc406d9c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 --2- 172.21.15.19:0/1167238492 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fefe40d1910 0x7fefe40ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 >> 172.21.15.19:0/1167238492 conn(0x7fefe40d3d40 msgr2=0x7fefe406c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 shutdown_connections 2024-03-04T08:50:51.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.816+0000 7fefe9335640 1 -- 172.21.15.19:0/1167238492 wait complete. 2024-03-04T08:50:51.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:50:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.931+0000 7f2f19adf640 1 Processor -- start 2024-03-04T08:50:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.931+0000 7f2f19adf640 1 -- start start 2024-03-04T08:50:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f19adf640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2f1406fd10 0x7f2f140cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f19adf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140cd4b0 con 0x7f2f140d0af0 2024-03-04T08:50:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f19adf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140cd790 con 0x7f2f1415c050 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f19adf640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f140cda70 con 0x7f2f1406fd10 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f13fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2f140d0af0 0x7f2f140ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42994/0 (socket says 172.21.15.19:42994) 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f13fff640 1 -- 172.21.15.19:0/650362296 learned_addr learned my addr 172.21.15.19:0/650362296 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.932+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/650362296 >> v2:172.21.15.204:3300/0 conn(0x7f2f1406fd10 0x7f2f140cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361801919 0 0) 0x7f2f140cd4b0 con 0x7f2f140d0af0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2efc003520 con 0x7f2f140d0af0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 377790716 0 0) 0x7f2efc003520 con 0x7f2f140d0af0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 >> v2:172.21.15.204:3300/0 conn(0x7f2f1406fd10 msgr2=0x7f2f140cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 --2- 172.21.15.19:0/650362296 >> v2:172.21.15.204:3300/0 conn(0x7f2f1406fd10 0x7f2f140cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 >> v1:172.21.15.204:6789/0 conn(0x7f2f1415c050 legacy=0x7f2f1406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140cdd50 con 0x7f2f140d0af0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f2f0c0019f0 con 0x7f2f140d0af0 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 >> v1:172.21.15.19:6789/0 conn(0x7f2f140d0af0 legacy=0x7f2f140ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2efc0039b0 0x7f2efc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2efc004800 0x7f2efc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2efc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140cda70 con 0x7f2efc0051c0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc00c160 con 0x7f2efc004800 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc00c360 con 0x7f2efc0039b0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2efc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f137fe640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2efc0039b0 0x7f2efc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2efc004800 0x7f2efc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 -- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2efc0039b0 msgr2=0x7f2efc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2efc0039b0 0x7f2efc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 -- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2efc004800 msgr2=0x7f2efc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2efc004800 0x7f2efc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f13fff640 1 -- 172.21.15.19:0/650362296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc003520 con 0x7f2efc0051c0 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.933+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2efc004800 0x7f2efc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:50:51.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.934+0000 7f2f13fff640 1 -- 172.21.15.19:0/650362296 reap_dead start 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.934+0000 7f2f13fff640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2efc00b9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f140d0f80 tx=0x7f2efc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7901e4f072b50363 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.934+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00a4a0 con 0x7f2efc0051c0 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.934+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c034650 con 0x7f2efc0051c0 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.934+0000 7f2f127fc640 1 -- 172.21.15.19:0/650362296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c034a40 con 0x7f2efc0051c0 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 -- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 msgr2=0x7f2efc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2efc00b9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f140d0f80 tx=0x7f2efc005830 comp rx=0 tx=0).stop 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 -- 172.21.15.19:0/650362296 shutdown_connections 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 --2- 172.21.15.19:0/650362296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2efc00b9c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 -- 172.21.15.19:0/650362296 >> 172.21.15.19:0/650362296 conn(0x7f2f140b3800 msgr2=0x7f2f140b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 -- 172.21.15.19:0/650362296 shutdown_connections 2024-03-04T08:50:51.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.935+0000 7f2f19adf640 1 -- 172.21.15.19:0/650362296 wait complete. 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.936+0000 7f2f19adf640 1 Processor -- start 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.936+0000 7f2f19adf640 1 -- start start 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f141f4a10 0x7f2f141f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 0x7f2f1414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1406f990 con 0x7f2efc0051c0 2024-03-04T08:50:51.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1406f810 con 0x7f2f141f4a10 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1406fb10 con 0x7f2f141f7850 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37296/0 (socket says 172.21.15.19:37296) 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 -- 172.21.15.19:0/1361734541 learned_addr learned my addr 172.21.15.19:0/1361734541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f141f4a10 0x7f2f141f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f13fff640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 0x7f2f1414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 -- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 msgr2=0x7f2f1414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 0x7f2f1414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 -- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f141f4a10 msgr2=0x7f2f141f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f141f4a10 0x7f2f141f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 -- 172.21.15.19:0/1361734541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f141f7d00 con 0x7f2efc0051c0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f13fff640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 0x7f2f1414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f137fe640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400f5f0 tx=0x7f2f0400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040052e0 con 0x7f2efc0051c0 2024-03-04T08:50:51.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04018070 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.937+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f141f7f90 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.938+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04003810 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.938+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f141f4210 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.939+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f141f3d50 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.939+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f040039b0 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.939+0000 7f2efbfff640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.939+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f04089f70 con 0x7f2efc0051c0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.940+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.940+0000 7f2f12ffd640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 0x7f2f0006d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f1409fe30 tx=0x7f2f08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:51.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:51.944+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2f141f3d50 con 0x7f2efc0051c0 2024-03-04T08:50:52.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.122+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f1409fe60 con 0x7f2efc0051c0 2024-03-04T08:50:52.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.122+0000 7f2efbfff640 1 -- 172.21.15.19:0/1361734541 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f04058df0 con 0x7f2efc0051c0 2024-03-04T08:50:52.119 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 msgr2=0x7f2f0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 0x7f2f0006d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f1409fe30 tx=0x7f2f08008040 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 msgr2=0x7f2f140cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400f5f0 tx=0x7f2f0400fab0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 shutdown_connections 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f141f7850 0x7f2f1414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f141f4a10 0x7f2f141f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 --2- 172.21.15.19:0/1361734541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc0051c0 0x7f2f140cb0f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 >> 172.21.15.19:0/1361734541 conn(0x7f2f140b3800 msgr2=0x7f2f140d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 shutdown_connections 2024-03-04T08:50:52.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.124+0000 7f2f19adf640 1 -- 172.21.15.19:0/1361734541 wait complete. 2024-03-04T08:50:52.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.236+0000 7fb0b2439640 1 Processor -- start 2024-03-04T08:50:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.236+0000 7fb0b2439640 1 -- start start 2024-03-04T08:50:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0b2439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 0x7fb0ac0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0b2439640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac0cebe0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0b2439640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac0ceec0 con 0x7fb0ac15bdd0 2024-03-04T08:50:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0b2439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0ce980 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0ab7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb0ac15fa10 0x7fb0ac0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43000/0 (socket says 172.21.15.19:43000) 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0ab7fe640 1 -- 172.21.15.19:0/550477985 learned_addr learned my addr 172.21.15.19:0/550477985 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0b09d6640 1 --2- 172.21.15.19:0/550477985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 0x7fb0ac0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.237+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587052676 0 0) 0x7fb0ac0cebe0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003520 con 0x7fb0ac15fa10 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306934017 0 0) 0x7fb0ac0ceec0 con 0x7fb0ac15bdd0 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ac0cebe0 con 0x7fb0ac15bdd0 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0b09d6640 1 -- 172.21.15.19:0/550477985 >> v1:172.21.15.204:6789/0 conn(0x7fb0ac15bdd0 legacy=0x7fb0ac0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0b09d6640 1 -- 172.21.15.19:0/550477985 >> v1:172.21.15.19:6789/0 conn(0x7fb0ac15fa10 legacy=0x7fb0ac0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.238+0000 7fb0b09d6640 1 -- 172.21.15.19:0/550477985 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0cf1a0 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b09d6640 1 --2- 172.21.15.19:0/550477985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 0x7fb0ac0d1b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009dc0 tx=0x7fb0a402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e62757f2a9bb73 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4039070 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a402cc40 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0aaffd640 1 -- 172.21.15.19:0/550477985 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4034440 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 -- 172.21.15.19:0/550477985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 msgr2=0x7fb0ac0d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 --2- 172.21.15.19:0/550477985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 0x7fb0ac0d1b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009dc0 tx=0x7fb0a402be90 comp rx=0 tx=0).stop 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 -- 172.21.15.19:0/550477985 shutdown_connections 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 --2- 172.21.15.19:0/550477985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac0d16e0 0x7fb0ac0d1b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 -- 172.21.15.19:0/550477985 >> 172.21.15.19:0/550477985 conn(0x7fb0ac09a9f0 msgr2=0x7fb0ac09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 -- 172.21.15.19:0/550477985 shutdown_connections 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.239+0000 7fb0b2439640 1 -- 172.21.15.19:0/550477985 wait complete. 2024-03-04T08:50:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 Processor -- start 2024-03-04T08:50:52.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 -- start start 2024-03-04T08:50:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 0x7fb0ac15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac15bdd0 0x7fb0ac144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0cc5d0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0d2050 con 0x7fb0ac0d16e0 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.241+0000 7fb0b2439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac15c1b0 con 0x7fb0ac15bdd0 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37302/0 (socket says 172.21.15.19:37302) 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 -- 172.21.15.19:0/3663579238 learned_addr learned my addr 172.21.15.19:0/3663579238 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0abfff640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 0x7fb0ac15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0ab7fe640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac15bdd0 0x7fb0ac144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 -- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac15bdd0 msgr2=0x7fb0ac144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac15bdd0 0x7fb0ac144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 -- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 msgr2=0x7fb0ac15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 0x7fb0ac15c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 -- 172.21.15.19:0/3663579238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac15ca10 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0abfff640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 0x7fb0ac15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b09d6640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009ee0 tx=0x7fb0a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4039050 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4045070 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0b59f0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4040690 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.242+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac0b5fb0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.243+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac0b61b0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.244+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb0a4040830 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.244+0000 7fb0a8ff9640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.244+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0a40aca40 con 0x7fb0ac15fa10 2024-03-04T08:50:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.244+0000 7fb0abfff640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.245+0000 7fb0abfff640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 0x7fb08c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb09c007fd0 tx=0x7fb09c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.248+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb0ac0b61b0 con 0x7fb0ac15fa10 2024-03-04T08:50:52.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.468+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0ac04f330 con 0x7fb0ac15fa10 2024-03-04T08:50:52.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.469+0000 7fb0a8ff9640 1 -- 172.21.15.19:0/3663579238 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7fb0a40ace20 con 0x7fb0ac15fa10 2024-03-04T08:50:52.465 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:52.465 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:50:52.465 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:50:52.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.470+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 msgr2=0x7fb08c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.470+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 0x7fb08c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb09c007fd0 tx=0x7fb09c009040 comp rx=0 tx=0).stop 2024-03-04T08:50:52.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 msgr2=0x7fb0ac146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009ee0 tx=0x7fb0a4004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 shutdown_connections 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0ac15fa10 0x7fb0ac146ea0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb0ac15bdd0 0x7fb0ac144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb08c06b4d0 0x7fb08c06d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 --2- 172.21.15.19:0/3663579238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb0ac0d16e0 0x7fb0ac15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 >> 172.21.15.19:0/3663579238 conn(0x7fb0ac09a9f0 msgr2=0x7fb0ac09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 shutdown_connections 2024-03-04T08:50:52.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.471+0000 7fb0b2439640 1 -- 172.21.15.19:0/3663579238 wait complete. 2024-03-04T08:50:52.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.583+0000 7f2d08efb640 1 Processor -- start 2024-03-04T08:50:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.583+0000 7f2d08efb640 1 -- start start 2024-03-04T08:50:52.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d08efb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d040d00c0 0x7f2d040d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d08efb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d0406cf20 0x7f2d0406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d08efb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040d09e0 con 0x7f2d040cf850 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d08efb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406ca90 con 0x7f2d040d00c0 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d08efb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0415e380 con 0x7f2d0406cf20 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d040d00c0 0x7f2d040d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d01d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2d040cf850 0x7f2d040cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43014/0 (socket says 172.21.15.19:43014) 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d040d00c0 0x7f2d040d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37304/0 (socket says 172.21.15.19:37304) 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d01d9b640 1 -- 172.21.15.19:0/3570593413 learned_addr learned my addr 172.21.15.19:0/3570593413 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d02d9d640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d0406cf20 0x7f2d0406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 -- 172.21.15.19:0/3570593413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d0406cf20 msgr2=0x7f2d0406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d0406cf20 0x7f2d0406d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 -- 172.21.15.19:0/3570593413 >> v1:172.21.15.19:6789/0 conn(0x7f2d040cf850 legacy=0x7f2d040cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0259c640 1 -- 172.21.15.19:0/3570593413 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040cdc10 con 0x7f2d040d00c0 2024-03-04T08:50:52.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.584+0000 7f2d0159a640 1 -- 172.21.15.19:0/3570593413 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923418931 0 0) 0x7f2d040d09e0 con 0x7f2d040cf850 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d0259c640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040d00c0 0x7f2d040d04a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40097a0 tx=0x7f2cf402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40da2aa8e2e5d753 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d0159a640 1 -- 172.21.15.19:0/3570593413 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4035020 con 0x7f2d040d00c0 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d0159a640 1 -- 172.21.15.19:0/3570593413 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf4031830 con 0x7f2d040d00c0 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d0159a640 1 -- 172.21.15.19:0/3570593413 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4031c00 con 0x7f2d040d00c0 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d08efb640 1 -- 172.21.15.19:0/3570593413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040d00c0 msgr2=0x7f2d040d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.585+0000 7f2d08efb640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040d00c0 0x7f2d040d04a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40097a0 tx=0x7f2cf402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 -- 172.21.15.19:0/3570593413 shutdown_connections 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d0406cf20 0x7f2d0406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 --2- 172.21.15.19:0/3570593413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040d00c0 0x7f2d040d04a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 -- 172.21.15.19:0/3570593413 >> 172.21.15.19:0/3570593413 conn(0x7f2d040b35a0 msgr2=0x7f2d040b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 -- 172.21.15.19:0/3570593413 shutdown_connections 2024-03-04T08:50:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.586+0000 7f2d08efb640 1 -- 172.21.15.19:0/3570593413 wait complete. 2024-03-04T08:50:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.587+0000 7f2d08efb640 1 Processor -- start 2024-03-04T08:50:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.587+0000 7f2d08efb640 1 -- start start 2024-03-04T08:50:52.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d0406cf20 0x7f2d0415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d040d00c0 0x7f2d041603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0406c720 con 0x7f2d040cf850 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0406c440 con 0x7f2d0406cf20 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040b1030 con 0x7f2d040d00c0 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37310/0 (socket says 172.21.15.19:37310) 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 -- 172.21.15.19:0/4274592792 learned_addr learned my addr 172.21.15.19:0/4274592792 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d02d9d640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d040d00c0 0x7f2d041603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d0259c640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d0406cf20 0x7f2d0415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 -- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d040d00c0 msgr2=0x7f2d041603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d040d00c0 0x7f2d041603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 -- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d0406cf20 msgr2=0x7f2d0415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d0406cf20 0x7f2d0415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 -- 172.21.15.19:0/4274592792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04160e10 con 0x7f2d040cf850 2024-03-04T08:50:52.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d01d9b640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c500 tx=0x7f2cf800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8018070 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8007580 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d040c9db0 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.588+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004a20 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.589+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d041610f0 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.589+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0415dba0 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.590+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cf801b070 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.590+0000 7f2cf2ffd640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 0x7f2ce406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.590+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cf8089430 con 0x7f2d040cf850 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.590+0000 7f2d0259c640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 0x7f2ce406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.591+0000 7f2d0259c640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 0x7f2ce406d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4036000 tx=0x7f2cf4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.594+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2d0415dba0 con 0x7f2d040cf850 2024-03-04T08:50:52.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.778+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d0404f330 con 0x7f2d040cf850 2024-03-04T08:50:52.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.779+0000 7f2cf2ffd640 1 -- 172.21.15.19:0/4274592792 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f2cf8057c60 con 0x7f2d040cf850 2024-03-04T08:50:52.775 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:52.776 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 msgr2=0x7f2ce406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 0x7f2ce406d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4036000 tx=0x7f2cf4008030 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 msgr2=0x7f2d040ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c500 tx=0x7f2cf800c9c0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 shutdown_connections 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2d040d00c0 0x7f2d041603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d040cf850 0x7f2d040ca890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2ce406b500 0x7f2ce406d9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 --2- 172.21.15.19:0/4274592792 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2d0406cf20 0x7f2d0415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 >> 172.21.15.19:0/4274592792 conn(0x7f2d040b35a0 msgr2=0x7f2d040b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 shutdown_connections 2024-03-04T08:50:52.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.781+0000 7f2d08efb640 1 -- 172.21.15.19:0/4274592792 wait complete. 2024-03-04T08:50:52.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:50:52.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:50:52.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.896+0000 7fda639f7640 1 Processor -- start 2024-03-04T08:50:52.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.896+0000 7fda639f7640 1 -- start start 2024-03-04T08:50:52.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda639f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda5c15bb40 0x7fda5c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda639f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fda5c0cfa90 0x7fda5c0cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda639f7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c15ff90 con 0x7fda5c15f7d0 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda639f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0d0440 con 0x7fda5c15bb40 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda639f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c06c910 con 0x7fda5c0cfa90 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda5c15bb40 0x7fda5c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fda5c15bb40 0x7fda5c0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37324/0 (socket says 172.21.15.19:37324) 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 -- 172.21.15.19:0/938805201 learned_addr learned my addr 172.21.15.19:0/938805201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda60f92640 1 --1- 172.21.15.19:0/938805201 >> v1:172.21.15.204:6789/0 conn(0x7fda5c15f7d0 0x7fda5c06d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:55406/0 (socket says 172.21.15.19:55406) 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61f94640 1 --2- 172.21.15.19:0/938805201 >> v2:172.21.15.204:3300/0 conn(0x7fda5c0cfa90 0x7fda5c0cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda5bfff640 1 -- 172.21.15.19:0/938805201 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987960458 0 0) 0x7fda5c15ff90 con 0x7fda5c15f7d0 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 -- 172.21.15.19:0/938805201 >> v2:172.21.15.204:3300/0 conn(0x7fda5c0cfa90 msgr2=0x7fda5c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 --2- 172.21.15.19:0/938805201 >> v2:172.21.15.204:3300/0 conn(0x7fda5c0cfa90 0x7fda5c0cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 -- 172.21.15.19:0/938805201 >> v1:172.21.15.204:6789/0 conn(0x7fda5c15f7d0 legacy=0x7fda5c06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.897+0000 7fda61793640 1 -- 172.21.15.19:0/938805201 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c160270 con 0x7fda5c15bb40 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.898+0000 7fda61793640 1 --2- 172.21.15.19:0/938805201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c15bb40 0x7fda5c0b4970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda5c072c60 tx=0x7fda5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e767ef271372a7f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.898+0000 7fda5bfff640 1 -- 172.21.15.19:0/938805201 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54034070 con 0x7fda5c15bb40 2024-03-04T08:50:52.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.898+0000 7fda5bfff640 1 -- 172.21.15.19:0/938805201 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54030860 con 0x7fda5c15bb40 2024-03-04T08:50:52.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.898+0000 7fda5bfff640 1 -- 172.21.15.19:0/938805201 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54030c30 con 0x7fda5c15bb40 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 -- 172.21.15.19:0/938805201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c15bb40 msgr2=0x7fda5c0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 --2- 172.21.15.19:0/938805201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c15bb40 0x7fda5c0b4970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda5c072c60 tx=0x7fda5402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 -- 172.21.15.19:0/938805201 shutdown_connections 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 --2- 172.21.15.19:0/938805201 >> v2:172.21.15.204:3300/0 conn(0x7fda5c0cfa90 0x7fda5c0cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 --2- 172.21.15.19:0/938805201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c15bb40 0x7fda5c0b4970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 -- 172.21.15.19:0/938805201 >> 172.21.15.19:0/938805201 conn(0x7fda5c06b190 msgr2=0x7fda5c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 -- 172.21.15.19:0/938805201 shutdown_connections 2024-03-04T08:50:52.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.899+0000 7fda639f7640 1 -- 172.21.15.19:0/938805201 wait complete. 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.900+0000 7fda639f7640 1 Processor -- start 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.900+0000 7fda639f7640 1 -- start start 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda5c15bb40 0x7fda5c0a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda5c15f7d0 0x7fda5c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c15fc30 con 0x7fda5c0cfa90 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c06cb60 con 0x7fda5c15f7d0 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda639f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c06d790 con 0x7fda5c15bb40 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37328/0 (socket says 172.21.15.19:37328) 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 -- 172.21.15.19:0/4013147197 learned_addr learned my addr 172.21.15.19:0/4013147197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61f94640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda5c15f7d0 0x7fda5c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda60f92640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda5c15bb40 0x7fda5c0a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 -- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda5c15bb40 msgr2=0x7fda5c0a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda5c15bb40 0x7fda5c0a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 -- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda5c15f7d0 msgr2=0x7fda5c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda5c15f7d0 0x7fda5c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 -- 172.21.15.19:0/4013147197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c1498f0 con 0x7fda5c0cfa90 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.901+0000 7fda61793640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda5402b9e0 tx=0x7fda54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.902+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54048070 con 0x7fda5c0cfa90 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.902+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54030660 con 0x7fda5c0cfa90 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.902+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54034040 con 0x7fda5c0cfa90 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.902+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0aa880 con 0x7fda5c0cfa90 2024-03-04T08:50:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.902+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c159bf0 con 0x7fda5c0cfa90 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.903+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c159720 con 0x7fda5c0cfa90 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.903+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda5404b070 con 0x7fda5c0cfa90 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.904+0000 7fda59ffb640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.904+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda540ac300 con 0x7fda5c0cfa90 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.904+0000 7fda60f92640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.904+0000 7fda60f92640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 0x7fda4806d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda5c156be0 tx=0x7fda50007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:52.908+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fda5407abb0 con 0x7fda5c0cfa90 2024-03-04T08:50:53.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.088+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda5c068ff0 con 0x7fda5c0cfa90 2024-03-04T08:50:53.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.088+0000 7fda59ffb640 1 -- 172.21.15.19:0/4013147197 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda5407ec50 con 0x7fda5c0cfa90 2024-03-04T08:50:53.085 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:50:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 msgr2=0x7fda4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 0x7fda4806d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda5c156be0 tx=0x7fda50007d50 comp rx=0 tx=0).stop 2024-03-04T08:50:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 msgr2=0x7fda5c1493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda5402b9e0 tx=0x7fda54004730 comp rx=0 tx=0).stop 2024-03-04T08:50:53.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 shutdown_connections 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fda5c15f7d0 0x7fda5c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fda5c15bb40 0x7fda5c0a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 --2- 172.21.15.19:0/4013147197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda5c0cfa90 0x7fda5c1493b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 >> 172.21.15.19:0/4013147197 conn(0x7fda5c06b190 msgr2=0x7fda5c0af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 shutdown_connections 2024-03-04T08:50:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.091+0000 7fda639f7640 1 -- 172.21.15.19:0/4013147197 wait complete. 2024-03-04T08:50:53.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:50:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.205+0000 7f6fb604e640 1 Processor -- start 2024-03-04T08:50:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.205+0000 7f6fb604e640 1 -- start start 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fb604e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb006b6c0 0x7f6fb015e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fb604e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb0071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fb604e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00cea90 con 0x7f6fb015bbb0 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fb604e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb0161970 con 0x7f6fb006b6c0 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fb604e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb01624f0 con 0x7f6fb015ec40 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faeffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb006b6c0 0x7f6fb015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faf7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6fb015bbb0 0x7f6fb006afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43022/0 (socket says 172.21.15.19:43022) 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faf7fe640 1 -- 172.21.15.19:0/1508309236 learned_addr learned my addr 172.21.15.19:0/1508309236 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faffff640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb0071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faeffd640 1 -- 172.21.15.19:0/1508309236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 msgr2=0x7f6fb0071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faeffd640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb0071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faeffd640 1 -- 172.21.15.19:0/1508309236 >> v1:172.21.15.19:6789/0 conn(0x7f6fb015bbb0 legacy=0x7f6fb006afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6faeffd640 1 -- 172.21.15.19:0/1508309236 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0161bc0 con 0x7f6fb006b6c0 2024-03-04T08:50:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.206+0000 7f6fae7fc640 1 -- 172.21.15.19:0/1508309236 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978216105 0 0) 0x7f6fa0001110 con 0x7f6fb015bbb0 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.207+0000 7f6faeffd640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb006b6c0 0x7f6fb015e700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40097a0 tx=0x7f6fa402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6ec16f3b0066ef server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.207+0000 7f6fae7fc640 1 -- 172.21.15.19:0/1508309236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4035020 con 0x7f6fb006b6c0 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.207+0000 7f6fae7fc640 1 -- 172.21.15.19:0/1508309236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa4031830 con 0x7f6fb006b6c0 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.207+0000 7f6fae7fc640 1 -- 172.21.15.19:0/1508309236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4031c00 con 0x7f6fb006b6c0 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 -- 172.21.15.19:0/1508309236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb006b6c0 msgr2=0x7f6fb015e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb006b6c0 0x7f6fb015e700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40097a0 tx=0x7f6fa402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 -- 172.21.15.19:0/1508309236 shutdown_connections 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb0071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1508309236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb006b6c0 0x7f6fb015e700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 -- 172.21.15.19:0/1508309236 >> 172.21.15.19:0/1508309236 conn(0x7f6fb00b2660 msgr2=0x7f6fb00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 -- 172.21.15.19:0/1508309236 shutdown_connections 2024-03-04T08:50:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.208+0000 7f6fb604e640 1 -- 172.21.15.19:0/1508309236 wait complete. 2024-03-04T08:50:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.209+0000 7f6fb604e640 1 Processor -- start 2024-03-04T08:50:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.209+0000 7f6fb604e640 1 -- start start 2024-03-04T08:50:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb006b6c0 0x7f6fb01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb015f0f0 con 0x7f6fb015a600 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0162180 con 0x7f6fb006b6c0 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6fb604e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00721e0 con 0x7f6fb015ec40 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37346/0 (socket says 172.21.15.19:37346) 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 -- 172.21.15.19:0/1415298892 learned_addr learned my addr 172.21.15.19:0/1415298892 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faeffd640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faf7fe640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb006b6c0 0x7f6fb01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 -- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 msgr2=0x7f6fb015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 -- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb006b6c0 msgr2=0x7f6fb01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb006b6c0 0x7f6fb01464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.210+0000 7f6faffff640 1 -- 172.21.15.19:0/1415298892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb015d930 con 0x7f6fb015a600 2024-03-04T08:50:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6faffff640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009d30 tx=0x7f6fa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8018020 con 0x7f6fb015a600 2024-03-04T08:50:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8014480 con 0x7f6fb015a600 2024-03-04T08:50:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb015cd20 con 0x7f6fb015a600 2024-03-04T08:50:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8014870 con 0x7f6fb015a600 2024-03-04T08:50:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.211+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb015d2e0 con 0x7f6fb015a600 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.212+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb00733b0 con 0x7f6fb015a600 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.212+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fa8005d10 con 0x7f6fb015a600 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.213+0000 7f6f97fff640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 0x7f6f9c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.213+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fa808ab60 con 0x7f6fb015a600 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.213+0000 7f6faf7fe640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 0x7f6f9c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.213+0000 7f6faf7fe640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 0x7f6f9c06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0000f60 tx=0x7f6fa0007b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.217+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6fa8022070 con 0x7f6fb015a600 2024-03-04T08:50:53.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.397+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fb0068ff0 con 0x7f6fb015a600 2024-03-04T08:50:53.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.398+0000 7f6f97fff640 1 -- 172.21.15.19:0/1415298892 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fa8010040 con 0x7f6fb015a600 2024-03-04T08:50:53.394 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 msgr2=0x7f6f9c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 0x7f6f9c06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0000f60 tx=0x7f6fa0007b50 comp rx=0 tx=0).stop 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 msgr2=0x7f6fb00cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009d30 tx=0x7f6fa800c490 comp rx=0 tx=0).stop 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 shutdown_connections 2024-03-04T08:50:53.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb015a600 0x7f6fb00cb620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb015ec40 0x7f6fb015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6f9c06b500 0x7f6f9c06d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 --2- 172.21.15.19:0/1415298892 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb006b6c0 0x7f6fb01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 >> 172.21.15.19:0/1415298892 conn(0x7f6fb00b2660 msgr2=0x7f6fb006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 shutdown_connections 2024-03-04T08:50:53.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.400+0000 7f6fb604e640 1 -- 172.21.15.19:0/1415298892 wait complete. 2024-03-04T08:50:53.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.514+0000 7f6cc9393640 1 Processor -- start 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.514+0000 7f6cc9393640 1 -- start start 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc9393640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6cc41614d0 0x7f6cc40d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc9393640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 0x7f6cc40b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc9393640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc41618b0 con 0x7f6cc40d1910 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc9393640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40cf400 con 0x7f6cc41614d0 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc9393640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40cf6a0 con 0x7f6cc40d24b0 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc2ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6cc41614d0 0x7f6cc40d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc27fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6cc40d1910 0x7f6cc40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43038/0 (socket says 172.21.15.19:43038) 2024-03-04T08:50:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc27fc640 1 -- 172.21.15.19:0/3312659022 learned_addr learned my addr 172.21.15.19:0/3312659022 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc37fe640 1 --2- 172.21.15.19:0/3312659022 >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 0x7f6cc40b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc2ffd640 1 -- 172.21.15.19:0/3312659022 >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 msgr2=0x7f6cc40b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc2ffd640 1 --2- 172.21.15.19:0/3312659022 >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 0x7f6cc40b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc2ffd640 1 -- 172.21.15.19:0/3312659022 >> v1:172.21.15.19:6789/0 conn(0x7f6cc40d1910 legacy=0x7f6cc40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc2ffd640 1 -- 172.21.15.19:0/3312659022 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40cf980 con 0x7f6cc41614d0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc1ffb640 1 -- 172.21.15.19:0/3312659022 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915934654 0 0) 0x7f6cc41618b0 con 0x7f6cc40d1910 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.515+0000 7f6cc37fe640 1 --2- 172.21.15.19:0/3312659022 >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 0x7f6cc40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.516+0000 7f6cc2ffd640 1 --2- 172.21.15.19:0/3312659022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40d4860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40b2a70 tx=0x7f6cbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399fdd5d767e58f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.516+0000 7f6cc1ffb640 1 -- 172.21.15.19:0/3312659022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc035020 con 0x7f6cc41614d0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.516+0000 7f6cc1ffb640 1 -- 172.21.15.19:0/3312659022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc031830 con 0x7f6cc41614d0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.516+0000 7f6cc1ffb640 1 -- 172.21.15.19:0/3312659022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc031c00 con 0x7f6cc41614d0 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 -- 172.21.15.19:0/3312659022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 msgr2=0x7f6cc40d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 --2- 172.21.15.19:0/3312659022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40d4860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40b2a70 tx=0x7f6cbc02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 -- 172.21.15.19:0/3312659022 shutdown_connections 2024-03-04T08:50:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 --2- 172.21.15.19:0/3312659022 >> v2:172.21.15.204:3300/0 conn(0x7f6cc40d24b0 0x7f6cc40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 --2- 172.21.15.19:0/3312659022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40d4860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 -- 172.21.15.19:0/3312659022 >> 172.21.15.19:0/3312659022 conn(0x7f6cc40d3d40 msgr2=0x7f6cc40d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 -- 172.21.15.19:0/3312659022 shutdown_connections 2024-03-04T08:50:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.517+0000 7f6cc9393640 1 -- 172.21.15.19:0/3312659022 wait complete. 2024-03-04T08:50:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.518+0000 7f6cc9393640 1 Processor -- start 2024-03-04T08:50:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.518+0000 7f6cc9393640 1 -- start start 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc40d1910 0x7f6cc4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc40d24b0 0x7f6cc40cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b1370 con 0x7f6cc41614d0 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b0910 con 0x7f6cc40d1910 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc9393640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b14f0 con 0x7f6cc40d24b0 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37366/0 (socket says 172.21.15.19:37366) 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 -- 172.21.15.19:0/2329032873 learned_addr learned my addr 172.21.15.19:0/2329032873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc2ffd640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc40d1910 0x7f6cc4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc27fc640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc40d24b0 0x7f6cc40cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 -- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc40d24b0 msgr2=0x7f6cc40cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc40d24b0 0x7f6cc40cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 -- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc40d1910 msgr2=0x7f6cc4157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc40d1910 0x7f6cc4157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 -- 172.21.15.19:0/2329032873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40c8250 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cc37fe640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009fd0 tx=0x7f6cb400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.519+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb401a070 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.520+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4003bb0 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.520+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc40c84d0 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.520+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4004030 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.520+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc40c8a90 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.521+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4068ff0 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.521+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6cb401d070 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.521+0000 7f6cbb7fe640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 0x7f6ca406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.522+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cb408a430 con 0x7f6cc41614d0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.522+0000 7f6cc2ffd640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 0x7f6ca406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.522+0000 7f6cc2ffd640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 0x7f6ca406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc036000 tx=0x7f6cbc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.526+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6cc40c8250 con 0x7f6cc41614d0 2024-03-04T08:50:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.704+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cc40c71c0 con 0x7f6cc41614d0 2024-03-04T08:50:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.704+0000 7f6cbb7fe640 1 -- 172.21.15.19:0/2329032873 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cb4010070 con 0x7f6cc41614d0 2024-03-04T08:50:53.701 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:50:53.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 msgr2=0x7f6ca406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 0x7f6ca406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc036000 tx=0x7f6cbc03c040 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 msgr2=0x7f6cc40c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009fd0 tx=0x7f6cb400d560 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 shutdown_connections 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cc41614d0 0x7f6cc40c9290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cc40d24b0 0x7f6cc40cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ca406b4d0 0x7f6ca406d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 --2- 172.21.15.19:0/2329032873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cc40d1910 0x7f6cc4157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 >> 172.21.15.19:0/2329032873 conn(0x7f6cc40d3d40 msgr2=0x7f6cc40b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 shutdown_connections 2024-03-04T08:50:53.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.706+0000 7f6cc9393640 1 -- 172.21.15.19:0/2329032873 wait complete. 2024-03-04T08:50:53.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:53.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.819+0000 7f8fd0f32640 1 Processor -- start 2024-03-04T08:50:53.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 -- start start 2024-03-04T08:50:53.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8fcc13dc10 0x7f8fcc0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc15f580 con 0x7f8fcc15e850 2024-03-04T08:50:53.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc0cf3f0 con 0x7f8fcc15bf30 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.820+0000 7f8fd0f32640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc15b210 con 0x7f8fcc13dc10 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37372/0 (socket says 172.21.15.19:37372) 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fcad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8fcc15e850 0x7f8fcc15ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43046/0 (socket says 172.21.15.19:43046) 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 -- 172.21.15.19:0/4281414883 learned_addr learned my addr 172.21.15.19:0/4281414883 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fca59c640 1 --2- 172.21.15.19:0/4281414883 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc13dc10 0x7f8fcc0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 -- 172.21.15.19:0/4281414883 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc13dc10 msgr2=0x7f8fcc0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 --2- 172.21.15.19:0/4281414883 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc13dc10 0x7f8fcc0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 -- 172.21.15.19:0/4281414883 >> v1:172.21.15.19:6789/0 conn(0x7f8fcc15e850 legacy=0x7f8fcc15ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc959a640 1 -- 172.21.15.19:0/4281414883 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919757512 0 0) 0x7f8fcc15f580 con 0x7f8fcc15e850 2024-03-04T08:50:53.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.821+0000 7f8fc9d9b640 1 -- 172.21.15.19:0/4281414883 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc15b450 con 0x7f8fcc15bf30 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fc9d9b640 1 --2- 172.21.15.19:0/4281414883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0731a0 tx=0x7f8fc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4867cc8c8bae56fb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fc959a640 1 -- 172.21.15.19:0/4281414883 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0035020 con 0x7f8fcc15bf30 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fc959a640 1 -- 172.21.15.19:0/4281414883 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0031870 con 0x7f8fcc15bf30 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fc959a640 1 -- 172.21.15.19:0/4281414883 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0031c40 con 0x7f8fcc15bf30 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 -- 172.21.15.19:0/4281414883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15bf30 msgr2=0x7f8fcc0b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/4281414883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0731a0 tx=0x7f8fc002b910 comp rx=0 tx=0).stop 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 -- 172.21.15.19:0/4281414883 shutdown_connections 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/4281414883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc0b2e90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/4281414883 >> v2:172.21.15.204:3300/0 conn(0x7f8fcc13dc10 0x7f8fcc0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 -- 172.21.15.19:0/4281414883 >> 172.21.15.19:0/4281414883 conn(0x7f8fcc0cf8a0 msgr2=0x7f8fcc0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 -- 172.21.15.19:0/4281414883 shutdown_connections 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.822+0000 7f8fd0f32640 1 -- 172.21.15.19:0/4281414883 wait complete. 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 Processor -- start 2024-03-04T08:50:53.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 -- start start 2024-03-04T08:50:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc13dc10 0x7f8fcc13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc13b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0708d0 con 0x7f8fcc15e850 2024-03-04T08:50:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc13dff0 con 0x7f8fcc15bf30 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.824+0000 7f8fd0f32640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc070a50 con 0x7f8fcc13dc10 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37384/0 (socket says 172.21.15.19:37384) 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 -- 172.21.15.19:0/1783674657 learned_addr learned my addr 172.21.15.19:0/1783674657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fc9d9b640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc13b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fca59c640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc13dc10 0x7f8fcc13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 -- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc13dc10 msgr2=0x7f8fcc13f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc13dc10 0x7f8fcc13f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 -- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc15bf30 msgr2=0x7f8fcc13b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc13b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 -- 172.21.15.19:0/1783674657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc142de0 con 0x7f8fcc15e850 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fcad9d640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c700 tx=0x7f8fbc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc018070 con 0x7f8fcc15e850 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00ce10 con 0x7f8fcc15e850 2024-03-04T08:50:53.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc13fc40 con 0x7f8fcc15e850 2024-03-04T08:50:53.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00a860 con 0x7f8fcc15e850 2024-03-04T08:50:53.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.825+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc140200 con 0x7f8fcc15e850 2024-03-04T08:50:53.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.826+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc04f330 con 0x7f8fcc15e850 2024-03-04T08:50:53.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.827+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fbc01b070 con 0x7f8fcc15e850 2024-03-04T08:50:53.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.827+0000 7f8fbaffd640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 0x7f8fac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:53.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.827+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fbc089640 con 0x7f8fcc15e850 2024-03-04T08:50:53.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.827+0000 7f8fca59c640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 0x7f8fac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:53.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.828+0000 7f8fca59c640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 0x7f8fac06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc06d450 tx=0x7f8fc4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:53.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:53.831+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8fbc057f00 con 0x7f8fcc15e850 2024-03-04T08:50:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.048+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fcc15ad30 con 0x7f8fcc15e850 2024-03-04T08:50:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.048+0000 7f8fbaffd640 1 -- 172.21.15.19:0/1783674657 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7f8fbc05bfa0 con 0x7f8fcc15e850 2024-03-04T08:50:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:54.045 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:50:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 msgr2=0x7f8fac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 0x7f8fac06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc06d450 tx=0x7f8fc4009190 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 msgr2=0x7f8fcc1428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c700 tx=0x7f8fbc00cbc0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 shutdown_connections 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc15e850 0x7f8fcc1428a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fac06b4d0 0x7f8fac06d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8fcc15bf30 0x7f8fcc13b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 --2- 172.21.15.19:0/1783674657 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8fcc13dc10 0x7f8fcc13f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 >> 172.21.15.19:0/1783674657 conn(0x7f8fcc0cf8a0 msgr2=0x7f8fcc0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 shutdown_connections 2024-03-04T08:50:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.050+0000 7f8fd0f32640 1 -- 172.21.15.19:0/1783674657 wait complete. 2024-03-04T08:50:54.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:50:54.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.162+0000 7fd8dc11e640 1 Processor -- start 2024-03-04T08:50:54.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 -- start start 2024-03-04T08:50:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd8d415bdd0 0x7fd8d40c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415fa10 0x7fd8d40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d40cebe0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40ceec0 con 0x7fd8d415bdd0 2024-03-04T08:50:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8dc11e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40cf1a0 con 0x7fd8d415fa10 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.163+0000 7fd8da6bb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd8d40d16e0 0x7fd8d40d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43048/0 (socket says 172.21.15.19:43048) 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8da6bb640 1 -- 172.21.15.19:0/1486572681 learned_addr learned my addr 172.21.15.19:0/1486572681 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d96b9640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415fa10 0x7fd8d40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/1486572681 >> v2:172.21.15.204:3300/0 conn(0x7fd8d415bdd0 0x7fd8d40c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d8eb8640 1 -- 172.21.15.19:0/1486572681 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008611584 0 0) 0x7fd8d40cebe0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d9eba640 1 -- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415fa10 msgr2=0x7fd8d40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415fa10 0x7fd8d40ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d9eba640 1 -- 172.21.15.19:0/1486572681 >> v1:172.21.15.19:6789/0 conn(0x7fd8d40d16e0 legacy=0x7fd8d40d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.164+0000 7fd8d9eba640 1 -- 172.21.15.19:0/1486572681 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40cc8e0 con 0x7fd8d415bdd0 2024-03-04T08:50:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415bdd0 0x7fd8d40c5610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00097a0 tx=0x7fd8d002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44a1adf092fae2d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8d8eb8640 1 -- 172.21.15.19:0/1486572681 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00315a0 con 0x7fd8d415bdd0 2024-03-04T08:50:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8d8eb8640 1 -- 172.21.15.19:0/1486572681 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0037070 con 0x7fd8d415bdd0 2024-03-04T08:50:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8d8eb8640 1 -- 172.21.15.19:0/1486572681 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0031960 con 0x7fd8d415bdd0 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 -- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415bdd0 msgr2=0x7fd8d40c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415bdd0 0x7fd8d40c5610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00097a0 tx=0x7fd8d002b840 comp rx=0 tx=0).stop 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 -- 172.21.15.19:0/1486572681 shutdown_connections 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415fa10 0x7fd8d40ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/1486572681 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415bdd0 0x7fd8d40c5610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 -- 172.21.15.19:0/1486572681 >> 172.21.15.19:0/1486572681 conn(0x7fd8d409a9f0 msgr2=0x7fd8d409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 -- 172.21.15.19:0/1486572681 shutdown_connections 2024-03-04T08:50:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.165+0000 7fd8dc11e640 1 -- 172.21.15.19:0/1486572681 wait complete. 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 Processor -- start 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 -- start start 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415bdd0 0x7fd8d40b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 0x7fd8d415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d415c1b0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40cc5d0 con 0x7fd8d415fa10 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8dc11e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40ce7b0 con 0x7fd8d415bdd0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8d9eba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8d9eba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37390/0 (socket says 172.21.15.19:37390) 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8d9eba640 1 -- 172.21.15.19:0/865945784 learned_addr learned my addr 172.21.15.19:0/865945784 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8d96b9640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415bdd0 0x7fd8d40b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.167+0000 7fd8da6bb640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 0x7fd8d415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 -- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415bdd0 msgr2=0x7fd8d40b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415bdd0 0x7fd8d40b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 -- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 msgr2=0x7fd8d415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 0x7fd8d415dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 -- 172.21.15.19:0/865945784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d415cd10 con 0x7fd8d40d16e0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8da6bb640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 0x7fd8d415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8d9eba640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0034040 tx=0x7fd8d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0032630 con 0x7fd8d40d16e0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d00327d0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d414d450 con 0x7fd8d40d16e0 2024-03-04T08:50:54.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0032bc0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.168+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d415cf90 con 0x7fd8d40d16e0 2024-03-04T08:50:54.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.169+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d404f330 con 0x7fd8d40d16e0 2024-03-04T08:50:54.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.169+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8d004e430 con 0x7fd8d40d16e0 2024-03-04T08:50:54.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.170+0000 7fd8ca7fc640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 0x7fd8b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.170+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8d002f030 con 0x7fd8d40d16e0 2024-03-04T08:50:54.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.170+0000 7fd8d96b9640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 0x7fd8b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.170+0000 7fd8d96b9640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 0x7fd8b806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8d415b140 tx=0x7fd8c4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.174+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd8d414d450 con 0x7fd8d40d16e0 2024-03-04T08:50:54.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.359+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8d40d12c0 con 0x7fd8d40d16e0 2024-03-04T08:50:54.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.360+0000 7fd8ca7fc640 1 -- 172.21.15.19:0/865945784 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fd8d415cd10 con 0x7fd8d40d16e0 2024-03-04T08:50:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:54.357 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:50:54.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 msgr2=0x7fd8b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 0x7fd8b806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8d415b140 tx=0x7fd8c4009190 comp rx=0 tx=0).stop 2024-03-04T08:50:54.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 msgr2=0x7fd8d414cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0034040 tx=0x7fd8d00046c0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 shutdown_connections 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd8b806b4d0 0x7fd8b806d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd8d415fa10 0x7fd8d415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd8d415bdd0 0x7fd8d40b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 --2- 172.21.15.19:0/865945784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8d40d16e0 0x7fd8d414cf10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 >> 172.21.15.19:0/865945784 conn(0x7fd8d409a9f0 msgr2=0x7fd8d40caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 shutdown_connections 2024-03-04T08:50:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.362+0000 7fd8dc11e640 1 -- 172.21.15.19:0/865945784 wait complete. 2024-03-04T08:50:54.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:50:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.475+0000 7f777b8fa640 1 Processor -- start 2024-03-04T08:50:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.475+0000 7f777b8fa640 1 -- start start 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f777b8fa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f777415e090 0x7f77740d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f777b8fa640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77740d2920 0x7f77740b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f777b8fa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777415e470 con 0x7f77740b3b20 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f777b8fa640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740d18f0 con 0x7f77740d2920 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f777b8fa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740d1b90 con 0x7f777415e090 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f7778e95640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77740d2920 0x7f77740b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f7778e95640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77740d2920 0x7f77740b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37402/0 (socket says 172.21.15.19:37402) 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f7778e95640 1 -- 172.21.15.19:0/3376352179 learned_addr learned my addr 172.21.15.19:0/3376352179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.476+0000 7f7779696640 1 --2- 172.21.15.19:0/3376352179 >> v2:172.21.15.204:3300/0 conn(0x7f777415e090 0x7f77740d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7778e95640 1 -- 172.21.15.19:0/3376352179 >> v2:172.21.15.204:3300/0 conn(0x7f777415e090 msgr2=0x7f77740d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7778e95640 1 --2- 172.21.15.19:0/3376352179 >> v2:172.21.15.204:3300/0 conn(0x7f777415e090 0x7f77740d47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7778e95640 1 -- 172.21.15.19:0/3376352179 >> v1:172.21.15.204:6789/0 conn(0x7f77740b3b20 legacy=0x7f77740d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7773fff640 1 -- 172.21.15.19:0/3376352179 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170388320 0 0) 0x7f777415e470 con 0x7f77740b3b20 2024-03-04T08:50:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7778e95640 1 -- 172.21.15.19:0/3376352179 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740ceb50 con 0x7f77740d2920 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7778e95640 1 --2- 172.21.15.19:0/3376352179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740d2920 0x7f77740b35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77740b6780 tx=0x7f776802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904c8abe6121f620 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7773fff640 1 -- 172.21.15.19:0/3376352179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768034070 con 0x7f77740d2920 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7773fff640 1 -- 172.21.15.19:0/3376352179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768030860 con 0x7f77740d2920 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.477+0000 7f7773fff640 1 -- 172.21.15.19:0/3376352179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768030c30 con 0x7f77740d2920 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 -- 172.21.15.19:0/3376352179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740d2920 msgr2=0x7f77740b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3376352179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740d2920 0x7f77740b35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77740b6780 tx=0x7f776802b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 -- 172.21.15.19:0/3376352179 shutdown_connections 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3376352179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740d2920 0x7f77740b35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3376352179 >> v2:172.21.15.204:3300/0 conn(0x7f777415e090 0x7f77740d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 -- 172.21.15.19:0/3376352179 >> 172.21.15.19:0/3376352179 conn(0x7f77740d3c80 msgr2=0x7f77740d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 -- 172.21.15.19:0/3376352179 shutdown_connections 2024-03-04T08:50:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.478+0000 7f777b8fa640 1 -- 172.21.15.19:0/3376352179 wait complete. 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.479+0000 7f777b8fa640 1 Processor -- start 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.479+0000 7f777b8fa640 1 -- start start 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77740d2920 0x7f77740cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f777415e090 0x7f777415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740ce800 con 0x7f77740cad50 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740b2df0 con 0x7f777415e090 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f777b8fa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740d0d60 con 0x7f77740d2920 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37408/0 (socket says 172.21.15.19:37408) 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 -- 172.21.15.19:0/3780279290 learned_addr learned my addr 172.21.15.19:0/3780279290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7778e95640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f777415e090 0x7f777415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779696640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77740d2920 0x7f77740cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 -- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77740d2920 msgr2=0x7f77740cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77740d2920 0x7f77740cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 -- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f777415e090 msgr2=0x7f777415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f777415e090 0x7f777415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 -- 172.21.15.19:0/3780279290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777415ab00 con 0x7f77740cad50 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.480+0000 7f7779e97640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f776400c440 tx=0x7f776400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.481+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764017070 con 0x7f77740cad50 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.481+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640035f0 con 0x7f77740cad50 2024-03-04T08:50:54.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.481+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777415ad80 con 0x7f77740cad50 2024-03-04T08:50:54.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.481+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640039e0 con 0x7f77740cad50 2024-03-04T08:50:54.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.481+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777415b340 con 0x7f77740cad50 2024-03-04T08:50:54.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.482+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777404f330 con 0x7f77740cad50 2024-03-04T08:50:54.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.482+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f776401a070 con 0x7f77740cad50 2024-03-04T08:50:54.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.482+0000 7f7771ffb640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 0x7f776006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.483+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77640894b0 con 0x7f77740cad50 2024-03-04T08:50:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.483+0000 7f7779696640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 0x7f776006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.483+0000 7f7779696640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 0x7f776006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77740ca300 tx=0x7f776c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:54.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.487+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f777415ab00 con 0x7f77740cad50 2024-03-04T08:50:54.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.703+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77740d1230 con 0x7f77740cad50 2024-03-04T08:50:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.704+0000 7f7771ffb640 1 -- 172.21.15.19:0/3780279290 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7f7764057d70 con 0x7f77740cad50 2024-03-04T08:50:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:50:54.700 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:50:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:50:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 msgr2=0x7f776006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 0x7f776006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77740ca300 tx=0x7f776c00b040 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 msgr2=0x7f77740cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f776400c440 tx=0x7f776400c900 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 shutdown_connections 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77740cad50 0x7f77740cb200 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f776006b4d0 0x7f776006d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f777415e090 0x7f777415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 --2- 172.21.15.19:0/3780279290 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f77740d2920 0x7f77740cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 >> 172.21.15.19:0/3780279290 conn(0x7f77740d3c80 msgr2=0x7f777406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 shutdown_connections 2024-03-04T08:50:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:54.706+0000 7f777b8fa640 1 -- 172.21.15.19:0/3780279290 wait complete. 2024-03-04T08:50:55.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T08:50:37.708863+0000', 'modified': '2024-03-04T08:50:39.707881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.204:6837/1359328576', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.204:6835', 'nonce': 1359328576}, {'type': 'v1', 'addr': '172.21.15.204:6837', 'nonce': 1359328576}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-03-04T08:50:55.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-04T08:50:55.116 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T08:50:55.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 Processor -- start 2024-03-04T08:50:55.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 -- start start 2024-03-04T08:50:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc0b4460 0x7f4cfc0d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4cfc162970 0x7f4cfc0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc0d22c0 con 0x7f4cfc161cf0 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc161b00 con 0x7f4cfc0b4460 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.226+0000 7f4d01a81640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0cecc0 con 0x7f4cfc162970 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc0b4460 0x7f4cfc0d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc0b4460 0x7f4cfc0d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37424/0 (socket says 172.21.15.19:37424) 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/3286805591 learned_addr learned my addr 172.21.15.19:0/3286805591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/3286805591 >> v2:172.21.15.204:3300/0 conn(0x7f4cfc162970 0x7f4cfc0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/3286805591 >> v2:172.21.15.204:3300/0 conn(0x7f4cfc162970 msgr2=0x7f4cfc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/3286805591 >> v2:172.21.15.204:3300/0 conn(0x7f4cfc162970 0x7f4cfc0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/3286805591 >> v1:172.21.15.204:6789/0 conn(0x7f4cfc161cf0 legacy=0x7f4cfc0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.227+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/3286805591 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0d25a0 con 0x7f4cfc0b4460 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/3286805591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc0b4460 0x7f4cfc0d4800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0d17e0 tx=0x7f4cec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5896e318d209a55 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4cfa7fc640 1 -- 172.21.15.19:0/3286805591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec034070 con 0x7f4cfc0b4460 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4cfa7fc640 1 -- 172.21.15.19:0/3286805591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec030860 con 0x7f4cfc0b4460 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4cfa7fc640 1 -- 172.21.15.19:0/3286805591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec030c30 con 0x7f4cfc0b4460 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 -- 172.21.15.19:0/3286805591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc0b4460 msgr2=0x7f4cfc0d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 --2- 172.21.15.19:0/3286805591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc0b4460 0x7f4cfc0d4800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0d17e0 tx=0x7f4cec02b9a0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 -- 172.21.15.19:0/3286805591 shutdown_connections 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 --2- 172.21.15.19:0/3286805591 >> v2:172.21.15.204:3300/0 conn(0x7f4cfc162970 0x7f4cfc0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 --2- 172.21.15.19:0/3286805591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc0b4460 0x7f4cfc0d4800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 -- 172.21.15.19:0/3286805591 >> 172.21.15.19:0/3286805591 conn(0x7f4cfc0d3ce0 msgr2=0x7f4cfc0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 -- 172.21.15.19:0/3286805591 shutdown_connections 2024-03-04T08:50:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.228+0000 7f4d01a81640 1 -- 172.21.15.19:0/3286805591 wait complete. 2024-03-04T08:50:55.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.229+0000 7f4d01a81640 1 Processor -- start 2024-03-04T08:50:55.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 -- start start 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cfc0b4460 0x7f4cfc156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cfc161cf0 0x7f4cfc0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0ce950 con 0x7f4cfc162970 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0d2b60 con 0x7f4cfc161cf0 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4d01a81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0b3ac0 con 0x7f4cfc0b4460 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.230+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37428/0 (socket says 172.21.15.19:37428) 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 -- 172.21.15.19:0/624390223 learned_addr learned my addr 172.21.15.19:0/624390223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cfc0b4460 0x7f4cfc156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cfc161cf0 0x7f4cfc0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 -- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cfc0b4460 msgr2=0x7f4cfc156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cfc0b4460 0x7f4cfc156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 -- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cfc161cf0 msgr2=0x7f4cfc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cfc161cf0 0x7f4cfc0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 -- 172.21.15.19:0/624390223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0cc460 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c7d0 tx=0x7f4cf400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4ce3fff640 1 -- 172.21.15.19:0/624390223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4003b70 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4ce3fff640 1 -- 172.21.15.19:0/624390223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4003d30 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc0cc740 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4ce3fff640 1 -- 172.21.15.19:0/624390223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400aa90 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.231+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0ccd00 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.232+0000 7f4ce3fff640 1 -- 172.21.15.19:0/624390223 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4cf400ac30 con 0x7f4cfc162970 2024-03-04T08:50:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.233+0000 7f4ce3fff640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 0x7f4ce806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.233+0000 7f4ce3fff640 1 -- 172.21.15.19:0/624390223 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf4089fe0 con 0x7f4cfc162970 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.233+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 0x7f4ce806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.234+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 0x7f4ce806d9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.234+0000 7f4d04669740 1 Processor -- start 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.234+0000 7f4d04669740 1 -- start start 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f708c0 0x55d431f72360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431ed66b0 con 0x55d431f6c870 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431e7fa60 con 0x55d431f9c600 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d431ed2750 con 0x55d431f708c0 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37434/0 (socket says 172.21.15.19:37434) 2024-03-04T08:50:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/2756191430 learned_addr learned my addr 172.21.15.19:0/2756191430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f708c0 0x55d431f72360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f708c0 msgr2=0x55d431f72360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f708c0 0x55d431f72360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 msgr2=0x55d431f9ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 -- 172.21.15.19:0/2756191430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d431e9df30 con 0x55d431f6c870 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.235+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009960 tx=0x7f4cec030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfd6189c02b4209 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4ce17fa640 1 -- 172.21.15.19:0/2756191430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec053070 con 0x55d431f6c870 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4ce17fa640 1 -- 172.21.15.19:0/2756191430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0399e0 con 0x55d431f6c870 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4ce17fa640 1 -- 172.21.15.19:0/2756191430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec034040 con 0x55d431f6c870 2024-03-04T08:50:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 -- 172.21.15.19:0/2756191430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 msgr2=0x55d431f6cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009960 tx=0x7f4cec030000 comp rx=0 tx=0).stop 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 -- 172.21.15.19:0/2756191430 shutdown_connections 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f708c0 0x55d431f72360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 --2- 172.21.15.19:0/2756191430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f6c870 0x55d431f6cc50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 -- 172.21.15.19:0/2756191430 >> 172.21.15.19:0/2756191430 conn(0x55d431f6e8f0 msgr2=0x55d431f701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 -- 172.21.15.19:0/2756191430 shutdown_connections 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.236+0000 7f4d04669740 1 -- 172.21.15.19:0/2756191430 wait complete. 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.237+0000 7f4d04669740 1 -- start start 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.237+0000 7f4d04669740 1 Processor -- start 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9df70 0x55d431f9e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431f70d50 con 0x55d431f94c10 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431e92ea0 con 0x55d431f9c600 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d431f71030 con 0x55d431f9df70 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 10 client.0 _ll_register_callbacks cb 0x55d431e92870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37440/0 (socket says 172.21.15.19:37440) 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 -- 172.21.15.19:0/2495933351 learned_addr learned my addr 172.21.15.19:0/2495933351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9df70 0x55d431f9e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 -- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9df70 msgr2=0x55d431f9e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9df70 0x55d431f9e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 -- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 msgr2=0x55d431f915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f915a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 -- 172.21.15.19:0/2495933351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d431e93270 con 0x55d431f94c10 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc162db0 tx=0x7f4cf0014e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f73d1275bbe92e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0022060 con 0x55d431f94c10 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf0012ac0 con 0x55d431f94c10 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4cec0399e0 con 0x55d431f94c10 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.238+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cf0028050 con 0x55d431f94c10 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 10 client.4677 fetch_fsmap learned FSMap version 6 2024-03-04T08:50:55.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55d431beb2d0 con 0x55d431f94c10 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0399e0 con 0x55d431f94c10 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f4cf002b020 con 0x55d431f94c10 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 10 client.4677 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 20 client.4677 populate_metadata read hostname 'smithi019' 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f97640 0x55d431fd6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 4 client.4677 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 --> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d431ee3bf0 con 0x55d431f97640 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f97640 0x55d431fd6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f97640 0x55d431fd6810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66f808bdb02d3124 server_cookie=22ba0be0bddbf750 in_seq=0 out_seq=0 2024-03-04T08:50:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.239+0000 7f4cda7fc640 10 client.4677 ms_handle_connect on v2:172.21.15.204:6835/1359328576 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2495933351 <== mds.0 v2:172.21.15.204:6835/1359328576 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d431ee3bf0 con 0x55d431f97640 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4cda7fc640 10 client.4677 handle_command_reply: tid=0 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 client.4677 shutdown 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 msgr2=0x55d431f8f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc162db0 tx=0x7f4cf0014e30 comp rx=0 tx=0).stop 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 shutdown_connections 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f97640 0x55d431fd6810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9df70 0x55d431f9e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f94c10 0x55d431f8f130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4cda7fc640 0 client.4677 ms_handle_reset on v2:172.21.15.204:6835/1359328576 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 --2- 172.21.15.19:0/2495933351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 >> 172.21.15.19:0/2495933351 conn(0x55d431f6c870 msgr2=0x55d431f9a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 shutdown_connections 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 1 -- 172.21.15.19:0/2495933351 wait complete. 2024-03-04T08:50:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.240+0000 7f4d04669740 20 client.4677 trim_cache size 0 max 16384 2024-03-04T08:50:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.257+0000 7f4d04669740 1 Processor -- start 2024-03-04T08:50:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.257+0000 7f4d04669740 1 -- start start 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f94c10 0x55d431f998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc200210 con 0x55d431f9df70 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0c8500 con 0x55d431f94c10 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0c7900 con 0x55d431f9c600 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37442/0 (socket says 172.21.15.19:37442) 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 -- 172.21.15.19:0/3420657966 learned_addr learned my addr 172.21.15.19:0/3420657966 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f94c10 0x55d431f998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 -- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9c600 msgr2=0x55d431f9a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 -- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f94c10 msgr2=0x55d431f998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f94c10 0x55d431f998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.258+0000 7f4cfbfff640 1 -- 172.21.15.19:0/3420657966 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d431cb56b0 con 0x55d431f9df70 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4054c60 tx=0x7f4cf4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2079b3ebaa7958d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4ce0ff9640 1 -- 172.21.15.19:0/3420657966 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4086070 con 0x55d431f9df70 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4ce0ff9640 1 -- 172.21.15.19:0/3420657966 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4088580 con 0x55d431f9df70 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4ce0ff9640 1 -- 172.21.15.19:0/3420657966 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4081e60 con 0x55d431f9df70 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 -- 172.21.15.19:0/3420657966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 msgr2=0x55d431f9a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4054c60 tx=0x7f4cf4005040 comp rx=0 tx=0).stop 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 -- 172.21.15.19:0/3420657966 shutdown_connections 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 --2- 172.21.15.19:0/3420657966 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f94c10 0x55d431f998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 -- 172.21.15.19:0/3420657966 >> 172.21.15.19:0/3420657966 conn(0x55d431f6c870 msgr2=0x55d431f8ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 -- 172.21.15.19:0/3420657966 shutdown_connections 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.259+0000 7f4d04669740 1 -- 172.21.15.19:0/3420657966 wait complete. 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.260+0000 7f4d04669740 1 -- start start 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.260+0000 7f4d04669740 1 Processor -- start 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f94c10 0x55d432010460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431f8f670 con 0x55d431f9df70 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0c7f00 con 0x55d431f9c600 2024-03-04T08:50:55.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d431f9eab0 con 0x55d431f94c10 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 10 client.0 _ll_register_callbacks cb 0x7f4cf00145e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37456/0 (socket says 172.21.15.19:37456) 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 -- 172.21.15.19:0/2163002173 learned_addr learned my addr 172.21.15.19:0/2163002173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f94c10 0x55d432010460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfaffd640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 -- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f94c10 msgr2=0x55d432010460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f94c10 0x55d432010460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 -- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 msgr2=0x55d431f9a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 -- 172.21.15.19:0/2163002173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d431fb7260 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cfbfff640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4054c60 tx=0x7f4cf40883d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d470108cc0f4de1 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4075060 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf4057c50 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4cf4088580 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cf407c050 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 10 client.4683 fetch_fsmap learned FSMap version 6 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.261+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55d431f96270 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4088580 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f4cf4054550 con 0x55d431f9df70 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 10 client.4683 fetch_fsmap finished waiting for FSMap version 6 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 20 client.4683 populate_metadata read hostname 'smithi019' 2024-03-04T08:50:55.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f958f0 0x55d431f9ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 4 client.4683 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 --> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d431eddf40 con 0x55d431f958f0 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f958f0 0x55d431f9ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cfb7fe640 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f958f0 0x55d431f9ed20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=507452b947f62f3f server_cookie=981f71ec106519cd in_seq=0 out_seq=0 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 10 client.4683 ms_handle_connect on v2:172.21.15.204:6835/1359328576 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 1 -- 172.21.15.19:0/2163002173 <== mds.0 v2:172.21.15.204:6835/1359328576 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d431eddf40 con 0x55d431f958f0 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 10 client.4683 handle_command_reply: tid=0 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 client.4683 shutdown 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 msgr2=0x55d431f9a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4054c60 tx=0x7f4cf40883d0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 shutdown_connections 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:6835/1359328576,v1:172.21.15.204:6837/1359328576] conn(0x55d431f958f0 0x55d431f9ed20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d431f9df70 0x55d431f9a7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d431f9c600 0x55d431f9a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4cda7fc640 0 client.4683 ms_handle_reset on v2:172.21.15.204:6835/1359328576 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.262+0000 7f4d04669740 1 --2- 172.21.15.19:0/2163002173 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d431f94c10 0x55d432010460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 >> 172.21.15.19:0/2163002173 conn(0x55d431f6c870 msgr2=0x55d431f91050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 shutdown_connections 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d04669740 1 -- 172.21.15.19:0/2163002173 wait complete. 2024-03-04T08:50:55.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d04669740 20 client.4683 trim_cache size 0 max 16384 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "385c227e-6109-4019-8b7b-25dec95ce12d", 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4273, 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 16.923401588000001, 2024-03-04T08:50:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 6, 2024-03-04T08:50:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 21, 2024-03-04T08:50:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 21, 2024-03-04T08:50:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 23.824287546000001 2024-03-04T08:50:55.268 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 msgr2=0x7f4ce806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 0x7f4ce806d9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec03b040 comp rx=0 tx=0).stop 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 msgr2=0x7f4cfc15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c7d0 tx=0x7f4cf400cc90 comp rx=0 tx=0).stop 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 shutdown_connections 2024-03-04T08:50:55.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc162970 0x7f4cfc15eda0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4ce806b500 0x7f4ce806d9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cfc161cf0 0x7f4cfc0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 --2- 172.21.15.19:0/624390223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cfc0b4460 0x7f4cfc156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 >> 172.21.15.19:0/624390223 conn(0x7f4cfc0d3ce0 msgr2=0x7f4cfc0d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 shutdown_connections 2024-03-04T08:50:55.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.263+0000 7f4d01a81640 1 -- 172.21.15.19:0/624390223 wait complete. 2024-03-04T08:50:55.271 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-04T08:50:55.302 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-04T08:50:55.302 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-04T08:50:55.302 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:55.303 INFO:tasks.ceph_fuse:client.2 config is {} 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-04T08:50:55.303 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-04T08:50:55.303 INFO:tasks.ceph_fuse:client.3 config is {} 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T08:50:55.303 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-04T08:50:55.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.304 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:50:55.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-04T08:50:55.387 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-03-04T08:50:55.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:50:55.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.389 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-04T08:50:55.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.405 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-04T08:50:55.473 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-03-04T08:50:55.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:50:55.475 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-04T08:50:55.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:50:55.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.580+0000 7f0936572640 1 Processor -- start 2024-03-04T08:50:55.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 -- start start 2024-03-04T08:50:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f09300c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09300d16e0 0x7f09300d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09300cebe0 con 0x7f093015fa10 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300ce980 con 0x7f09300d16e0 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0936572640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09300ceec0 con 0x7f093015bdd0 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0934b0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09300d16e0 0x7f09300d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0934b0f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09300d16e0 0x7f09300d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37464/0 (socket says 172.21.15.19:37464) 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.581+0000 7f0934b0f640 1 -- 172.21.15.19:0/1767785798 learned_addr learned my addr 172.21.15.19:0/1767785798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f092ffff640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f09300c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f0934b0f640 1 -- 172.21.15.19:0/1767785798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 msgr2=0x7f09300c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f0934b0f640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f09300c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f0934b0f640 1 -- 172.21.15.19:0/1767785798 >> v1:172.21.15.204:6789/0 conn(0x7f093015fa10 legacy=0x7f09300ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f092effd640 1 -- 172.21.15.19:0/1767785798 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972136056 0 0) 0x7f09300cebe0 con 0x7f093015fa10 2024-03-04T08:50:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f0934b0f640 1 -- 172.21.15.19:0/1767785798 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300cf1a0 con 0x7f09300d16e0 2024-03-04T08:50:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.582+0000 7f0934b0f640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09300d16e0 0x7f09300d1b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f092802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46773120dc9923c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f092effd640 1 -- 172.21.15.19:0/1767785798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092802ca70 con 0x7f09300d16e0 2024-03-04T08:50:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f092effd640 1 -- 172.21.15.19:0/1767785798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092802cc10 con 0x7f09300d16e0 2024-03-04T08:50:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f092effd640 1 -- 172.21.15.19:0/1767785798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280343f0 con 0x7f09300d16e0 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 -- 172.21.15.19:0/1767785798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09300d16e0 msgr2=0x7f09300d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09300d16e0 0x7f09300d1b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f092802bed0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 -- 172.21.15.19:0/1767785798 shutdown_connections 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09300d16e0 0x7f09300d1b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 --2- 172.21.15.19:0/1767785798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f09300c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 -- 172.21.15.19:0/1767785798 >> 172.21.15.19:0/1767785798 conn(0x7f093009a9f0 msgr2=0x7f093009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 -- 172.21.15.19:0/1767785798 shutdown_connections 2024-03-04T08:50:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.583+0000 7f0936572640 1 -- 172.21.15.19:0/1767785798 wait complete. 2024-03-04T08:50:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.584+0000 7f0936572640 1 Processor -- start 2024-03-04T08:50:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 -- start start 2024-03-04T08:50:55.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 0x7f09300b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f093006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300d2070 con 0x7f093015fa10 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300c5b50 con 0x7f09300d16e0 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0936572640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09300cc5d0 con 0x7f093015bdd0 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0934b0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0934b0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37472/0 (socket says 172.21.15.19:37472) 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f0934b0f640 1 -- 172.21.15.19:0/4061148032 learned_addr learned my addr 172.21.15.19:0/4061148032 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f092ffff640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 0x7f09300b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.585+0000 7f092f7fe640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f093006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 -- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 msgr2=0x7f093006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f093006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 -- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 msgr2=0x7f09300b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 0x7f09300b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 -- 172.21.15.19:0/4061148032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093006c750 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f092ffff640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 0x7f09300b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0934b0f640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f0928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928043020 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092803e450 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928009510 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093006ca30 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.586+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093006cff0 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.587+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093004f330 con 0x7f093015fa10 2024-03-04T08:50:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.588+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0928046020 con 0x7f093015fa10 2024-03-04T08:50:55.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.588+0000 7f092cff9640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 0x7f091c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:55.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.588+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09280ac7b0 con 0x7f093015fa10 2024-03-04T08:50:55.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.588+0000 7f092ffff640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 0x7f091c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:55.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.589+0000 7f092ffff640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 0x7f091c06d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0920009e90 tx=0x7f0920009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:55.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.592+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f092804d030 con 0x7f093015fa10 2024-03-04T08:50:55.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.818+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f09300b7a40 con 0x7f093015fa10 2024-03-04T08:50:55.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.818+0000 7f092cff9640 1 -- 172.21.15.19:0/4061148032 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f092807b070 con 0x7f093015fa10 2024-03-04T08:50:55.814 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:50:55.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 msgr2=0x7f091c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 0x7f091c06d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0920009e90 tx=0x7f0920009190 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 msgr2=0x7f093015ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f0928004a40 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 shutdown_connections 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093015fa10 0x7f093015ed70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093015bdd0 0x7f093006c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f091c06b4d0 0x7f091c06d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 --2- 172.21.15.19:0/4061148032 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09300d16e0 0x7f09300b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 >> 172.21.15.19:0/4061148032 conn(0x7f093009a9f0 msgr2=0x7f09300ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 shutdown_connections 2024-03-04T08:50:55.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:55.820+0000 7f0936572640 1 -- 172.21.15.19:0/4061148032 wait complete. 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:50:55.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:50:55.828 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:50:55.828 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:50:55.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.828 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:50:55.842 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:50:55.843 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42638sec preferred_lft 42638sec 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:50:55.844 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-04T08:50:55.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:55.844 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-04T08:50:55.845 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:56.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.007 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:50:56.033 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:50:56.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.035 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:50:56.113 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:50:56.114 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:50:56.114 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:50:56.114 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:50:56.114 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:50:56.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.114 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:56.115 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:56.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:50:56.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:50:56.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:50:56.115 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:56.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.358 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:50:56.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.373 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-03-04T08:50:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.428 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:56.428 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:56.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:56.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-04T08:50:56.428 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:56.510 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-04T08:50:56.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.510 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-04T08:50:56.511 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:56.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.650 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:56.650 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:56.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:50:56.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-03-04T08:50:56.650 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:56.691 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:50:56.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:56.691 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:56.745 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:50:56.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:56.746 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:56.801 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:50:56.869 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:50:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:50:56.925 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:56.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:56.926 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:50:56.978 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:50:56.978 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:50:57.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:50:57.046 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:50:57.102 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:50:57.103 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:57.104 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:57.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.105 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:50:57.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:50:57.110+0000 7f280a63d480 -1 init, newargv = 0x55c338b84810 newargc=15 2024-03-04T08:50:57.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[46299]: starting ceph client 2024-03-04T08:50:57.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[46299]: starting fuse 2024-03-04T08:50:57.120 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:50:57.121 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:50:57.121 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:50:57.123 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:50:57.241 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.46299.asok 2024-03-04T08:50:57.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:50:57.252 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46299.asok 2024-03-04T08:50:57.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46299.asok status 2024-03-04T08:50:57.390 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:50:57.390 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "46299", 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4692, 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:50:57.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4692 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1434766359 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1434766359 2024-03-04T08:50:57.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4692 192.168.0.1:0/1434766359", 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/1434766359", 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 6, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 21, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:50:57.393 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:50:57.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:50:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.505+0000 7f8506d13640 1 Processor -- start 2024-03-04T08:50:57.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.505+0000 7f8506d13640 1 -- start start 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.505+0000 7f8506d13640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85000cdcb0 0x7f85000ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.505+0000 7f8506d13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850006e0a0 0x7f850006e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.505+0000 7f8506d13640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850006d2e0 con 0x7f850015ac00 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f8506d13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000ce630 con 0x7f850006e0a0 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f8506d13640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850006d5c0 con 0x7f85000cdcb0 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f85052b0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850006e0a0 0x7f850006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f8504aaf640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f850015ac00 0x7f850006bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42322/0 (socket says 172.21.15.19:42322) 2024-03-04T08:50:57.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f8504aaf640 1 -- 172.21.15.19:0/199033061 learned_addr learned my addr 172.21.15.19:0/199033061 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f84fffff640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85000cdcb0 0x7f85000ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f85052b0640 1 -- 172.21.15.19:0/199033061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85000cdcb0 msgr2=0x7f85000ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f85052b0640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85000cdcb0 0x7f85000ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f85052b0640 1 -- 172.21.15.19:0/199033061 >> v1:172.21.15.19:6789/0 conn(0x7f850015ac00 legacy=0x7f850006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f85052b0640 1 -- 172.21.15.19:0/199033061 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850006d8a0 con 0x7f850006e0a0 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.506+0000 7f84ff7fe640 1 -- 172.21.15.19:0/199033061 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842506506 0 0) 0x7f850006d2e0 con 0x7f850015ac00 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f85052b0640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f850006e530 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009d90 tx=0x7f84f802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc1f8a39c4e8e0e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f84ff7fe640 1 -- 172.21.15.19:0/199033061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8039070 con 0x7f850006e0a0 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f84ff7fe640 1 -- 172.21.15.19:0/199033061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f802cc50 con 0x7f850006e0a0 2024-03-04T08:50:57.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f84ff7fe640 1 -- 172.21.15.19:0/199033061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8034440 con 0x7f850006e0a0 2024-03-04T08:50:57.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 -- 172.21.15.19:0/199033061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 msgr2=0x7f850006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f850006e530 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009d90 tx=0x7f84f802bea0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 -- 172.21.15.19:0/199033061 shutdown_connections 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f850006e530 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 --2- 172.21.15.19:0/199033061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85000cdcb0 0x7f85000ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 -- 172.21.15.19:0/199033061 >> 172.21.15.19:0/199033061 conn(0x7f85000d00e0 msgr2=0x7f85000d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 -- 172.21.15.19:0/199033061 shutdown_connections 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.507+0000 7f8506d13640 1 -- 172.21.15.19:0/199033061 wait complete. 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 Processor -- start 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 -- start start 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 0x7f85000b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f850015ac00 0x7f8500072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.509+0000 7f8506d13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000ca730 con 0x7f850006e0a0 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8506d13640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850006b240 con 0x7f85000cdcb0 2024-03-04T08:50:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8506d13640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000ca8b0 con 0x7f850015ac00 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47570/0 (socket says 172.21.15.19:47570) 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 -- 172.21.15.19:0/1137931243 learned_addr learned my addr 172.21.15.19:0/1137931243 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f85052b0640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f850015ac00 0x7f8500072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f84fffff640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 0x7f85000b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 -- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f850015ac00 msgr2=0x7f8500072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f850015ac00 0x7f8500072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 -- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 msgr2=0x7f85000b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 0x7f85000b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 -- 172.21.15.19:0/1137931243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000b5aa0 con 0x7f850006e0a0 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f84fffff640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 0x7f85000b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8504aaf640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c430 tx=0x7f84f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40074e0 con 0x7f850006e0a0 2024-03-04T08:50:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40047e0 con 0x7f850006e0a0 2024-03-04T08:50:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000c5570 con 0x7f850006e0a0 2024-03-04T08:50:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4004bd0 con 0x7f850006e0a0 2024-03-04T08:50:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.510+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000c5ad0 con 0x7f850006e0a0 2024-03-04T08:50:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.511+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850004f330 con 0x7f850006e0a0 2024-03-04T08:50:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.512+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84f4011070 con 0x7f850006e0a0 2024-03-04T08:50:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.512+0000 7f84fd7fa640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 0x7f84e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.512+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f4089de0 con 0x7f850006e0a0 2024-03-04T08:50:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.512+0000 7f84fffff640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 0x7f84e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.513+0000 7f84fffff640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 0x7f84e406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f850015a3d0 tx=0x7f84ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:57.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.517+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f85000c5570 con 0x7f850006e0a0 2024-03-04T08:50:57.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.737+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85000b0a70 con 0x7f850006e0a0 2024-03-04T08:50:57.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.738+0000 7f84fd7fa640 1 -- 172.21.15.19:0/1137931243 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84f4058c60 con 0x7f850006e0a0 2024-03-04T08:50:57.734 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:50:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 msgr2=0x7f84e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 0x7f84e406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f850015a3d0 tx=0x7f84ec008040 comp rx=0 tx=0).stop 2024-03-04T08:50:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 msgr2=0x7f85000b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:57.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c430 tx=0x7f84f400c8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 shutdown_connections 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f850015ac00 0x7f8500072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84e406b4d0 0x7f84e406d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85000cdcb0 0x7f85000b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 --2- 172.21.15.19:0/1137931243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850006e0a0 0x7f85000b4390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 >> 172.21.15.19:0/1137931243 conn(0x7f85000d00e0 msgr2=0x7f85000b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 shutdown_connections 2024-03-04T08:50:57.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:57.740+0000 7f8506d13640 1 -- 172.21.15.19:0/1137931243 wait complete. 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:50:57.747 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:50:57.748 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:50:57.748 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-04T08:50:57.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.748 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:50:57.763 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:50:57.764 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link tentative 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:57.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.765 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:50:57.828 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:50:57.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.830 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:50:57.885 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:50:57.886 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:50:57.886 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:50:57.886 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:50:57.886 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:50:57.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:50:57.886 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:57.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.981 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:50:57.995 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:50:57.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:57.996 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-03-04T08:50:58.050 INFO:teuthology.orchestra.run.smithi019.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-04T08:50:58.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.051 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:58.051 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:58.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:50:58.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-04T08:50:58.051 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:58.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-04T08:50:58.199 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:58.199 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:58.199 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:58.199 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.199 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 96:5a:b9:e7:f7:95 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::945a:b9ff:fee7:f795/64 scope link 2024-03-04T08:50:58.200 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 96:5a:b9:e7:f7:95 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.268 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::945a:b9ff:fee7:f795/64 scope link 2024-03-04T08:50:58.269 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:58.270 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-04T08:50:58.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-04T08:50:58.270 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:58.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.396 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:50:58.396 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:50:58.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.1 up 2024-03-04T08:50:58.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.1 master ceph-brx 2024-03-04T08:50:58.396 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:50:58.437 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-03-04T08:50:58.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:58.437 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-04T08:50:58.492 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-04T08:50:58.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:50:58.492 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-04T08:50:58.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:50:58.612 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:50:58.668 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:50:58.668 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:50:58.668 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:50:58.669 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:58.671 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:58.671 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:50:58.671 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:50:58.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.671 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:50:58.723 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:50:58.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-03-04T08:50:58.723 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-03-04T08:50:58.765 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:50:58.791 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:50:58.845 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:50:58.845 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:50:58.845 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:50:58.845 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:50:58.846 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:58.847 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:50:58.848 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-04T08:50:58.848 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:50:58.848 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:50:58.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.849 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:50:58.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:2024-03-04T08:50:58.853+0000 7f7e0a41f480 -1 init, newargv = 0x55d7b6c038d0 newargc=15 2024-03-04T08:50:58.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[46793]: starting ceph client 2024-03-04T08:50:58.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[46793]: starting fuse 2024-03-04T08:50:58.863 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:50:58.863 INFO:teuthology.orchestra.run.smithi019.stdout:44 2024-03-04T08:50:58.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2024-03-04T08:50:58.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:50:58.863 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:50:58.863 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:50:58.864 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.2")) 2024-03-04T08:50:58.865 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:50:58.982 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.2.46793.asok 2024-03-04T08:50:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:50:58.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46793.asok 2024-03-04T08:50:58.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:58.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46793.asok status 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "2", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "46793", 2024-03-04T08:50:59.130 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4710, 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4710 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3219151809 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:50:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3219151809 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4710 192.168.0.2:0/3219151809", 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.2:0/3219151809", 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 6, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 21, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:50:59.132 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:50:59.138 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:50:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.242+0000 7fcdff81c640 1 Processor -- start 2024-03-04T08:50:59.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.242+0000 7fcdff81c640 1 -- start start 2024-03-04T08:50:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdff81c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcdf81621c0 0x7fcdf80cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdff81c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80ceac0 con 0x7fcdf80d4920 2024-03-04T08:50:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdff81c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80d2dc0 con 0x7fcdf81625a0 2024-03-04T08:50:59.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdff81c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf80cf690 con 0x7fcdf81621c0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfcdb7640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcdf80d4920 0x7fcdf80d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42334/0 (socket says 172.21.15.19:42334) 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfcdb7640 1 -- 172.21.15.19:0/4103572390 learned_addr learned my addr 172.21.15.19:0/4103572390 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/4103572390 >> v2:172.21.15.204:3300/0 conn(0x7fcdf81621c0 0x7fcdf80cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217132296 0 0) 0x7fcdf80ceac0 con 0x7fcdf80d4920 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde4003520 con 0x7fcdf80d4920 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589473045 0 0) 0x7fcdf80d2dc0 con 0x7fcdf81625a0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfd5b8640 1 -- 172.21.15.19:0/4103572390 >> v1:172.21.15.204:6789/0 conn(0x7fcdf81625a0 legacy=0x7fcdf815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfd5b8640 1 -- 172.21.15.19:0/4103572390 >> v1:172.21.15.19:6789/0 conn(0x7fcdf80d4920 legacy=0x7fcdf80d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.243+0000 7fcdfd5b8640 1 -- 172.21.15.19:0/4103572390 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80ced60 con 0x7fcdf81621c0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.244+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/4103572390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf81621c0 0x7fcdf80cfb20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097a0 tx=0x7fcdf402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86724ac7d950099e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.244+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4035020 con 0x7fcdf81621c0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.244+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4031830 con 0x7fcdf81621c0 2024-03-04T08:50:59.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.244+0000 7fcdeffff640 1 -- 172.21.15.19:0/4103572390 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4031be0 con 0x7fcdf81621c0 2024-03-04T08:50:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 -- 172.21.15.19:0/4103572390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf81621c0 msgr2=0x7fcdf80cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 --2- 172.21.15.19:0/4103572390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf81621c0 0x7fcdf80cfb20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097a0 tx=0x7fcdf402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 -- 172.21.15.19:0/4103572390 shutdown_connections 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 --2- 172.21.15.19:0/4103572390 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf81621c0 0x7fcdf80cfb20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 -- 172.21.15.19:0/4103572390 >> 172.21.15.19:0/4103572390 conn(0x7fcdf80d3d10 msgr2=0x7fcdf80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 -- 172.21.15.19:0/4103572390 shutdown_connections 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.245+0000 7fcdff81c640 1 -- 172.21.15.19:0/4103572390 wait complete. 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.246+0000 7fcdff81c640 1 Processor -- start 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.246+0000 7fcdff81c640 1 -- start start 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 0x7fcdf80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf81625a0 0x7fcdf815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf815e450 con 0x7fcdf81621c0 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cf320 con 0x7fcdf80d4920 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf815e5d0 con 0x7fcdf81625a0 2024-03-04T08:50:59.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47586/0 (socket says 172.21.15.19:47586) 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 -- 172.21.15.19:0/3403619861 learned_addr learned my addr 172.21.15.19:0/3403619861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 0x7fcdf80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfddb9640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf81625a0 0x7fcdf815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 -- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf81625a0 msgr2=0x7fcdf815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf81625a0 0x7fcdf815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 -- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 msgr2=0x7fcdf80cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 0x7fcdf80cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 -- 172.21.15.19:0/3403619861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80b8d20 con 0x7fcdf81621c0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 0x7fcdf80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdfcdb7640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c430 tx=0x7fcde800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8017070 con 0x7fcdf81621c0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8005ce0 con 0x7fcdf81621c0 2024-03-04T08:50:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80b8f90 con 0x7fcdf81621c0 2024-03-04T08:50:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.247+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80072f0 con 0x7fcdf81621c0 2024-03-04T08:50:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.248+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf80b9550 con 0x7fcdf81621c0 2024-03-04T08:50:59.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.249+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf804f330 con 0x7fcdf81621c0 2024-03-04T08:50:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.249+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcde801a070 con 0x7fcdf81621c0 2024-03-04T08:50:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.249+0000 7fcdedffb640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 0x7fcddc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:50:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.249+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcde8089570 con 0x7fcdf81621c0 2024-03-04T08:50:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.249+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 0x7fcddc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:50:59.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.250+0000 7fcdfd5b8640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 0x7fcddc06d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4036000 tx=0x7fcdf4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:50:59.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.254+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcde8057e30 con 0x7fcdf81621c0 2024-03-04T08:50:59.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.474+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdf8073380 con 0x7fcdf81621c0 2024-03-04T08:50:59.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.474+0000 7fcdedffb640 1 -- 172.21.15.19:0/3403619861 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcde805bed0 con 0x7fcdf81621c0 2024-03-04T08:50:59.471 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 msgr2=0x7fcddc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 0x7fcddc06d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4036000 tx=0x7fcdf4008030 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 msgr2=0x7fcdf81572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcde800c430 tx=0x7fcde800c8f0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 shutdown_connections 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcdf81625a0 0x7fcdf815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdf81621c0 0x7fcdf81572e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcddc06b4d0 0x7fcddc06d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 --2- 172.21.15.19:0/3403619861 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcdf80d4920 0x7fcdf80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:50:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 >> 172.21.15.19:0/3403619861 conn(0x7fcdf80d3d10 msgr2=0x7fcdf815f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:50:59.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 shutdown_connections 2024-03-04T08:50:59.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:50:59.476+0000 7fcdff81c640 1 -- 172.21.15.19:0/3403619861 wait complete. 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:50:59.483 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-04T08:50:59.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:59.484 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-04T08:50:59.499 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-03-04T08:50:59.500 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2024-03-04T08:50:59.501 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:50:59.501 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-04T08:50:59.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-04T08:50:59.501 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:50:59.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:59.664 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:50:59.691 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-04T08:50:59.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:59.692 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-03-04T08:50:59.761 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-03-04T08:50:59.762 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:50:59.762 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-04T08:50:59.762 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-04T08:50:59.762 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:50:59.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:50:59.762 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:50:59.762 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:50:59.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-04T08:50:59.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-04T08:50:59.763 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-04T08:50:59.763 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:00.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.021 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-04T08:51:00.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.035 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-03-04T08:51:00.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.091 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:00.091 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:00.091 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:00.091 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-04T08:51:00.091 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:00.175 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-04T08:51:00.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-04T08:51:00.176 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:00.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.284 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:00.284 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:00.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2024-03-04T08:51:00.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2024-03-04T08:51:00.284 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:00.328 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-04T08:51:00.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:00.328 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:00.385 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-04T08:51:00.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:00.386 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:00.441 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-03-04T08:51:00.510 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:00.566 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-03-04T08:51:00.566 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-03-04T08:51:00.567 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-03-04T08:51:00.568 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-03-04T08:51:00.569 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-03-04T08:51:00.569 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:00.569 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:00.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.569 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-03-04T08:51:00.621 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:51:00.621 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-04T08:51:00.664 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-03-04T08:51:00.692 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:00.748 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:00.749 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-03-04T08:51:00.750 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-03-04T08:51:00.751 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-03-04T08:51:00.751 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-03-04T08:51:00.751 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:00.751 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:00.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.751 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-03-04T08:51:00.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:2024-03-04T08:51:00.756+0000 7f42c7731480 -1 init, newargv = 0x5625bdef6440 newargc=15 2024-03-04T08:51:00.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[44242]: starting ceph client 2024-03-04T08:51:00.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi204.stderr:ceph-fuse[44242]: starting fuse 2024-03-04T08:51:00.768 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-03-04T08:51:00.768 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> import re 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> import os 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2024-03-04T08:51:00.768 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> return f 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:00.769 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.1")) 2024-03-04T08:51:00.770 DEBUG:teuthology.orchestra.run.smithi204:> ' 2024-03-04T08:51:00.890 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.1.44242.asok 2024-03-04T08:51:00.894 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:51:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:51:00.903 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44242.asok 2024-03-04T08:51:00.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:00.903 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44242.asok status 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "1", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "44242", 2024-03-04T08:51:01.042 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4720, 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4720 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 3156943411 2024-03-04T08:51:01.043 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 3156943411 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4720 192.168.0.1:0/3156943411", 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.1:0/3156943411", 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 6, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 21, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2024-03-04T08:51:01.044 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-03-04T08:51:01.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:51:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.167+0000 7f0b5f2ed640 1 Processor -- start 2024-03-04T08:51:01.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.167+0000 7f0b5f2ed640 1 -- start start 2024-03-04T08:51:01.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5f2ed640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b581621c0 0x7f0b580cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5f2ed640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0b581625a0 0x7f0b5815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5f2ed640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580ceac0 con 0x7f0b580d4920 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5f2ed640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580cf690 con 0x7f0b581621c0 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5f2ed640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580d2dc0 con 0x7f0b581625a0 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5d089640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b581621c0 0x7f0b580cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5c888640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0b580d4920 0x7f0b580d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42338/0 (socket says 172.21.15.19:42338) 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5c888640 1 -- 172.21.15.19:0/2942298121 learned_addr learned my addr 172.21.15.19:0/2942298121 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b5d88a640 1 --2- 172.21.15.19:0/2942298121 >> v2:172.21.15.204:3300/0 conn(0x7f0b581625a0 0x7f0b5815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b4ffff640 1 -- 172.21.15.19:0/2942298121 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796005915 0 0) 0x7f0b580ceac0 con 0x7f0b580d4920 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.168+0000 7f0b4ffff640 1 -- 172.21.15.19:0/2942298121 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44003520 con 0x7f0b580d4920 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b5d089640 1 -- 172.21.15.19:0/2942298121 >> v2:172.21.15.204:3300/0 conn(0x7f0b581625a0 msgr2=0x7f0b5815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b5d089640 1 --2- 172.21.15.19:0/2942298121 >> v2:172.21.15.204:3300/0 conn(0x7f0b581625a0 0x7f0b5815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b5d089640 1 -- 172.21.15.19:0/2942298121 >> v1:172.21.15.19:6789/0 conn(0x7f0b580d4920 legacy=0x7f0b580d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b5d089640 1 -- 172.21.15.19:0/2942298121 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580ced60 con 0x7f0b581621c0 2024-03-04T08:51:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b5d089640 1 --2- 172.21.15.19:0/2942298121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581621c0 0x7f0b580cfb20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b580d3be0 tx=0x7f0b5002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc65baec0412a140 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b4ffff640 1 -- 172.21.15.19:0/2942298121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500315a0 con 0x7f0b581621c0 2024-03-04T08:51:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b4ffff640 1 -- 172.21.15.19:0/2942298121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50037070 con 0x7f0b581621c0 2024-03-04T08:51:01.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.169+0000 7f0b4ffff640 1 -- 172.21.15.19:0/2942298121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50031960 con 0x7f0b581621c0 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/2942298121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581621c0 msgr2=0x7f0b580cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/2942298121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581621c0 0x7f0b580cfb20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b580d3be0 tx=0x7f0b5002b840 comp rx=0 tx=0).stop 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/2942298121 shutdown_connections 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/2942298121 >> v2:172.21.15.204:3300/0 conn(0x7f0b581625a0 0x7f0b5815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/2942298121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581621c0 0x7f0b580cfb20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/2942298121 >> 172.21.15.19:0/2942298121 conn(0x7f0b580d3d10 msgr2=0x7f0b580d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/2942298121 shutdown_connections 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.170+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/2942298121 wait complete. 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.171+0000 7f0b5f2ed640 1 Processor -- start 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.171+0000 7f0b5f2ed640 1 -- start start 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b580d4920 0x7f0b5814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b581621c0 0x7f0b580cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5815e280 con 0x7f0b581625a0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580cf320 con 0x7f0b581621c0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5f2ed640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5815e400 con 0x7f0b580d4920 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5d88a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5d88a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47600/0 (socket says 172.21.15.19:47600) 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5d88a640 1 -- 172.21.15.19:0/3007308863 learned_addr learned my addr 172.21.15.19:0/3007308863 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5d089640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b580d4920 0x7f0b5814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.172+0000 7f0b5c888640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b581621c0 0x7f0b580cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 -- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b580d4920 msgr2=0x7f0b5814c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b580d4920 0x7f0b5814c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 -- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b581621c0 msgr2=0x7f0b580cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b581621c0 0x7f0b580cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 -- 172.21.15.19:0/3007308863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5814c650 con 0x7f0b581625a0 2024-03-04T08:51:01.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5d88a640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400efc0 tx=0x7f0b5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54018020 con 0x7f0b581625a0 2024-03-04T08:51:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54014480 con 0x7f0b581625a0 2024-03-04T08:51:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54014870 con 0x7f0b581625a0 2024-03-04T08:51:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5809dcc0 con 0x7f0b581625a0 2024-03-04T08:51:01.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.173+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5809e280 con 0x7f0b581625a0 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.174+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5804f330 con 0x7f0b581625a0 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.175+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b54005d10 con 0x7f0b581625a0 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.175+0000 7f0b4dffb640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.175+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b5408aa90 con 0x7f0b581625a0 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.175+0000 7f0b5d089640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:01.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.176+0000 7f0b5d089640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b50036000 tx=0x7f0b5003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:01.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.180+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0b54022070 con 0x7f0b581625a0 2024-03-04T08:51:01.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.400+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b58073380 con 0x7f0b581625a0 2024-03-04T08:51:01.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.401+0000 7f0b4dffb640 1 -- 172.21.15.19:0/3007308863 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b54010040 con 0x7f0b581625a0 2024-03-04T08:51:01.397 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:51:01.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 msgr2=0x7f0b3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b50036000 tx=0x7f0b5003d040 comp rx=0 tx=0).stop 2024-03-04T08:51:01.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 msgr2=0x7f0b5814fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:01.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400efc0 tx=0x7f0b5400c490 comp rx=0 tx=0).stop 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 shutdown_connections 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b581625a0 0x7f0b5814fdd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0b3c06b500 0x7f0b3c06d9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0b581621c0 0x7f0b580cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 --2- 172.21.15.19:0/3007308863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0b580d4920 0x7f0b5814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 >> 172.21.15.19:0/3007308863 conn(0x7f0b580d3d10 msgr2=0x7f0b580d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 shutdown_connections 2024-03-04T08:51:01.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:01.403+0000 7f0b5f2ed640 1 -- 172.21.15.19:0/3007308863 wait complete. 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:51:01.410 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-04T08:51:01.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.411 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:01.426 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42630sec preferred_lft 42630sec 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 5e:f5:f3:e4:5f:8e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::1c94:45ff:fea2:4f37/64 scope link tentative 2024-03-04T08:51:01.427 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.428 INFO:teuthology.orchestra.run.smithi204.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:51:01.428 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 5e:f5:f3:e4:5f:8e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:01.428 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::5cf5:f3ff:fee4:5f8e/64 scope link tentative 2024-03-04T08:51:01.428 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.428 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:51:01.492 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-03-04T08:51:01.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.494 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-03-04T08:51:01.550 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-03-04T08:51:01.550 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:51:01.550 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-04T08:51:01.551 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-04T08:51:01.551 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:51:01.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-04T08:51:01.551 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:01.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.647 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-04T08:51:01.661 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-04T08:51:01.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.662 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-03-04T08:51:01.716 INFO:teuthology.orchestra.run.smithi204.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-04T08:51:01.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.716 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:01.716 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:01.716 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:51:01.717 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-04T08:51:01.717 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:01.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-04T08:51:01.832 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether fe:54:a3:8e:7d:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::fc54:a3ff:fe8e:7d7a/64 scope link tentative 2024-03-04T08:51:01.833 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.834 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether fe:54:a3:8e:7d:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.900 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::fc54:a3ff:fe8e:7d7a/64 scope link tentative 2024-03-04T08:51:01.901 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:01.901 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-04T08:51:01.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-04T08:51:01.902 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:02.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.029 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-03-04T08:51:02.029 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-03-04T08:51:02.029 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.1 up 2024-03-04T08:51:02.029 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.1 master ceph-brx 2024-03-04T08:51:02.030 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-03-04T08:51:02.072 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-03-04T08:51:02.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:02.072 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:02.128 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-04T08:51:02.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:02.128 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:02.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-03-04T08:51:02.251 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-03-04T08:51:02.308 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-03-04T08:51:02.309 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-03-04T08:51:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:51:02.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.311 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-03-04T08:51:02.363 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-03-04T08:51:02.364 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-03-04T08:51:02.364 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-03-04T08:51:02.405 DEBUG:teuthology.orchestra.run.smithi204:> sudo modprobe fuse 2024-03-04T08:51:02.433 DEBUG:teuthology.orchestra.run.smithi204:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/proc 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/dev 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/security 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/shm 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/pts 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/run 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/cgroup 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/pstore 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/bpf 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/ 2024-03-04T08:51:02.488 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/selinux 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/mqueue 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/dev/hugepages 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/debug 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/tracing 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/sys/kernel/config 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/run/user/1000 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-4 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-5 2024-03-04T08:51:02.489 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-6 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/var/lib/ceph/osd/ceph-7 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run.smithi204.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:51:02.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.490 DEBUG:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2024-03-04T08:51:02.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:2024-03-04T08:51:02.497+0000 7f85ffd56480 -1 init, newargv = 0x55c7d3e799d0 newargc=15 2024-03-04T08:51:02.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[44695]: starting ceph client 2024-03-04T08:51:02.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi204.stderr:ceph-fuse[44695]: starting fuse 2024-03-04T08:51:02.509 INFO:teuthology.orchestra.run.smithi204.stdout:43 2024-03-04T08:51:02.509 INFO:teuthology.orchestra.run.smithi204.stdout:44 2024-03-04T08:51:02.509 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> import glob 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> import re 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> import os 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> import subprocess 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> def _find_admin_socket(client_name): 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2024-03-04T08:51:02.510 DEBUG:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> return files[0] 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> for f in files: 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> contents = proc_f.read() 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> if mountpoint in contents: 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> return f 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> print(_find_admin_socket("client.3")) 2024-03-04T08:51:02.511 DEBUG:teuthology.orchestra.run.smithi204:> ' 2024-03-04T08:51:02.634 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.3.44695.asok 2024-03-04T08:51:02.637 INFO:teuthology.orchestra.run.smithi204.stderr:2024-03-04T08:51:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:51:02.644 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44695.asok 2024-03-04T08:51:02.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.645 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44695.asok status 2024-03-04T08:51:02.781 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-03-04T08:51:02.781 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "3", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "44695", 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4547, 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2024-03-04T08:51:02.782 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4547 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 1866095296 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "v1", 2024-03-04T08:51:02.783 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "192.168.0.2:0", 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 1866095296 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4547 192.168.0.2:0/1866095296", 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "192.168.0.2:0/1866095296", 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 6, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 21, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "blocklisted": false, 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout: "fs_name": "cephfs" 2024-03-04T08:51:02.784 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-03-04T08:51:02.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.790 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:51:02.790 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:02.809 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:51:02.809 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:02.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:02.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.881 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:51:02.881 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.2 2024-03-04T08:51:02.938 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:51:02.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-03-04T08:51:02.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:02.938 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-04T08:51:03.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:03.011 DEBUG:teuthology.orchestra.run.smithi204:> stat --file-system '--printf=%T 2024-03-04T08:51:03.011 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:03.026 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2024-03-04T08:51:03.026 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:03.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:03.026 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:03.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:03.092 DEBUG:teuthology.orchestra.run.smithi204:> stat --file-system '--printf=%T 2024-03-04T08:51:03.092 DEBUG:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:03.148 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2024-03-04T08:51:03.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:03.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:03.149 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:03.215 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-04T08:51:03.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:03.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.351+0000 7f22579f7640 1 Processor -- start 2024-03-04T08:51:03.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.351+0000 7f22579f7640 1 -- start start 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22501621c0 0x7f22500cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f22500d4920 0x7f22500d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22500d2bf0 0x7f225015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500cf690 con 0x7f22501621c0 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500ceac0 con 0x7f22500d4920 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f22579f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500ced60 con 0x7f22500d2bf0 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22501621c0 0x7f22500cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22501621c0 0x7f22500cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47616/0 (socket says 172.21.15.19:47616) 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 -- 172.21.15.19:0/2968569047 learned_addr learned my addr 172.21.15.19:0/2968569047 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2254f92640 1 --2- 172.21.15.19:0/2968569047 >> v2:172.21.15.204:3300/0 conn(0x7f22500d4920 0x7f22500d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255f94640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22500d2bf0 0x7f225015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 -- 172.21.15.19:0/2968569047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22500d2bf0 msgr2=0x7f225015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22500d2bf0 0x7f225015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 -- 172.21.15.19:0/2968569047 >> v2:172.21.15.204:3300/0 conn(0x7f22500d4920 msgr2=0x7f22500d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 --2- 172.21.15.19:0/2968569047 >> v2:172.21.15.204:3300/0 conn(0x7f22500d4920 0x7f22500d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.352+0000 7f2255793640 1 -- 172.21.15.19:0/2968569047 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500cf040 con 0x7f22501621c0 2024-03-04T08:51:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.353+0000 7f2255793640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501621c0 0x7f22500cfb20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22500736c0 tx=0x7f224002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a9cbf10e7518e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.353+0000 7f224ffff640 1 -- 172.21.15.19:0/2968569047 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224002ca70 con 0x7f22501621c0 2024-03-04T08:51:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.353+0000 7f224ffff640 1 -- 172.21.15.19:0/2968569047 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224002cc10 con 0x7f22501621c0 2024-03-04T08:51:03.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.353+0000 7f224ffff640 1 -- 172.21.15.19:0/2968569047 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400343f0 con 0x7f22501621c0 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 -- 172.21.15.19:0/2968569047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501621c0 msgr2=0x7f22500cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501621c0 0x7f22500cfb20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22500736c0 tx=0x7f224002bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 -- 172.21.15.19:0/2968569047 shutdown_connections 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22500d2bf0 0x7f225015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 --2- 172.21.15.19:0/2968569047 >> v2:172.21.15.204:3300/0 conn(0x7f22500d4920 0x7f22500d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 --2- 172.21.15.19:0/2968569047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501621c0 0x7f22500cfb20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 -- 172.21.15.19:0/2968569047 >> 172.21.15.19:0/2968569047 conn(0x7f22500d3d10 msgr2=0x7f22500d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 -- 172.21.15.19:0/2968569047 shutdown_connections 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.354+0000 7f22579f7640 1 -- 172.21.15.19:0/2968569047 wait complete. 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.355+0000 7f22579f7640 1 Processor -- start 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.355+0000 7f22579f7640 1 -- start start 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22500d4920 0x7f22501f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22501621c0 0x7f22501f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250162720 con 0x7f22500d2bf0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501625a0 con 0x7f22500d4920 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f22579f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22501628a0 con 0x7f22501621c0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47620/0 (socket says 172.21.15.19:47620) 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 -- 172.21.15.19:0/2516410947 learned_addr learned my addr 172.21.15.19:0/2516410947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255f94640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22501621c0 0x7f22501f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2254f92640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22500d4920 0x7f22501f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 -- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22501621c0 msgr2=0x7f22501f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22501621c0 0x7f22501f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 -- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22500d4920 msgr2=0x7f22501f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22500d4920 0x7f22501f65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.356+0000 7f2255793640 1 -- 172.21.15.19:0/2516410947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22501e8ea0 con 0x7f22500d2bf0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f2255793640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2240000f80 tx=0x7f2240004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240043020 con 0x7f22500d2bf0 2024-03-04T08:51:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224003e450 con 0x7f22500d2bf0 2024-03-04T08:51:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22501e9180 con 0x7f22500d2bf0 2024-03-04T08:51:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240009510 con 0x7f22500d2bf0 2024-03-04T08:51:03.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.357+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250153b60 con 0x7f22500d2bf0 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.358+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225004f330 con 0x7f22500d2bf0 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.359+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2240046020 con 0x7f22500d2bf0 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.359+0000 7f224dffb640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.359+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22400ac7d0 con 0x7f22500d2bf0 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.359+0000 7f2254f92640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.360+0000 7f2254f92640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 0x7f223c06d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22501528f0 tx=0x7f2244009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.364+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f224004d030 con 0x7f22500d2bf0 2024-03-04T08:51:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.551+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2250073380 con 0x7f22500d2bf0 2024-03-04T08:51:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.552+0000 7f224dffb640 1 -- 172.21.15.19:0/2516410947 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f224007b000 con 0x7f22500d2bf0 2024-03-04T08:51:03.549 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:03.549 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 msgr2=0x7f223c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 0x7f223c06d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22501528f0 tx=0x7f2244009190 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 msgr2=0x7f22500ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2240000f80 tx=0x7f2240004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 shutdown_connections 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22501621c0 0x7f22501f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22500d4920 0x7f22501f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 --2- 172.21.15.19:0/2516410947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500d2bf0 0x7f22500ccb00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 >> 172.21.15.19:0/2516410947 conn(0x7f22500d3d10 msgr2=0x7f22500b8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 shutdown_connections 2024-03-04T08:51:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.554+0000 7f22579f7640 1 -- 172.21.15.19:0/2516410947 wait complete. 2024-03-04T08:51:03.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:03.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:03.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.669+0000 7f9bb73d6640 1 Processor -- start 2024-03-04T08:51:03.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.670+0000 7f9bb73d6640 1 -- start start 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.670+0000 7f9bb73d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bb006cab0 0x7f9bb00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.670+0000 7f9bb73d6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb006d030 con 0x7f9bb00cea50 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.670+0000 7f9bb73d6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb006d310 con 0x7f9bb015def0 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.670+0000 7f9bb73d6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb00cf1c0 con 0x7f9bb006cab0 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bb006cab0 0x7f9bb00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bb006cab0 0x7f9bb00b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47632/0 (socket says 172.21.15.19:47632) 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb4971640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9bb00cea50 0x7f9bb00ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42342/0 (socket says 172.21.15.19:42342) 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 -- 172.21.15.19:0/3729488698 learned_addr learned my addr 172.21.15.19:0/3729488698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 -- 172.21.15.19:0/3729488698 >> v1:172.21.15.204:6789/0 conn(0x7f9bb015def0 legacy=0x7f9bb00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 -- 172.21.15.19:0/3729488698 >> v1:172.21.15.19:6789/0 conn(0x7f9bb00cea50 legacy=0x7f9bb00ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9baffff640 1 -- 172.21.15.19:0/3729488698 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773882813 0 0) 0x7f9bb006d030 con 0x7f9bb00cea50 2024-03-04T08:51:03.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.671+0000 7f9bb5973640 1 -- 172.21.15.19:0/3729488698 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00cc110 con 0x7f9bb006cab0 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb5973640 1 --2- 172.21.15.19:0/3729488698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb006cab0 0x7f9bb00b41b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097f0 tx=0x7f9ba802b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc3c24ddd06707b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9baffff640 1 -- 172.21.15.19:0/3729488698 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8031760 con 0x7f9bb006cab0 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9baffff640 1 -- 172.21.15.19:0/3729488698 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8037070 con 0x7f9bb006cab0 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9baffff640 1 -- 172.21.15.19:0/3729488698 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8031b20 con 0x7f9bb006cab0 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 -- 172.21.15.19:0/3729488698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb006cab0 msgr2=0x7f9bb00b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/3729488698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb006cab0 0x7f9bb00b41b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097f0 tx=0x7f9ba802b800 comp rx=0 tx=0).stop 2024-03-04T08:51:03.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 -- 172.21.15.19:0/3729488698 shutdown_connections 2024-03-04T08:51:03.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/3729488698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb006cab0 0x7f9bb00b41b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 -- 172.21.15.19:0/3729488698 >> 172.21.15.19:0/3729488698 conn(0x7f9bb00b3690 msgr2=0x7f9bb00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:03.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 -- 172.21.15.19:0/3729488698 shutdown_connections 2024-03-04T08:51:03.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.672+0000 7f9bb73d6640 1 -- 172.21.15.19:0/3729488698 wait complete. 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.673+0000 7f9bb73d6640 1 Processor -- start 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 -- start start 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9bb006cab0 0x7f9bb00b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9bb015def0 0x7f9bb00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb015e2d0 con 0x7f9bb00cea50 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00cc760 con 0x7f9bb015def0 2024-03-04T08:51:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb73d6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb015e450 con 0x7f9bb006cab0 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb4971640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb4971640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47634/0 (socket says 172.21.15.19:47634) 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb4971640 1 -- 172.21.15.19:0/2020664307 learned_addr learned my addr 172.21.15.19:0/2020664307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb5973640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9bb015def0 0x7f9bb00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.674+0000 7f9bb5172640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9bb006cab0 0x7f9bb00b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 -- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9bb006cab0 msgr2=0x7f9bb00b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9bb006cab0 0x7f9bb00b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 -- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9bb015def0 msgr2=0x7f9bb00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9bb015def0 0x7f9bb00c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 -- 172.21.15.19:0/2020664307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00c8200 con 0x7f9bb00cea50 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb4971640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c530 tx=0x7f9ba400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4018070 con 0x7f9bb00cea50 2024-03-04T08:51:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4007500 con 0x7f9bb00cea50 2024-03-04T08:51:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4004a20 con 0x7f9bb00cea50 2024-03-04T08:51:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb00c61a0 con 0x7f9bb00cea50 2024-03-04T08:51:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.675+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb00c6760 con 0x7f9bb00cea50 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.676+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb009fcf0 con 0x7f9bb00cea50 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.677+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ba401b070 con 0x7f9bb00cea50 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.677+0000 7f9badffb640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 0x7f9b9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.677+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba4089430 con 0x7f9bb00cea50 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.677+0000 7f9bb5172640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 0x7f9b9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.678+0000 7f9bb5172640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 0x7f9b9c06d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00012e0 tx=0x7f9ba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.681+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9bb00c8200 con 0x7f9bb00cea50 2024-03-04T08:51:03.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.862+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bb0068ff0 con 0x7f9bb00cea50 2024-03-04T08:51:03.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.863+0000 7f9badffb640 1 -- 172.21.15.19:0/2020664307 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ba4057c60 con 0x7f9bb00cea50 2024-03-04T08:51:03.859 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:03.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 msgr2=0x7f9b9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 0x7f9b9c06d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00012e0 tx=0x7f9ba0009040 comp rx=0 tx=0).stop 2024-03-04T08:51:03.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 msgr2=0x7f9bb015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c530 tx=0x7f9ba400c9f0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 shutdown_connections 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9b9c06b4d0 0x7f9b9c06d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9bb015def0 0x7f9bb00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb00cea50 0x7f9bb015d080 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 --2- 172.21.15.19:0/2020664307 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9bb006cab0 0x7f9bb00b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 >> 172.21.15.19:0/2020664307 conn(0x7f9bb00b3690 msgr2=0x7f9bb00caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 shutdown_connections 2024-03-04T08:51:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.865+0000 7f9bb73d6640 1 -- 172.21.15.19:0/2020664307 wait complete. 2024-03-04T08:51:03.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.980+0000 7fa0a6da2640 1 Processor -- start 2024-03-04T08:51:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.980+0000 7fa0a6da2640 1 -- start start 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a6da2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 0x7fa0a00d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a6da2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00cec90 con 0x7fa0a00ce640 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a6da2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00cef70 con 0x7fa0a00d0bb0 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a6da2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00cf8a0 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a559f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa0a00ce640 0x7fa0a00d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42350/0 (socket says 172.21.15.19:42350) 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a559f640 1 -- 172.21.15.19:0/273384538 learned_addr learned my addr 172.21.15.19:0/273384538 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a5da0640 1 --2- 172.21.15.19:0/273384538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 0x7fa0a00d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414379096 0 0) 0x7fa0a00cec90 con 0x7fa0a00ce640 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa08c003520 con 0x7fa0a00ce640 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977351961 0 0) 0x7fa0a00cef70 con 0x7fa0a00d0bb0 2024-03-04T08:51:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a00cec90 con 0x7fa0a00d0bb0 2024-03-04T08:51:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a5da0640 1 -- 172.21.15.19:0/273384538 >> v1:172.21.15.204:6789/0 conn(0x7fa0a00d0bb0 legacy=0x7fa0a015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a5da0640 1 -- 172.21.15.19:0/273384538 >> v1:172.21.15.19:6789/0 conn(0x7fa0a00ce640 legacy=0x7fa0a00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.981+0000 7fa0a5da0640 1 -- 172.21.15.19:0/273384538 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00cf250 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.982+0000 7fa0a5da0640 1 --2- 172.21.15.19:0/273384538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 0x7fa0a00d45e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097d0 tx=0x7fa09c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57cc5244ef57167 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.982+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c035020 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.982+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c031890 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.982+0000 7fa0a4d9e640 1 -- 172.21.15.19:0/273384538 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c031c40 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 -- 172.21.15.19:0/273384538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 msgr2=0x7fa0a00d45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/273384538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 0x7fa0a00d45e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0097d0 tx=0x7fa09c02b930 comp rx=0 tx=0).stop 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 -- 172.21.15.19:0/273384538 shutdown_connections 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/273384538 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00b4ef0 0x7fa0a00d45e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 -- 172.21.15.19:0/273384538 >> 172.21.15.19:0/273384538 conn(0x7fa0a00d3ac0 msgr2=0x7fa0a00d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 -- 172.21.15.19:0/273384538 shutdown_connections 2024-03-04T08:51:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.983+0000 7fa0a6da2640 1 -- 172.21.15.19:0/273384538 wait complete. 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.984+0000 7fa0a6da2640 1 Processor -- start 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.984+0000 7fa0a6da2640 1 -- start start 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00ce640 0x7fa0a015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0a00d0bb0 0x7fa0a015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b52d0 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00d1b60 con 0x7fa0a00d0bb0 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a6da2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b7a40 con 0x7fa0a00ce640 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47636/0 (socket says 172.21.15.19:47636) 2024-03-04T08:51:03.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 -- 172.21.15.19:0/3547244294 learned_addr learned my addr 172.21.15.19:0/3547244294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a559f640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00ce640 0x7fa0a015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a65a1640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0a00d0bb0 0x7fa0a015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 -- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00ce640 msgr2=0x7fa0a015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00ce640 0x7fa0a015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 -- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0a00d0bb0 msgr2=0x7fa0a015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0a00d0bb0 0x7fa0a015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.985+0000 7fa0a5da0640 1 -- 172.21.15.19:0/3547244294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a015c980 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0a5da0640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa09c000c00 tx=0x7fa09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c035040 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c030d20 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a015cc60 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c006e10 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.986+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a00ca2a0 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.987+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a0068f10 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.987+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa09c038020 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.988+0000 7fa0967fc640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 0x7fa08406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:03.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.988+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa09c0ac6f0 con 0x7fa0a00b4ef0 2024-03-04T08:51:03.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.988+0000 7fa0a559f640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 0x7fa08406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:03.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.988+0000 7fa0a559f640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 0x7fa08406d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0159a60 tx=0x7fa090007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:03.992+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa09c02d040 con 0x7fa0a00b4ef0 2024-03-04T08:51:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.170+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0a00d1e80 con 0x7fa0a00b4ef0 2024-03-04T08:51:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.171+0000 7fa0967fc640 1 -- 172.21.15.19:0/3547244294 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa09c07af20 con 0x7fa0a00b4ef0 2024-03-04T08:51:04.167 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 msgr2=0x7fa08406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 0x7fa08406d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0159a60 tx=0x7fa090007d70 comp rx=0 tx=0).stop 2024-03-04T08:51:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 msgr2=0x7fa0a00c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa09c000c00 tx=0x7fa09c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 shutdown_connections 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa08406b4d0 0x7fa08406d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0a00d0bb0 0x7fa0a015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0a00ce640 0x7fa0a015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 --2- 172.21.15.19:0/3547244294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0a00b4ef0 0x7fa0a00c9d60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 >> 172.21.15.19:0/3547244294 conn(0x7fa0a00d3ac0 msgr2=0x7fa0a00b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 shutdown_connections 2024-03-04T08:51:04.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.173+0000 7fa0a6da2640 1 -- 172.21.15.19:0/3547244294 wait complete. 2024-03-04T08:51:04.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.288+0000 7f56dbc15640 1 Processor -- start 2024-03-04T08:51:04.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.288+0000 7f56dbc15640 1 -- start start 2024-03-04T08:51:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56dbc15640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56dbc15640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56d406cab0 0x7f56d40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56dbc15640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d406d030 con 0x7f56d40ce880 2024-03-04T08:51:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56dbc15640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40cecf0 con 0x7f56d406cab0 2024-03-04T08:51:04.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56dbc15640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cf1c0 con 0x7f56d415def0 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56d406cab0 0x7f56d40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d99b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f56d406cab0 0x7f56d40ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:36612/0 (socket says 172.21.15.19:36612) 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56da1b2640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f56d40ce880 0x7f56d40cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:54606/0 (socket says 172.21.15.19:54606) 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 -- 172.21.15.19:0/2137197586 learned_addr learned my addr 172.21.15.19:0/2137197586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d99b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:58780/0 (socket says 172.21.15.19:58780) 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 -- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 msgr2=0x7f56d40b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 -- 172.21.15.19:0/2137197586 >> v1:172.21.15.204:6789/0 conn(0x7f56d40ce880 legacy=0x7f56d40cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d91b0640 1 -- 172.21.15.19:0/2137197586 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d406d310 con 0x7f56d406cab0 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d99b1640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:04.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.289+0000 7f56d89af640 1 -- 172.21.15.19:0/2137197586 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827175611 0 0) 0x7f56d406d030 con 0x7f56d40ce880 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56d91b0640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d406cab0 0x7f56d40ce340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009870 tx=0x7f56c402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae8a376d2e8966f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56d89af640 1 -- 172.21.15.19:0/2137197586 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c402f840 con 0x7f56d406cab0 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56d89af640 1 -- 172.21.15.19:0/2137197586 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c402f9e0 con 0x7f56d406cab0 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56d89af640 1 -- 172.21.15.19:0/2137197586 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c402fdb0 con 0x7f56d406cab0 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56dbc15640 1 -- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d406cab0 msgr2=0x7f56d40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.290+0000 7f56dbc15640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d406cab0 0x7f56d40ce340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009870 tx=0x7f56c402ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 -- 172.21.15.19:0/2137197586 shutdown_connections 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d406cab0 0x7f56d40ce340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 --2- 172.21.15.19:0/2137197586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d415def0 0x7f56d40b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 -- 172.21.15.19:0/2137197586 >> 172.21.15.19:0/2137197586 conn(0x7f56d40b3690 msgr2=0x7f56d40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 -- 172.21.15.19:0/2137197586 shutdown_connections 2024-03-04T08:51:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.291+0000 7f56dbc15640 1 -- 172.21.15.19:0/2137197586 wait complete. 2024-03-04T08:51:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 Processor -- start 2024-03-04T08:51:04.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 -- start start 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 0x7f56d4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d40ce880 0x7f56d415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cc3f0 con 0x7f56d415def0 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cc760 con 0x7f56d40ce880 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.292+0000 7f56dbc15640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d415e2d0 con 0x7f56d406cab0 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56d99b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 0x7f56d4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47652/0 (socket says 172.21.15.19:47652) 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56d91b0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d40ce880 0x7f56d415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56d99b1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 0x7f56d4157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:58784/0 (socket says 172.21.15.19:58784) 2024-03-04T08:51:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 -- 172.21.15.19:0/17016697 learned_addr learned my addr 172.21.15.19:0/17016697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 -- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 msgr2=0x7f56d4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 0x7f56d4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 -- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d40ce880 msgr2=0x7f56d415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d40ce880 0x7f56d415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 -- 172.21.15.19:0/17016697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40c5d30 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56da1b2640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c7a0 tx=0x7f56cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc018070 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00a640 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40c6010 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00aab0 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.293+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4159ce0 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.294+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d409fcf0 con 0x7f56d415def0 2024-03-04T08:51:04.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.295+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56cc01b070 con 0x7f56d415def0 2024-03-04T08:51:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.295+0000 7f56ca7fc640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 0x7f56b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.295+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56cc089790 con 0x7f56d415def0 2024-03-04T08:51:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.295+0000 7f56d99b1640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 0x7f56b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.296+0000 7f56d99b1640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 0x7f56b806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009560 tx=0x7f56d0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.299+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f56cc057fc0 con 0x7f56d415def0 2024-03-04T08:51:04.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.479+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56d4068ff0 con 0x7f56d415def0 2024-03-04T08:51:04.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.480+0000 7f56ca7fc640 1 -- 172.21.15.19:0/17016697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56cc05c060 con 0x7f56d415def0 2024-03-04T08:51:04.476 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:04.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 msgr2=0x7f56b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 0x7f56b806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009560 tx=0x7f56d0009190 comp rx=0 tx=0).stop 2024-03-04T08:51:04.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 msgr2=0x7f56d415eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00c7a0 tx=0x7f56cc00cc60 comp rx=0 tx=0).stop 2024-03-04T08:51:04.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 shutdown_connections 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56d415def0 0x7f56d415eec0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f56b806b4d0 0x7f56b806d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56d40ce880 0x7f56d415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.481+0000 7f56dbc15640 1 --2- 172.21.15.19:0/17016697 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56d406cab0 0x7f56d4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.482+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 >> 172.21.15.19:0/17016697 conn(0x7f56d40b3690 msgr2=0x7f56d415e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.482+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 shutdown_connections 2024-03-04T08:51:04.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.482+0000 7f56dbc15640 1 -- 172.21.15.19:0/17016697 wait complete. 2024-03-04T08:51:04.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:04.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.593+0000 7fbb9b9d7640 1 Processor -- start 2024-03-04T08:51:04.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.593+0000 7fbb9b9d7640 1 -- start start 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4170 0x7fbb940b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb940d4760 0x7fbb940d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbb940b4dd0 0x7fbb940d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940d4bf0 con 0x7fbb940d4760 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940ce9e0 con 0x7fbb940b4dd0 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb9b9d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940d25d0 con 0x7fbb940b4170 2024-03-04T08:51:04.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb98f72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb940d4760 0x7fbb940d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb98f72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb940d4760 0x7fbb940d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47664/0 (socket says 172.21.15.19:47664) 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb98f72640 1 -- 172.21.15.19:0/2235020520 learned_addr learned my addr 172.21.15.19:0/2235020520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb99773640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4170 0x7fbb940b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.594+0000 7fbb99f74640 1 --2- 172.21.15.19:0/2235020520 >> v2:172.21.15.204:3300/0 conn(0x7fbb940b4dd0 0x7fbb940d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 -- 172.21.15.19:0/2235020520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4170 msgr2=0x7fbb940b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 --2- 172.21.15.19:0/2235020520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4170 0x7fbb940b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 -- 172.21.15.19:0/2235020520 >> v2:172.21.15.204:3300/0 conn(0x7fbb940b4dd0 msgr2=0x7fbb940d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 --2- 172.21.15.19:0/2235020520 >> v2:172.21.15.204:3300/0 conn(0x7fbb940b4dd0 0x7fbb940d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 -- 172.21.15.19:0/2235020520 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940d2870 con 0x7fbb940d4760 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.595+0000 7fbb98f72640 1 --2- 172.21.15.19:0/2235020520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d4760 0x7fbb940d0370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb940cffb0 tx=0x7fbb8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f948eab460b4be server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb8bfff640 1 -- 172.21.15.19:0/2235020520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84035020 con 0x7fbb940d4760 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb8bfff640 1 -- 172.21.15.19:0/2235020520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84031870 con 0x7fbb940d4760 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb8bfff640 1 -- 172.21.15.19:0/2235020520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84031c40 con 0x7fbb940d4760 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2235020520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d4760 msgr2=0x7fbb940d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2235020520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d4760 0x7fbb940d0370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb940cffb0 tx=0x7fbb8402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2235020520 shutdown_connections 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2235020520 >> v2:172.21.15.204:3300/0 conn(0x7fbb940b4dd0 0x7fbb940d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2235020520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d4760 0x7fbb940d0370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2235020520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4170 0x7fbb940b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2235020520 >> 172.21.15.19:0/2235020520 conn(0x7fbb940d3c40 msgr2=0x7fbb940d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2235020520 shutdown_connections 2024-03-04T08:51:04.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.596+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2235020520 wait complete. 2024-03-04T08:51:04.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.597+0000 7fbb9b9d7640 1 Processor -- start 2024-03-04T08:51:04.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.597+0000 7fbb9b9d7640 1 -- start start 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940b4170 0x7fbb9415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4dd0 0x7fbb940c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b47d0 con 0x7fbb940c8d80 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b4550 con 0x7fbb940b4170 2024-03-04T08:51:04.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb9b9d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b4950 con 0x7fbb940b4dd0 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47672/0 (socket says 172.21.15.19:47672) 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 -- 172.21.15.19:0/2165525403 learned_addr learned my addr 172.21.15.19:0/2165525403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99773640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940b4170 0x7fbb9415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb98f72640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4dd0 0x7fbb940c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 -- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4dd0 msgr2=0x7fbb940c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4dd0 0x7fbb940c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 -- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940b4170 msgr2=0x7fbb9415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940b4170 0x7fbb9415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.598+0000 7fbb99f74640 1 -- 172.21.15.19:0/2165525403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940c7740 con 0x7fbb940c8d80 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb99f74640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000efc0 tx=0x7fbb9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90018020 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90014480 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940c79e0 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90014870 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.599+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9415eb50 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.600+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9404f330 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.601+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb90005d10 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.601+0000 7fbb89ffb640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 0x7fbb7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.601+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb9008aac0 con 0x7fbb940c8d80 2024-03-04T08:51:04.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.601+0000 7fbb99773640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 0x7fbb7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.602+0000 7fbb99773640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 0x7fbb7806d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb940ccb80 tx=0x7fbb8c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.605+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb90022070 con 0x7fbb940c8d80 2024-03-04T08:51:04.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.786+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb940733b0 con 0x7fbb940c8d80 2024-03-04T08:51:04.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.787+0000 7fbb89ffb640 1 -- 172.21.15.19:0/2165525403 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fbb90010040 con 0x7fbb940c8d80 2024-03-04T08:51:04.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:04.784 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 msgr2=0x7fbb7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 0x7fbb7806d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb940ccb80 tx=0x7fbb8c009190 comp rx=0 tx=0).stop 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 msgr2=0x7fbb940ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000efc0 tx=0x7fbb9000c490 comp rx=0 tx=0).stop 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 shutdown_connections 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940c8d80 0x7fbb940ccbf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940b4dd0 0x7fbb940c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b500 0x7fbb7806d9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 --2- 172.21.15.19:0/2165525403 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940b4170 0x7fbb9415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 >> 172.21.15.19:0/2165525403 conn(0x7fbb940d3c40 msgr2=0x7fbb940b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 shutdown_connections 2024-03-04T08:51:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.789+0000 7fbb9b9d7640 1 -- 172.21.15.19:0/2165525403 wait complete. 2024-03-04T08:51:04.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:04.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.905+0000 7f9c4d54b640 1 Processor -- start 2024-03-04T08:51:04.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.905+0000 7f9c4d54b640 1 -- start start 2024-03-04T08:51:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c4d54b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815bb40 0x7f9c480b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c4d54b640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c4815f7d0 0x7f9c4806d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c4d54b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4815ff90 con 0x7f9c4806d5c0 2024-03-04T08:51:04.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c4d54b640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4806c910 con 0x7f9c4815f7d0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c4d54b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48160270 con 0x7f9c4815bb40 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c477fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9c4806d5c0 0x7f9c480cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42364/0 (socket says 172.21.15.19:42364) 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c477fe640 1 -- 172.21.15.19:0/3504112512 learned_addr learned my addr 172.21.15.19:0/3504112512 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815bb40 0x7f9c480b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c467fc640 1 --2- 172.21.15.19:0/3504112512 >> v2:172.21.15.204:3300/0 conn(0x7f9c4815f7d0 0x7f9c4806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c45ffb640 1 -- 172.21.15.19:0/3504112512 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728738789 0 0) 0x7f9c4815ff90 con 0x7f9c4806d5c0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c45ffb640 1 -- 172.21.15.19:0/3504112512 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c30003520 con 0x7f9c4806d5c0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c467fc640 1 -- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815bb40 msgr2=0x7f9c480b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c467fc640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815bb40 0x7f9c480b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c467fc640 1 -- 172.21.15.19:0/3504112512 >> v1:172.21.15.19:6789/0 conn(0x7f9c4806d5c0 legacy=0x7f9c480cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.906+0000 7f9c467fc640 1 -- 172.21.15.19:0/3504112512 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48160550 con 0x7f9c4815f7d0 2024-03-04T08:51:04.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.907+0000 7f9c467fc640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4815f7d0 0x7f9c4806d080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097a0 tx=0x7f9c3c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4b7608333684923 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.907+0000 7f9c45ffb640 1 -- 172.21.15.19:0/3504112512 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c035020 con 0x7f9c4815f7d0 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.907+0000 7f9c45ffb640 1 -- 172.21.15.19:0/3504112512 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c031830 con 0x7f9c4815f7d0 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.907+0000 7f9c45ffb640 1 -- 172.21.15.19:0/3504112512 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c031be0 con 0x7f9c4815f7d0 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 -- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4815f7d0 msgr2=0x7f9c4806d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4815f7d0 0x7f9c4806d080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097a0 tx=0x7f9c3c02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 -- 172.21.15.19:0/3504112512 shutdown_connections 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4815f7d0 0x7f9c4806d080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/3504112512 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815bb40 0x7f9c480b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 -- 172.21.15.19:0/3504112512 >> 172.21.15.19:0/3504112512 conn(0x7f9c4806b190 msgr2=0x7f9c4806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 -- 172.21.15.19:0/3504112512 shutdown_connections 2024-03-04T08:51:04.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.908+0000 7f9c4d54b640 1 -- 172.21.15.19:0/3504112512 wait complete. 2024-03-04T08:51:04.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.909+0000 7f9c4d54b640 1 Processor -- start 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.909+0000 7f9c4d54b640 1 -- start start 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 0x7f9c4814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815f7d0 0x7f9c481f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4815bf20 con 0x7f9c4815bb40 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4815fc30 con 0x7f9c4806d5c0 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c4d54b640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4815c0a0 con 0x7f9c4815f7d0 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 0x7f9c4814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47680/0 (socket says 172.21.15.19:47680) 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c467fc640 1 -- 172.21.15.19:0/1006284466 learned_addr learned my addr 172.21.15.19:0/1006284466 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:04.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c477fe640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815f7d0 0x7f9c481f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 -- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815f7d0 msgr2=0x7f9c481f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815f7d0 0x7f9c481f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 -- 172.21.15.19:0/1006284466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 msgr2=0x7f9c481f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 -- 172.21.15.19:0/1006284466 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c481f2070 con 0x7f9c4806d5c0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c467fc640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.910+0000 7f9c46ffd640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 0x7f9c4814b610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800e870 tx=0x7f9c3800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.911+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38017070 con 0x7f9c4806d5c0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.911+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800c940 con 0x7f9c4806d5c0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.911+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c481f2350 con 0x7f9c4806d5c0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.911+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800cd10 con 0x7f9c4806d5c0 2024-03-04T08:51:04.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.911+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c480af580 con 0x7f9c4806d5c0 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.912+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c480732b0 con 0x7f9c4806d5c0 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.912+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c3801a070 con 0x7f9c4806d5c0 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.912+0000 7f9c2f7fe640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 0x7f9c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.912+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c3808a220 con 0x7f9c4806d5c0 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.913+0000 7f9c467fc640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 0x7f9c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:04.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.913+0000 7f9c467fc640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 0x7f9c3406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097a0 tx=0x7f9c3c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:04.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:04.921+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9c380589b0 con 0x7f9c4806d5c0 2024-03-04T08:51:05.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.101+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c48068ff0 con 0x7f9c4806d5c0 2024-03-04T08:51:05.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.101+0000 7f9c2f7fe640 1 -- 172.21.15.19:0/1006284466 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c3805ca50 con 0x7f9c4806d5c0 2024-03-04T08:51:05.098 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:05.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.103+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 msgr2=0x7f9c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.103+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 0x7f9c3406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097a0 tx=0x7f9c3c03c040 comp rx=0 tx=0).stop 2024-03-04T08:51:05.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 msgr2=0x7f9c4814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 0x7f9c4814b610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800e870 tx=0x7f9c3800ed30 comp rx=0 tx=0).stop 2024-03-04T08:51:05.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 shutdown_connections 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c4815f7d0 0x7f9c481f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c4815bb40 0x7f9c481f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c3406b4d0 0x7f9c3406d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 --2- 172.21.15.19:0/1006284466 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c4806d5c0 0x7f9c4814b610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 >> 172.21.15.19:0/1006284466 conn(0x7f9c4806b190 msgr2=0x7f9c48154950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 shutdown_connections 2024-03-04T08:51:05.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.104+0000 7f9c4d54b640 1 -- 172.21.15.19:0/1006284466 wait complete. 2024-03-04T08:51:05.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:05.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.218+0000 7f29c3365640 1 Processor -- start 2024-03-04T08:51:05.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 -- start start 2024-03-04T08:51:05.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f29bc15c050 0x7f29bc06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0d0af0 0x7f29bc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0cd4b0 con 0x7f29bc06fb40 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc06ffb0 con 0x7f29bc15c050 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.219+0000 7f29c3365640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0cd790 con 0x7f29bc0d0af0 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c0900640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f29bc06fb40 0x7f29bc0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42366/0 (socket says 172.21.15.19:42366) 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c0900640 1 -- 172.21.15.19:0/446137112 learned_addr learned my addr 172.21.15.19:0/446137112 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1101640 1 --2- 172.21.15.19:0/446137112 >> v2:172.21.15.204:3300/0 conn(0x7f29bc15c050 0x7f29bc06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1902640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0d0af0 0x7f29bc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29b3fff640 1 -- 172.21.15.19:0/446137112 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244345796 0 0) 0x7f29bc0cd4b0 con 0x7f29bc06fb40 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29b3fff640 1 -- 172.21.15.19:0/446137112 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a8003520 con 0x7f29bc06fb40 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1101640 1 -- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0d0af0 msgr2=0x7f29bc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1101640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0d0af0 0x7f29bc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1101640 1 -- 172.21.15.19:0/446137112 >> v1:172.21.15.19:6789/0 conn(0x7f29bc06fb40 legacy=0x7f29bc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.220+0000 7f29c1101640 1 -- 172.21.15.19:0/446137112 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0cda70 con 0x7f29bc15c050 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c1101640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc15c050 0x7f29bc06f600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097a0 tx=0x7f29b802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7863e005e88355e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29b3fff640 1 -- 172.21.15.19:0/446137112 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80315a0 con 0x7f29bc15c050 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29b3fff640 1 -- 172.21.15.19:0/446137112 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b8037070 con 0x7f29bc15c050 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29b3fff640 1 -- 172.21.15.19:0/446137112 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8031960 con 0x7f29bc15c050 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 -- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc15c050 msgr2=0x7f29bc06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc15c050 0x7f29bc06f600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097a0 tx=0x7f29b802b840 comp rx=0 tx=0).stop 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 -- 172.21.15.19:0/446137112 shutdown_connections 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc0d0af0 0x7f29bc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 --2- 172.21.15.19:0/446137112 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc15c050 0x7f29bc06f600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.221+0000 7f29c3365640 1 -- 172.21.15.19:0/446137112 >> 172.21.15.19:0/446137112 conn(0x7f29bc0b3800 msgr2=0x7f29bc0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.222+0000 7f29c3365640 1 -- 172.21.15.19:0/446137112 shutdown_connections 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.222+0000 7f29c3365640 1 -- 172.21.15.19:0/446137112 wait complete. 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 Processor -- start 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 -- start start 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc06fb40 0x7f29bc14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 0x7f29bc14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc165c30 con 0x7f29bc15c050 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc165ab0 con 0x7f29bc0d0af0 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c3365640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc165db0 con 0x7f29bc06fb40 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.223+0000 7f29c1902640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47686/0 (socket says 172.21.15.19:47686) 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c0900640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 0x7f29bc14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 -- 172.21.15.19:0/3125606030 learned_addr learned my addr 172.21.15.19:0/3125606030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1101640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc06fb40 0x7f29bc14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 -- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc06fb40 msgr2=0x7f29bc14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc06fb40 0x7f29bc14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 -- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 msgr2=0x7f29bc14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 0x7f29bc14f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 -- 172.21.15.19:0/3125606030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc14de10 con 0x7f29bc15c050 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c0900640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 0x7f29bc14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c1902640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29b400efc0 tx=0x7f29b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4018020 con 0x7f29bc15c050 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4014480 con 0x7f29bc15c050 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc14e100 con 0x7f29bc15c050 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4009e60 con 0x7f29bc15c050 2024-03-04T08:51:05.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.224+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc14e6c0 con 0x7f29bc15c050 2024-03-04T08:51:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.225+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc155ce0 con 0x7f29bc15c050 2024-03-04T08:51:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.226+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29b4005d10 con 0x7f29bc15c050 2024-03-04T08:51:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.226+0000 7f29b1ffb640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 0x7f29a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.226+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29b408ae50 con 0x7f29bc15c050 2024-03-04T08:51:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.226+0000 7f29c1101640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 0x7f29a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.227+0000 7f29c1101640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 0x7f29a006d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29b8036000 tx=0x7f29b803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.230+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f29bc155ce0 con 0x7f29bc15c050 2024-03-04T08:51:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.410+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29bc068ff0 con 0x7f29bc15c050 2024-03-04T08:51:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.410+0000 7f29b1ffb640 1 -- 172.21.15.19:0/3125606030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29b4022030 con 0x7f29bc15c050 2024-03-04T08:51:05.407 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:05.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 msgr2=0x7f29a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 0x7f29a006d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29b8036000 tx=0x7f29b803d040 comp rx=0 tx=0).stop 2024-03-04T08:51:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 msgr2=0x7f29bc0cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29b400efc0 tx=0x7f29b400c490 comp rx=0 tx=0).stop 2024-03-04T08:51:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 shutdown_connections 2024-03-04T08:51:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29bc15c050 0x7f29bc0cae80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29a006b4d0 0x7f29a006d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f29bc0d0af0 0x7f29bc14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 --2- 172.21.15.19:0/3125606030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f29bc06fb40 0x7f29bc14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 >> 172.21.15.19:0/3125606030 conn(0x7f29bc0b3800 msgr2=0x7f29bc158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 shutdown_connections 2024-03-04T08:51:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.413+0000 7f29c3365640 1 -- 172.21.15.19:0/3125606030 wait complete. 2024-03-04T08:51:05.464 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:05.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.572+0000 7effca417640 1 Processor -- start 2024-03-04T08:51:05.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.572+0000 7effca417640 1 -- start start 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7effc415bb40 0x7effc40b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415f7d0 0x7effc406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc406d5c0 0x7effc40cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc406c910 con 0x7effc406d5c0 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc415ff90 con 0x7effc415bb40 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effca417640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4160270 con 0x7effc415f7d0 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effc89b4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc406d5c0 0x7effc40cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effc89b4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc406d5c0 0x7effc40cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47688/0 (socket says 172.21.15.19:47688) 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effc89b4640 1 -- 172.21.15.19:0/1337203302 learned_addr learned my addr 172.21.15.19:0/1337203302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.573+0000 7effc37fe640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415f7d0 0x7effc406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc3fff640 1 --2- 172.21.15.19:0/1337203302 >> v2:172.21.15.204:3300/0 conn(0x7effc415bb40 0x7effc40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 -- 172.21.15.19:0/1337203302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415f7d0 msgr2=0x7effc406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415f7d0 0x7effc406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 -- 172.21.15.19:0/1337203302 >> v2:172.21.15.204:3300/0 conn(0x7effc415bb40 msgr2=0x7effc40b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 --2- 172.21.15.19:0/1337203302 >> v2:172.21.15.204:3300/0 conn(0x7effc415bb40 0x7effc40b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 -- 172.21.15.19:0/1337203302 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4160550 con 0x7effc406d5c0 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.574+0000 7effc89b4640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc406d5c0 0x7effc40cfa90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effc40b4f60 tx=0x7effbc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3630e8acb16be80 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effc2ffd640 1 -- 172.21.15.19:0/1337203302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc02ca70 con 0x7effc406d5c0 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effc2ffd640 1 -- 172.21.15.19:0/1337203302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc02cc10 con 0x7effc406d5c0 2024-03-04T08:51:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effc2ffd640 1 -- 172.21.15.19:0/1337203302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0343f0 con 0x7effc406d5c0 2024-03-04T08:51:05.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 -- 172.21.15.19:0/1337203302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc406d5c0 msgr2=0x7effc40cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc406d5c0 0x7effc40cfa90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effc40b4f60 tx=0x7effbc02bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 -- 172.21.15.19:0/1337203302 shutdown_connections 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc406d5c0 0x7effc40cfa90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 --2- 172.21.15.19:0/1337203302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415f7d0 0x7effc406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 --2- 172.21.15.19:0/1337203302 >> v2:172.21.15.204:3300/0 conn(0x7effc415bb40 0x7effc40b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 -- 172.21.15.19:0/1337203302 >> 172.21.15.19:0/1337203302 conn(0x7effc406b190 msgr2=0x7effc406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 -- 172.21.15.19:0/1337203302 shutdown_connections 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.575+0000 7effca417640 1 -- 172.21.15.19:0/1337203302 wait complete. 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.576+0000 7effca417640 1 Processor -- start 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.576+0000 7effca417640 1 -- start start 2024-03-04T08:51:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effc406d5c0 0x7effc414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415bb40 0x7effc4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc415bf20 con 0x7effc415f7d0 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc415fc30 con 0x7effc406d5c0 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effca417640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc415c0a0 con 0x7effc415bb40 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effc89b4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effc89b4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47698/0 (socket says 172.21.15.19:47698) 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effc89b4640 1 -- 172.21.15.19:0/3395507414 learned_addr learned my addr 172.21.15.19:0/3395507414 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effc3fff640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effc406d5c0 0x7effc414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.577+0000 7effc37fe640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415bb40 0x7effc4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 -- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415bb40 msgr2=0x7effc4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415bb40 0x7effc4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 -- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effc406d5c0 msgr2=0x7effc414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effc406d5c0 0x7effc414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 -- 172.21.15.19:0/3395507414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4151da0 con 0x7effc415f7d0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc89b4640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7effbc036040 tx=0x7effbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc043020 con 0x7effc415f7d0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc03e450 con 0x7effc415f7d0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4152040 con 0x7effc415f7d0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc009510 con 0x7effc415f7d0 2024-03-04T08:51:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.578+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc4152600 con 0x7effc415f7d0 2024-03-04T08:51:05.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.579+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc40732b0 con 0x7effc415f7d0 2024-03-04T08:51:05.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.579+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effbc046020 con 0x7effc415f7d0 2024-03-04T08:51:05.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.580+0000 7effc0ff9640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 0x7effb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.580+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effbc0ac7c0 con 0x7effc415f7d0 2024-03-04T08:51:05.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.580+0000 7effc3fff640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 0x7effb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.580+0000 7effc3fff640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 0x7effb006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb4009aa0 tx=0x7effb4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.584+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7effbc04d030 con 0x7effc415f7d0 2024-03-04T08:51:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.763+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effc406e130 con 0x7effc415f7d0 2024-03-04T08:51:05.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.763+0000 7effc0ff9640 1 -- 172.21.15.19:0/3395507414 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7effbc07b110 con 0x7effc415f7d0 2024-03-04T08:51:05.760 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 msgr2=0x7effb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 0x7effb006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb4009aa0 tx=0x7effb4009190 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 msgr2=0x7effc4157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7effbc036040 tx=0x7effbc004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 shutdown_connections 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc415f7d0 0x7effc4157140 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effc415bb40 0x7effc4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effb006b4d0 0x7effb006d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 --2- 172.21.15.19:0/3395507414 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effc406d5c0 0x7effc414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 >> 172.21.15.19:0/3395507414 conn(0x7effc406b190 msgr2=0x7effc4159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 shutdown_connections 2024-03-04T08:51:05.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.765+0000 7effca417640 1 -- 172.21.15.19:0/3395507414 wait complete. 2024-03-04T08:51:05.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:05.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.878+0000 7f981495c640 1 Processor -- start 2024-03-04T08:51:05.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.878+0000 7f981495c640 1 -- start start 2024-03-04T08:51:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f981495c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98100d4920 0x7f98100cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f981495c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98101625a0 0x7f981015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f981495c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100ceac0 con 0x7f98101621c0 2024-03-04T08:51:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f981495c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100cf690 con 0x7f98100d4920 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f981495c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100d2dc0 con 0x7f98101625a0 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98100d4920 0x7f98100cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98100d4920 0x7f98100cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47714/0 (socket says 172.21.15.19:47714) 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 -- 172.21.15.19:0/3107651223 learned_addr learned my addr 172.21.15.19:0/3107651223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f980ed9d640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98101625a0 0x7f981015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 -- 172.21.15.19:0/3107651223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98101625a0 msgr2=0x7f981015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98101625a0 0x7f981015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 -- 172.21.15.19:0/3107651223 >> v1:172.21.15.204:6789/0 conn(0x7f98101621c0 legacy=0x7f98100d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.879+0000 7f9807fff640 1 -- 172.21.15.19:0/3107651223 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100ced60 con 0x7f98100d4920 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f9807fff640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98100d4920 0x7f98100cfb20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009870 tx=0x7f97f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b8f5d11542640b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f980dd9b640 1 -- 172.21.15.19:0/3107651223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8034070 con 0x7f98100d4920 2024-03-04T08:51:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f980dd9b640 1 -- 172.21.15.19:0/3107651223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8030840 con 0x7f98100d4920 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f980dd9b640 1 -- 172.21.15.19:0/3107651223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8030c10 con 0x7f98100d4920 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 -- 172.21.15.19:0/3107651223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98100d4920 msgr2=0x7f98100cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98100d4920 0x7f98100cfb20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009870 tx=0x7f97f802b980 comp rx=0 tx=0).stop 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 -- 172.21.15.19:0/3107651223 shutdown_connections 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98101625a0 0x7f981015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 --2- 172.21.15.19:0/3107651223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98100d4920 0x7f98100cfb20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 -- 172.21.15.19:0/3107651223 >> 172.21.15.19:0/3107651223 conn(0x7f98100d3d10 msgr2=0x7f98100d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.880+0000 7f981495c640 1 -- 172.21.15.19:0/3107651223 shutdown_connections 2024-03-04T08:51:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.881+0000 7f981495c640 1 -- 172.21.15.19:0/3107651223 wait complete. 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.882+0000 7f981495c640 1 Processor -- start 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.882+0000 7f981495c640 1 -- start start 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.882+0000 7f981495c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98100d4920 0x7f98100b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98101621c0 0x7f981014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015e280 con 0x7f98101625a0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100cf320 con 0x7f98101621c0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981015e400 con 0x7f98100d4920 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47716/0 (socket says 172.21.15.19:47716) 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 -- 172.21.15.19:0/768558826 learned_addr learned my addr 172.21.15.19:0/768558826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980e59c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98100d4920 0x7f98100b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f9807fff640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98101621c0 0x7f981014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 -- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98100d4920 msgr2=0x7f98100b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98100d4920 0x7f98100b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 -- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98101621c0 msgr2=0x7f981014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98101621c0 0x7f981014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 -- 172.21.15.19:0/768558826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98101f3a60 con 0x7f98101625a0 2024-03-04T08:51:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f980ed9d640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9808009d30 tx=0x7f980800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808018020 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808014480 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98100cc440 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808014870 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.883+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101e7cc0 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.884+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981004f330 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.885+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9808005d10 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.885+0000 7f9806ffd640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 0x7f97f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.885+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980808aaf0 con 0x7f98101625a0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.885+0000 7f980e59c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 0x7f97f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.886+0000 7f980e59c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 0x7f97f006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9800001780 tx=0x7f9800009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:05.890+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9808022070 con 0x7f98101625a0 2024-03-04T08:51:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.073+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9810073380 con 0x7f98101625a0 2024-03-04T08:51:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.074+0000 7f9806ffd640 1 -- 172.21.15.19:0/768558826 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f9808010040 con 0x7f98101625a0 2024-03-04T08:51:06.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:06.070 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 msgr2=0x7f97f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 0x7f97f006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9800001780 tx=0x7f9800009040 comp rx=0 tx=0).stop 2024-03-04T08:51:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 msgr2=0x7f98100ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9808009d30 tx=0x7f980800c490 comp rx=0 tx=0).stop 2024-03-04T08:51:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 shutdown_connections 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98101625a0 0x7f98100ccd80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f97f006b4d0 0x7f97f006d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98101621c0 0x7f981014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 --2- 172.21.15.19:0/768558826 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98100d4920 0x7f98100b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 >> 172.21.15.19:0/768558826 conn(0x7f98100d3d10 msgr2=0x7f981015bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 shutdown_connections 2024-03-04T08:51:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.076+0000 7f981495c640 1 -- 172.21.15.19:0/768558826 wait complete. 2024-03-04T08:51:06.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:06.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.192+0000 7f812757a640 1 Processor -- start 2024-03-04T08:51:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.192+0000 7f812757a640 1 -- start start 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f812757a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f81200b1e40 0x7f8120168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f812757a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200d2730 con 0x7f81201614d0 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f812757a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81201618b0 con 0x7f81200d4860 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f812757a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200d4cf0 con 0x7f81200b1e40 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f81200b1e40 0x7f8120168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f81200b1e40 0x7f8120168b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47732/0 (socket says 172.21.15.19:47732) 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125316640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f81201614d0 0x7f81200d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42374/0 (socket says 172.21.15.19:42374) 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 -- 172.21.15.19:0/151962297 learned_addr learned my addr 172.21.15.19:0/151962297 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 -- 172.21.15.19:0/151962297 >> v1:172.21.15.204:6789/0 conn(0x7f81200d4860 legacy=0x7f81200d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 -- 172.21.15.19:0/151962297 >> v1:172.21.15.19:6789/0 conn(0x7f81201614d0 legacy=0x7f81200d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8125b17640 1 -- 172.21.15.19:0/151962297 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200cf400 con 0x7f81200b1e40 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.193+0000 7f8117fff640 1 -- 172.21.15.19:0/151962297 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545881706 0 0) 0x7f81200d2730 con 0x7f81201614d0 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.194+0000 7f8125b17640 1 --2- 172.21.15.19:0/151962297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81200b1e40 0x7f8120168b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81200cf5d0 tx=0x7f811802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9b14cc3679bb1e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.194+0000 7f8117fff640 1 -- 172.21.15.19:0/151962297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811802caf0 con 0x7f81200b1e40 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.194+0000 7f8117fff640 1 -- 172.21.15.19:0/151962297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811802cc90 con 0x7f81200b1e40 2024-03-04T08:51:06.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.194+0000 7f8117fff640 1 -- 172.21.15.19:0/151962297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118034610 con 0x7f81200b1e40 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 -- 172.21.15.19:0/151962297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81200b1e40 msgr2=0x7f8120168b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 --2- 172.21.15.19:0/151962297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81200b1e40 0x7f8120168b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81200cf5d0 tx=0x7f811802bf50 comp rx=0 tx=0).stop 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 -- 172.21.15.19:0/151962297 shutdown_connections 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 --2- 172.21.15.19:0/151962297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81200b1e40 0x7f8120168b60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 -- 172.21.15.19:0/151962297 >> 172.21.15.19:0/151962297 conn(0x7f81200d3d40 msgr2=0x7f81200d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 -- 172.21.15.19:0/151962297 shutdown_connections 2024-03-04T08:51:06.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.195+0000 7f812757a640 1 -- 172.21.15.19:0/151962297 wait complete. 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.196+0000 7f812757a640 1 Processor -- start 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.196+0000 7f812757a640 1 -- start start 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.196+0000 7f812757a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81200b1e40 0x7f8120150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81200d4860 0x7f81200cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200cfc60 con 0x7f81201614d0 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200cf980 con 0x7f81200d4860 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b0910 con 0x7f81200b1e40 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47744/0 (socket says 172.21.15.19:47744) 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 -- 172.21.15.19:0/4026471039 learned_addr learned my addr 172.21.15.19:0/4026471039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8124b15640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81200d4860 0x7f81200cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125316640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81200b1e40 0x7f8120150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 -- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81200b1e40 msgr2=0x7f8120150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81200b1e40 0x7f8120150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 -- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81200d4860 msgr2=0x7f81200cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81200d4860 0x7f81200cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 -- 172.21.15.19:0/4026471039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200cb060 con 0x7f81201614d0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8125b17640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8118009f40 tx=0x7f8118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118043020 con 0x7f81201614d0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811803e450 con 0x7f81201614d0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811803e820 con 0x7f81201614d0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.197+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200cb340 con 0x7f81201614d0 2024-03-04T08:51:06.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.198+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200cb900 con 0x7f81201614d0 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.198+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200cbad0 con 0x7f81201614d0 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.199+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8118046020 con 0x7f81201614d0 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.199+0000 7f8115ffb640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 0x7f810406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.199+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81180accf0 con 0x7f81201614d0 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.199+0000 7f8125316640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 0x7f810406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.200+0000 7f8125316640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 0x7f810406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f811c007f70 tx=0x7f811c007f00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.204+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f81180b1070 con 0x7f81201614d0 2024-03-04T08:51:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.384+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81200b28d0 con 0x7f81201614d0 2024-03-04T08:51:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.385+0000 7f8115ffb640 1 -- 172.21.15.19:0/4026471039 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f811804d020 con 0x7f81201614d0 2024-03-04T08:51:06.381 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 msgr2=0x7f810406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 0x7f810406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f811c007f70 tx=0x7f811c007f00 comp rx=0 tx=0).stop 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 msgr2=0x7f81200b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8118009f40 tx=0x7f8118004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 shutdown_connections 2024-03-04T08:51:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81201614d0 0x7f81200b0d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f810406b4d0 0x7f810406d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f81200d4860 0x7f81200cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 --2- 172.21.15.19:0/4026471039 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f81200b1e40 0x7f8120150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 >> 172.21.15.19:0/4026471039 conn(0x7f81200d3d40 msgr2=0x7f81200d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 shutdown_connections 2024-03-04T08:51:06.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.387+0000 7f812757a640 1 -- 172.21.15.19:0/4026471039 wait complete. 2024-03-04T08:51:06.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.504+0000 7f6ec46c2640 1 Processor -- start 2024-03-04T08:51:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.504+0000 7f6ec46c2640 1 -- start start 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec46c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 0x7f6ebc0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec46c2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 0x7f6ebc0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec46c2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc1618b0 con 0x7f6ebc0d1910 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec46c2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0cf400 con 0x7f6ebc0d2480 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec46c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0cf6a0 con 0x7f6ebc1614d0 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec1c5d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ebc0d1910 0x7f6ebc0d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42384/0 (socket says 172.21.15.19:42384) 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec1c5d640 1 -- 172.21.15.19:0/3865731897 learned_addr learned my addr 172.21.15.19:0/3865731897 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.505+0000 7f6ec2c5f640 1 --2- 172.21.15.19:0/3865731897 >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 0x7f6ebc0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec245e640 1 --2- 172.21.15.19:0/3865731897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 0x7f6ebc0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec145c640 1 -- 172.21.15.19:0/3865731897 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935178506 0 0) 0x7f6ebc1618b0 con 0x7f6ebc0d1910 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec145c640 1 -- 172.21.15.19:0/3865731897 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea8003520 con 0x7f6ebc0d1910 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec245e640 1 -- 172.21.15.19:0/3865731897 >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 msgr2=0x7f6ebc0b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec245e640 1 --2- 172.21.15.19:0/3865731897 >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 0x7f6ebc0b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec245e640 1 -- 172.21.15.19:0/3865731897 >> v1:172.21.15.19:6789/0 conn(0x7f6ebc0d1910 legacy=0x7f6ebc0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec245e640 1 -- 172.21.15.19:0/3865731897 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0cf980 con 0x7f6ebc1614d0 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.506+0000 7f6ec2c5f640 1 --2- 172.21.15.19:0/3865731897 >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 0x7f6ebc0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec245e640 1 --2- 172.21.15.19:0/3865731897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 0x7f6ebc0d4860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80097a0 tx=0x7f6eb802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f1f2dfa53b4d97 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec145c640 1 -- 172.21.15.19:0/3865731897 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8035020 con 0x7f6ebc1614d0 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec145c640 1 -- 172.21.15.19:0/3865731897 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8031830 con 0x7f6ebc1614d0 2024-03-04T08:51:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec145c640 1 -- 172.21.15.19:0/3865731897 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8031be0 con 0x7f6ebc1614d0 2024-03-04T08:51:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 -- 172.21.15.19:0/3865731897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 msgr2=0x7f6ebc0d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/3865731897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 0x7f6ebc0d4860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80097a0 tx=0x7f6eb802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 -- 172.21.15.19:0/3865731897 shutdown_connections 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/3865731897 >> v2:172.21.15.204:3300/0 conn(0x7f6ebc0d2480 0x7f6ebc0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/3865731897 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc1614d0 0x7f6ebc0d4860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 -- 172.21.15.19:0/3865731897 >> 172.21.15.19:0/3865731897 conn(0x7f6ebc0d3d40 msgr2=0x7f6ebc0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 -- 172.21.15.19:0/3865731897 shutdown_connections 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.507+0000 7f6ec46c2640 1 -- 172.21.15.19:0/3865731897 wait complete. 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 Processor -- start 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 -- start start 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 0x7f6ebc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 0x7f6ebc0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b1370 con 0x7f6ebc1614d0 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b0910 con 0x7f6ebc0d1910 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec46c2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b14f0 con 0x7f6ebc0d2480 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec2c5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec245e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 0x7f6ebc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec2c5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47748/0 (socket says 172.21.15.19:47748) 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec2c5f640 1 -- 172.21.15.19:0/1089760821 learned_addr learned my addr 172.21.15.19:0/1089760821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.509+0000 7f6ec1c5d640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 0x7f6ebc0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 -- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 msgr2=0x7f6ebc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 0x7f6ebc0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 -- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 msgr2=0x7f6ebc0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 0x7f6ebc0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 -- 172.21.15.19:0/1089760821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0cdd20 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec1c5d640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 0x7f6ebc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec245e640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 0x7f6ebc0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec2c5f640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009eb0 tx=0x7f6eb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4018020 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4014480 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4014850 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc0b6db0 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.510+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc0b7370 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.511+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc068ff0 con 0x7f6ebc1614d0 2024-03-04T08:51:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.511+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6eb4005d10 con 0x7f6ebc1614d0 2024-03-04T08:51:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.512+0000 7f6eb2ffd640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 0x7f6ea006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.512+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6eb408af50 con 0x7f6ebc1614d0 2024-03-04T08:51:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.512+0000 7f6ec245e640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 0x7f6ea006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.513+0000 7f6ec245e640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 0x7f6ea006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8036000 tx=0x7f6eb803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.516+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6eb4022030 con 0x7f6ebc1614d0 2024-03-04T08:51:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.697+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ebc0b5650 con 0x7f6ebc1614d0 2024-03-04T08:51:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.697+0000 7f6eb2ffd640 1 -- 172.21.15.19:0/1089760821 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6eb4010040 con 0x7f6ebc1614d0 2024-03-04T08:51:06.693 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 msgr2=0x7f6ea006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 0x7f6ea006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8036000 tx=0x7f6eb803c040 comp rx=0 tx=0).stop 2024-03-04T08:51:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 msgr2=0x7f6ebc157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009eb0 tx=0x7f6eb400c490 comp rx=0 tx=0).stop 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 shutdown_connections 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc1614d0 0x7f6ebc157c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6ebc0d2480 0x7f6ebc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6ea006b4d0 0x7f6ea006d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 --2- 172.21.15.19:0/1089760821 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6ebc0d1910 0x7f6ebc0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 >> 172.21.15.19:0/1089760821 conn(0x7f6ebc0d3d40 msgr2=0x7f6ebc0b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 shutdown_connections 2024-03-04T08:51:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.699+0000 7f6ec46c2640 1 -- 172.21.15.19:0/1089760821 wait complete. 2024-03-04T08:51:06.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:06.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.814+0000 7f7a9abbd640 1 Processor -- start 2024-03-04T08:51:06.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.814+0000 7f7a9abbd640 1 -- start start 2024-03-04T08:51:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9abbd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a940d4860 0x7f7a940d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9abbd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7a940b0e30 0x7f7a940b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9abbd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a941618b0 con 0x7f7a941614d0 2024-03-04T08:51:06.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9abbd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940d4cf0 con 0x7f7a940d4860 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9abbd640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940cf400 con 0x7f7a940b0e30 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a940d4860 0x7f7a940d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a98959640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a941614d0 0x7f7a940d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42390/0 (socket says 172.21.15.19:42390) 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a940d4860 0x7f7a940d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47764/0 (socket says 172.21.15.19:47764) 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a98959640 1 -- 172.21.15.19:0/726405326 learned_addr learned my addr 172.21.15.19:0/726405326 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a9915a640 1 --2- 172.21.15.19:0/726405326 >> v2:172.21.15.204:3300/0 conn(0x7f7a940b0e30 0x7f7a940b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 -- 172.21.15.19:0/726405326 >> v2:172.21.15.204:3300/0 conn(0x7f7a940b0e30 msgr2=0x7f7a940b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 --2- 172.21.15.19:0/726405326 >> v2:172.21.15.204:3300/0 conn(0x7f7a940b0e30 0x7f7a940b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 -- 172.21.15.19:0/726405326 >> v1:172.21.15.19:6789/0 conn(0x7f7a941614d0 legacy=0x7f7a940d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a93fff640 1 -- 172.21.15.19:0/726405326 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940cf6a0 con 0x7f7a940d4860 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.815+0000 7f7a937fe640 1 -- 172.21.15.19:0/726405326 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687806443 0 0) 0x7f7a941618b0 con 0x7f7a941614d0 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.816+0000 7f7a93fff640 1 --2- 172.21.15.19:0/726405326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940d4860 0x7f7a940d2020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b2a70 tx=0x7f7a8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab60b9d8093b053 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.816+0000 7f7a937fe640 1 -- 172.21.15.19:0/726405326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88035020 con 0x7f7a940d4860 2024-03-04T08:51:06.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.816+0000 7f7a937fe640 1 -- 172.21.15.19:0/726405326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88031830 con 0x7f7a940d4860 2024-03-04T08:51:06.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.816+0000 7f7a937fe640 1 -- 172.21.15.19:0/726405326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88031c00 con 0x7f7a940d4860 2024-03-04T08:51:06.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 -- 172.21.15.19:0/726405326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940d4860 msgr2=0x7f7a940d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/726405326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940d4860 0x7f7a940d2020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b2a70 tx=0x7f7a8802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 -- 172.21.15.19:0/726405326 shutdown_connections 2024-03-04T08:51:06.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/726405326 >> v2:172.21.15.204:3300/0 conn(0x7f7a940b0e30 0x7f7a940b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/726405326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940d4860 0x7f7a940d2020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 -- 172.21.15.19:0/726405326 >> 172.21.15.19:0/726405326 conn(0x7f7a940d3d40 msgr2=0x7f7a940d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 -- 172.21.15.19:0/726405326 shutdown_connections 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.817+0000 7f7a9abbd640 1 -- 172.21.15.19:0/726405326 wait complete. 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.818+0000 7f7a9abbd640 1 Processor -- start 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.818+0000 7f7a9abbd640 1 -- start start 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7a940d4860 0x7f7a9415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a941614d0 0x7f7a9415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940b0910 con 0x7f7a940b0e30 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940cfc60 con 0x7f7a941614d0 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9abbd640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940d2560 con 0x7f7a940d4860 2024-03-04T08:51:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47774/0 (socket says 172.21.15.19:47774) 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 -- 172.21.15.19:0/1231687016 learned_addr learned my addr 172.21.15.19:0/1231687016 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a9915a640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a941614d0 0x7f7a9415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a93fff640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7a940d4860 0x7f7a9415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 -- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7a940d4860 msgr2=0x7f7a9415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7a940d4860 0x7f7a9415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 -- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a941614d0 msgr2=0x7f7a9415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a941614d0 0x7f7a9415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 -- 172.21.15.19:0/1231687016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940b5dd0 con 0x7f7a940b0e30 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.819+0000 7f7a98959640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00cb10 tx=0x7f7a8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.820+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c017070 con 0x7f7a940b0e30 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.820+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c00ac70 con 0x7f7a940b0e30 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.820+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a940b60b0 con 0x7f7a940b0e30 2024-03-04T08:51:06.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.820+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00ae60 con 0x7f7a940b0e30 2024-03-04T08:51:06.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.820+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940cafb0 con 0x7f7a940b0e30 2024-03-04T08:51:06.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.821+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a94068ff0 con 0x7f7a940b0e30 2024-03-04T08:51:06.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.821+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a8c01a070 con 0x7f7a940b0e30 2024-03-04T08:51:06.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.821+0000 7f7a917fa640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 0x7f7a8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:06.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.821+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a8c089e90 con 0x7f7a940b0e30 2024-03-04T08:51:06.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.821+0000 7f7a93fff640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 0x7f7a8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:06.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.822+0000 7f7a93fff640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 0x7f7a8006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a88036000 tx=0x7f7a88008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:06.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:06.826+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7a8c058750 con 0x7f7a940b0e30 2024-03-04T08:51:07.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.006+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a9415f720 con 0x7f7a940b0e30 2024-03-04T08:51:07.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.007+0000 7f7a917fa640 1 -- 172.21.15.19:0/1231687016 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a8c05c7f0 con 0x7f7a940b0e30 2024-03-04T08:51:07.003 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.008+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 msgr2=0x7f7a8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.008+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 0x7f7a8006d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a88036000 tx=0x7f7a88008030 comp rx=0 tx=0).stop 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.008+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 msgr2=0x7f7a940b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.008+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00cb10 tx=0x7f7a8c00a060 comp rx=0 tx=0).stop 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 shutdown_connections 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8006b4d0 0x7f7a8006d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7a941614d0 0x7f7a9415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7a940d4860 0x7f7a9415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 --2- 172.21.15.19:0/1231687016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a940b0e30 0x7f7a940b54d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 >> 172.21.15.19:0/1231687016 conn(0x7f7a940d3d40 msgr2=0x7f7a9406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 shutdown_connections 2024-03-04T08:51:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.009+0000 7f7a9abbd640 1 -- 172.21.15.19:0/1231687016 wait complete. 2024-03-04T08:51:07.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:07.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.123+0000 7fa970447640 1 Processor -- start 2024-03-04T08:51:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.123+0000 7fa970447640 1 -- start start 2024-03-04T08:51:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa970447640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9680d00c0 0x7fa9680d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa970447640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680cf850 0x7fa9680cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa970447640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680d09e0 con 0x7fa9680ce1b0 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa970447640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96806ca90 con 0x7fa9680d00c0 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa970447640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806df30 con 0x7fa9680cf850 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa96e9e4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9680ce1b0 0x7fa9680ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42406/0 (socket says 172.21.15.19:42406) 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa96e9e4640 1 -- 172.21.15.19:0/2246261850 learned_addr learned my addr 172.21.15.19:0/2246261850 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/2246261850 >> v2:172.21.15.204:3300/0 conn(0x7fa9680d00c0 0x7fa9680d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.124+0000 7fa96d9e2640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680cf850 0x7fa9680cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96e1e3640 1 -- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680cf850 msgr2=0x7fa9680cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680cf850 0x7fa9680cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96e1e3640 1 -- 172.21.15.19:0/2246261850 >> v1:172.21.15.19:6789/0 conn(0x7fa9680ce1b0 legacy=0x7fa9680ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96e1e3640 1 -- 172.21.15.19:0/2246261850 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96815e380 con 0x7fa9680d00c0 2024-03-04T08:51:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96d1e1640 1 -- 172.21.15.19:0/2246261850 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331311698 0 0) 0x7fa9680d09e0 con 0x7fa9680ce1b0 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680d00c0 0x7fa9680d04a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097a0 tx=0x7fa96002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50e0a9a857ee711 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96d1e1640 1 -- 172.21.15.19:0/2246261850 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960035020 con 0x7fa9680d00c0 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.125+0000 7fa96d1e1640 1 -- 172.21.15.19:0/2246261850 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960031830 con 0x7fa9680d00c0 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa96d1e1640 1 -- 172.21.15.19:0/2246261850 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960031c00 con 0x7fa9680d00c0 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 -- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680d00c0 msgr2=0x7fa9680d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680d00c0 0x7fa9680d04a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097a0 tx=0x7fa96002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 -- 172.21.15.19:0/2246261850 shutdown_connections 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680cf850 0x7fa9680cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 --2- 172.21.15.19:0/2246261850 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680d00c0 0x7fa9680d04a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 -- 172.21.15.19:0/2246261850 >> 172.21.15.19:0/2246261850 conn(0x7fa9680b35a0 msgr2=0x7fa9680b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 -- 172.21.15.19:0/2246261850 shutdown_connections 2024-03-04T08:51:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.126+0000 7fa970447640 1 -- 172.21.15.19:0/2246261850 wait complete. 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.127+0000 7fa970447640 1 Processor -- start 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.127+0000 7fa970447640 1 -- start start 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 0x7fa968154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680d00c0 0x7fa9680b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806c440 con 0x7fa9680cf850 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806c160 con 0x7fa9680ce1b0 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa970447640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806c720 con 0x7fa9680d00c0 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47782/0 (socket says 172.21.15.19:47782) 2024-03-04T08:51:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 -- 172.21.15.19:0/794632239 learned_addr learned my addr 172.21.15.19:0/794632239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96e9e4640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680d00c0 0x7fa9680b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 0x7fa968154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 -- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680d00c0 msgr2=0x7fa9680b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680d00c0 0x7fa9680b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 -- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 msgr2=0x7fa968154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 0x7fa968154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.128+0000 7fa96d9e2640 1 -- 172.21.15.19:0/794632239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96815d500 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 0x7fa968154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa96d9e2640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00e9e0 tx=0x7fa95c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c017070 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00c9d0 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9680b5540 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00cdc0 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.129+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680b5b00 con 0x7fa9680cf850 2024-03-04T08:51:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.130+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96804f330 con 0x7fa9680cf850 2024-03-04T08:51:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.130+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa95c01a070 con 0x7fa9680cf850 2024-03-04T08:51:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.131+0000 7fa966ffd640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 0x7fa95406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.131+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa95c08a140 con 0x7fa9680cf850 2024-03-04T08:51:07.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.131+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 0x7fa95406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.131+0000 7fa96e1e3640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 0x7fa95406d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa960036000 tx=0x7fa96003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.135+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa95c058970 con 0x7fa9680cf850 2024-03-04T08:51:07.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.317+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9680d2710 con 0x7fa9680cf850 2024-03-04T08:51:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.318+0000 7fa966ffd640 1 -- 172.21.15.19:0/794632239 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fa95c05ca10 con 0x7fa9680cf850 2024-03-04T08:51:07.315 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:07.315 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 msgr2=0x7fa95406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 0x7fa95406d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa960036000 tx=0x7fa96003c040 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 msgr2=0x7fa9680c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00e9e0 tx=0x7fa95c00eea0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 shutdown_connections 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9680d00c0 0x7fa9680b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9680cf850 0x7fa9680c5eb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa95406b500 0x7fa95406d9c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 --2- 172.21.15.19:0/794632239 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9680ce1b0 0x7fa968154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 >> 172.21.15.19:0/794632239 conn(0x7fa9680b35a0 msgr2=0x7fa9680d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 shutdown_connections 2024-03-04T08:51:07.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.320+0000 7fa970447640 1 -- 172.21.15.19:0/794632239 wait complete. 2024-03-04T08:51:07.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:07.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.436+0000 7f5d11064640 1 Processor -- start 2024-03-04T08:51:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.436+0000 7f5d11064640 1 -- start start 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d11064640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d11064640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0d2730 con 0x7f5d0c1614d0 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d11064640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c1618b0 con 0x7f5d0c0d4860 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d11064640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0d4cf0 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5d0c1614d0 0x7f5d0c0d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60386/0 (socket says 172.21.15.19:60386) 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0ad9d640 1 -- 172.21.15.19:0/996337636 learned_addr learned my addr 172.21.15.19:0/996337636 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0b59e640 1 --2- 172.21.15.19:0/996337636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752443150 0 0) 0x7f5d0c0d2730 con 0x7f5d0c1614d0 2024-03-04T08:51:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf4003520 con 0x7f5d0c1614d0 2024-03-04T08:51:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218730423 0 0) 0x7f5d0c1618b0 con 0x7f5d0c0d4860 2024-03-04T08:51:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d0c0d2730 con 0x7f5d0c0d4860 2024-03-04T08:51:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0b59e640 1 -- 172.21.15.19:0/996337636 >> v1:172.21.15.204:6789/0 conn(0x7f5d0c0d4860 legacy=0x7f5d0c0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0b59e640 1 -- 172.21.15.19:0/996337636 >> v1:172.21.15.19:6789/0 conn(0x7f5d0c1614d0 legacy=0x7f5d0c0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.437+0000 7f5d0b59e640 1 -- 172.21.15.19:0/996337636 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0cf400 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.438+0000 7f5d0b59e640 1 --2- 172.21.15.19:0/996337636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c168b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0cf5d0 tx=0x7f5cfc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66a1dc287eaf09e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.438+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc039070 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.438+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc02ccd0 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.438+0000 7f5d09d9b640 1 -- 172.21.15.19:0/996337636 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc034660 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 -- 172.21.15.19:0/996337636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 msgr2=0x7f5d0c168b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 --2- 172.21.15.19:0/996337636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c168b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0cf5d0 tx=0x7f5cfc02bf20 comp rx=0 tx=0).stop 2024-03-04T08:51:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 -- 172.21.15.19:0/996337636 shutdown_connections 2024-03-04T08:51:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 --2- 172.21.15.19:0/996337636 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c168b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 -- 172.21.15.19:0/996337636 >> 172.21.15.19:0/996337636 conn(0x7f5d0c0d3d40 msgr2=0x7f5d0c0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 -- 172.21.15.19:0/996337636 shutdown_connections 2024-03-04T08:51:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.439+0000 7f5d11064640 1 -- 172.21.15.19:0/996337636 wait complete. 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.440+0000 7f5d11064640 1 Processor -- start 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.440+0000 7f5d11064640 1 -- start start 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c0b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d0c0d4860 0x7f5d0c153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0cfc60 con 0x7f5d0c1614d0 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0cf980 con 0x7f5d0c0d4860 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d11064640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0b0910 con 0x7f5d0c0b1e40 2024-03-04T08:51:07.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d0b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d0b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52778/0 (socket says 172.21.15.19:52778) 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d0ad9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c0b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d0b59e640 1 -- 172.21.15.19:0/3526057664 learned_addr learned my addr 172.21.15.19:0/3526057664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.441+0000 7f5d0a59c640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d0c0d4860 0x7f5d0c153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 -- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 msgr2=0x7f5d0c0b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c0b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 -- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d0c0d4860 msgr2=0x7f5d0c153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d0c0d4860 0x7f5d0c153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 -- 172.21.15.19:0/3526057664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0d0890 con 0x7f5d0c1614d0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0ad9d640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c0b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d0b59e640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc039050 con 0x7f5d0c1614d0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc045070 con 0x7f5d0c1614d0 2024-03-04T08:51:07.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c0d0b00 con 0x7f5d0c1614d0 2024-03-04T08:51:07.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc009450 con 0x7f5d0c1614d0 2024-03-04T08:51:07.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.442+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c0d10c0 con 0x7f5d0c1614d0 2024-03-04T08:51:07.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.443+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c0ce170 con 0x7f5d0c1614d0 2024-03-04T08:51:07.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.443+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5cfc03e850 con 0x7f5d0c1614d0 2024-03-04T08:51:07.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.444+0000 7f5cf37fe640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 0x7f5cf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.444+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cfc0acd30 con 0x7f5d0c1614d0 2024-03-04T08:51:07.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.444+0000 7f5d0ad9d640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 0x7f5cf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.444+0000 7f5d0ad9d640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 0x7f5cf806d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000f60 tx=0x7f5d04007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.448+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5cfc07b710 con 0x7f5d0c1614d0 2024-03-04T08:51:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.628+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d0c068ff0 con 0x7f5d0c1614d0 2024-03-04T08:51:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.629+0000 7f5cf37fe640 1 -- 172.21.15.19:0/3526057664 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cfc07f7b0 con 0x7f5d0c1614d0 2024-03-04T08:51:07.625 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 msgr2=0x7f5cf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 0x7f5cf806d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000f60 tx=0x7f5d04007d70 comp rx=0 tx=0).stop 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 msgr2=0x7f5d0c154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 shutdown_connections 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d0c1614d0 0x7f5d0c154060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cf806b4d0 0x7f5cf806d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d0c0d4860 0x7f5d0c153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 --2- 172.21.15.19:0/3526057664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5d0c0b1e40 0x7f5d0c0b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.630+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 >> 172.21.15.19:0/3526057664 conn(0x7f5d0c0d3d40 msgr2=0x7f5d0c15e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.631+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 shutdown_connections 2024-03-04T08:51:07.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.631+0000 7f5d11064640 1 -- 172.21.15.19:0/3526057664 wait complete. 2024-03-04T08:51:07.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.745+0000 7f0e8b53a640 1 Processor -- start 2024-03-04T08:51:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 -- start start 2024-03-04T08:51:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e841614d0 0x7f0e840d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e840d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e840d2740 con 0x7f0e840d22b0 2024-03-04T08:51:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e841618b0 con 0x7f0e841614d0 2024-03-04T08:51:07.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.746+0000 7f0e8b53a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840cf400 con 0x7f0e840d1910 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e841614d0 0x7f0e840d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e841614d0 0x7f0e840d4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52780/0 (socket says 172.21.15.19:52780) 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 -- 172.21.15.19:0/1399065020 learned_addr learned my addr 172.21.15.19:0/1399065020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e88ad5640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e840d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 -- 172.21.15.19:0/1399065020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 msgr2=0x7f0e840d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e840d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 -- 172.21.15.19:0/1399065020 >> v1:172.21.15.19:6789/0 conn(0x7f0e840d22b0 legacy=0x7f0e840d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e892d6640 1 -- 172.21.15.19:0/1399065020 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e840cf6a0 con 0x7f0e841614d0 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e7bfff640 1 -- 172.21.15.19:0/1399065020 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329361585 0 0) 0x7f0e7c001490 con 0x7f0e840d22b0 2024-03-04T08:51:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.747+0000 7f0e88ad5640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e840d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e892d6640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e841614d0 0x7f0e840d4860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009870 tx=0x7f0e8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c93fee09e4f25f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e7bfff640 1 -- 172.21.15.19:0/1399065020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80034070 con 0x7f0e841614d0 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e7bfff640 1 -- 172.21.15.19:0/1399065020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80030840 con 0x7f0e841614d0 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e7bfff640 1 -- 172.21.15.19:0/1399065020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80030c10 con 0x7f0e841614d0 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 -- 172.21.15.19:0/1399065020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e841614d0 msgr2=0x7f0e840d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e841614d0 0x7f0e840d4860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009870 tx=0x7f0e8002b980 comp rx=0 tx=0).stop 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 -- 172.21.15.19:0/1399065020 shutdown_connections 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e840d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/1399065020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e841614d0 0x7f0e840d4860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 -- 172.21.15.19:0/1399065020 >> 172.21.15.19:0/1399065020 conn(0x7f0e840d3d40 msgr2=0x7f0e840d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 -- 172.21.15.19:0/1399065020 shutdown_connections 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.748+0000 7f0e8b53a640 1 -- 172.21.15.19:0/1399065020 wait complete. 2024-03-04T08:51:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 Processor -- start 2024-03-04T08:51:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 -- start start 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e841f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e841614d0 0x7f0e840cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b0910 con 0x7f0e840d22b0 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840cfc60 con 0x7f0e841614d0 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e8b53a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b1e40 con 0x7f0e840d1910 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e88ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e88ad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52792/0 (socket says 172.21.15.19:52792) 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e88ad5640 1 -- 172.21.15.19:0/877145516 learned_addr learned my addr 172.21.15.19:0/877145516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e892d6640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e841f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.750+0000 7f0e89ad7640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e841614d0 0x7f0e840cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 -- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 msgr2=0x7f0e841f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e841f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 -- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e841614d0 msgr2=0x7f0e840cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e841614d0 0x7f0e840cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 -- 172.21.15.19:0/877145516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e840c8320 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e88ad5640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400ebe0 tx=0x7f0e7400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74017070 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400cc30 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e840c9380 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74013470 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.751+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e840c88a0 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.752+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84068ff0 con 0x7f0e840d22b0 2024-03-04T08:51:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.753+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e7401a070 con 0x7f0e840d22b0 2024-03-04T08:51:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.753+0000 7f0e79ffb640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 0x7f0e6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.753+0000 7f0e892d6640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 0x7f0e6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.753+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e7408a0d0 con 0x7f0e840d22b0 2024-03-04T08:51:07.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.754+0000 7f0e892d6640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 0x7f0e6806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e80036000 tx=0x7f0e8003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:07.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.758+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0e74058900 con 0x7f0e840d22b0 2024-03-04T08:51:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.937+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e840b1a00 con 0x7f0e840d22b0 2024-03-04T08:51:07.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.937+0000 7f0e79ffb640 1 -- 172.21.15.19:0/877145516 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e7405c9a0 con 0x7f0e840d22b0 2024-03-04T08:51:07.934 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 msgr2=0x7f0e6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 0x7f0e6806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e80036000 tx=0x7f0e8003b040 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 msgr2=0x7f0e840ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400ebe0 tx=0x7f0e7400c520 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 shutdown_connections 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e6806b4d0 0x7f0e6806d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e841614d0 0x7f0e840cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e840d22b0 0x7f0e840ccc80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 --2- 172.21.15.19:0/877145516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e840d1910 0x7f0e841f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 >> 172.21.15.19:0/877145516 conn(0x7f0e840d3d40 msgr2=0x7f0e8406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 shutdown_connections 2024-03-04T08:51:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:07.939+0000 7f0e8b53a640 1 -- 172.21.15.19:0/877145516 wait complete. 2024-03-04T08:51:07.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.054+0000 7fbd9e1c9640 1 Processor -- start 2024-03-04T08:51:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.054+0000 7fbd9e1c9640 1 -- start start 2024-03-04T08:51:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd9e1c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd9e1c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbd980b0e30 0x7fbd980b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd9e1c9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd981618b0 con 0x7fbd981614d0 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd9e1c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd980d4cc0 con 0x7fbd980b0e30 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd9e1c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980cf400 con 0x7fbd980d4860 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd96ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd97fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbd980b0e30 0x7fbd980b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd977fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fbd981614d0 0x7fbd980d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:34948/0 (socket says 172.21.15.19:34948) 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd96ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:52740/0 (socket says 172.21.15.19:52740) 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd977fe640 1 -- 172.21.15.19:0/391403015 learned_addr learned my addr 172.21.15.19:0/391403015 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.055+0000 7fbd97fff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbd980b0e30 0x7fbd980b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:42788/0 (socket says 172.21.15.19:42788) 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd97fff640 1 -- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 msgr2=0x7fbd980d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd97fff640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd97fff640 1 -- 172.21.15.19:0/391403015 >> v1:172.21.15.204:6789/0 conn(0x7fbd981614d0 legacy=0x7fbd980d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd97fff640 1 -- 172.21.15.19:0/391403015 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980cf6a0 con 0x7fbd980b0e30 2024-03-04T08:51:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd967fc640 1 -- 172.21.15.19:0/391403015 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495824080 0 0) 0x7fbd981618b0 con 0x7fbd981614d0 2024-03-04T08:51:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd96ffd640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.056+0000 7fbd97fff640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980b0e30 0x7fbd980b12c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009d90 tx=0x7fbd9002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b82ccc9e29aee43 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd967fc640 1 -- 172.21.15.19:0/391403015 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90039070 con 0x7fbd980b0e30 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd967fc640 1 -- 172.21.15.19:0/391403015 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9002cc50 con 0x7fbd980b0e30 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd967fc640 1 -- 172.21.15.19:0/391403015 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90034440 con 0x7fbd980b0e30 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980b0e30 msgr2=0x7fbd980b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980b0e30 0x7fbd980b12c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009d90 tx=0x7fbd9002bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/391403015 shutdown_connections 2024-03-04T08:51:08.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980b0e30 0x7fbd980b12c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/391403015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980d4860 0x7fbd980d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/391403015 >> 172.21.15.19:0/391403015 conn(0x7fbd980d3d40 msgr2=0x7fbd980d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/391403015 shutdown_connections 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.057+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/391403015 wait complete. 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.058+0000 7fbd9e1c9640 1 Processor -- start 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 -- start start 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 0x7fbd9814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 0x7fbd9814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980b0910 con 0x7fbd981614d0 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980cfc60 con 0x7fbd980d4860 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd9e1c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980d2560 con 0x7fbd980b0e30 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd96ffd640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 0x7fbd9814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd977fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 0x7fbd9814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52806/0 (socket says 172.21.15.19:52806) 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.059+0000 7fbd97fff640 1 -- 172.21.15.19:0/3080164223 learned_addr learned my addr 172.21.15.19:0/3080164223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 -- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 msgr2=0x7fbd9814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 0x7fbd9814ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 -- 172.21.15.19:0/3080164223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 msgr2=0x7fbd980d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 -- 172.21.15.19:0/3080164223 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9814e490 con 0x7fbd980d4860 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd977fe640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 0x7fbd9814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd97fff640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd96ffd640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 0x7fbd9814df50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00e900 tx=0x7fbd8c00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c017070 con 0x7fbd980d4860 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00ca00 con 0x7fbd980d4860 2024-03-04T08:51:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd980cb120 con 0x7fbd980d4860 2024-03-04T08:51:08.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00cdf0 con 0x7fbd980d4860 2024-03-04T08:51:08.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.060+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd980cd440 con 0x7fbd980d4860 2024-03-04T08:51:08.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.061+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd980ca6d0 con 0x7fbd980d4860 2024-03-04T08:51:08.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.062+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd8c01a070 con 0x7fbd980d4860 2024-03-04T08:51:08.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.062+0000 7fbd7ffff640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 0x7fbd8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.062+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd8c08a4a0 con 0x7fbd980d4860 2024-03-04T08:51:08.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.062+0000 7fbd977fe640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 0x7fbd8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.063+0000 7fbd977fe640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 0x7fbd8406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbd88007fd0 tx=0x7fbd88007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.066+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd9814e490 con 0x7fbd980d4860 2024-03-04T08:51:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.248+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd98068ff0 con 0x7fbd980d4860 2024-03-04T08:51:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.248+0000 7fbd7ffff640 1 -- 172.21.15.19:0/3080164223 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd8c058dc0 con 0x7fbd980d4860 2024-03-04T08:51:08.245 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 msgr2=0x7fbd8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 0x7fbd8406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbd88007fd0 tx=0x7fbd88007de0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 msgr2=0x7fbd9814df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 0x7fbd9814df50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00e900 tx=0x7fbd8c00edc0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 shutdown_connections 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd981614d0 0x7fbd980d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd8406b4d0 0x7fbd8406d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd980d4860 0x7fbd9814df50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 --2- 172.21.15.19:0/3080164223 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd980b0e30 0x7fbd9814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 >> 172.21.15.19:0/3080164223 conn(0x7fbd980d3d40 msgr2=0x7fbd98160220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 shutdown_connections 2024-03-04T08:51:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.250+0000 7fbd9e1c9640 1 -- 172.21.15.19:0/3080164223 wait complete. 2024-03-04T08:51:08.276 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-03-04T08:51:08.276 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:51:08.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.381+0000 7f4103ab1640 1 Processor -- start 2024-03-04T08:51:08.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 -- start start 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40fc0d0a80 0x7f40fc0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0d25d0 con 0x7f40fc0d4760 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc0d4bf0 con 0x7f40fc0d0a80 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f4103ab1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0ce9e0 con 0x7f40fc0b4170 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f410204e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40fc0d0a80 0x7f40fc0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f410104c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f40fc0d4760 0x7f40fc0d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60406/0 (socket says 172.21.15.19:60406) 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.382+0000 7f410104c640 1 -- 172.21.15.19:0/3687963759 learned_addr learned my addr 172.21.15.19:0/3687963759 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410184d640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410204e640 1 -- 172.21.15.19:0/3687963759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 msgr2=0x7f40fc0b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410204e640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc0b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410204e640 1 -- 172.21.15.19:0/3687963759 >> v1:172.21.15.19:6789/0 conn(0x7f40fc0d4760 legacy=0x7f40fc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410204e640 1 -- 172.21.15.19:0/3687963759 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0d2870 con 0x7f40fc0d0a80 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.383+0000 7f410204e640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cee70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a32a2cebbff046 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f410084b640 1 -- 172.21.15.19:0/3687963759 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4039070 con 0x7f40fc0d0a80 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f410084b640 1 -- 172.21.15.19:0/3687963759 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f402cc50 con 0x7f40fc0d0a80 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f410084b640 1 -- 172.21.15.19:0/3687963759 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4034440 con 0x7f40fc0d0a80 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 -- 172.21.15.19:0/3687963759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 msgr2=0x7f40fc0cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cee70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009d90 tx=0x7f40f402bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 -- 172.21.15.19:0/3687963759 shutdown_connections 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cee70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 --2- 172.21.15.19:0/3687963759 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 -- 172.21.15.19:0/3687963759 >> 172.21.15.19:0/3687963759 conn(0x7f40fc0d3c40 msgr2=0x7f40fc0d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 -- 172.21.15.19:0/3687963759 shutdown_connections 2024-03-04T08:51:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.384+0000 7f4103ab1640 1 -- 172.21.15.19:0/3687963759 wait complete. 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.385+0000 7f4103ab1640 1 Processor -- start 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.385+0000 7f4103ab1640 1 -- start start 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40fc0b6860 0x7f40fc0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b4dd0 con 0x7f40fc0d0a80 2024-03-04T08:51:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b4550 con 0x7f40fc0b6860 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f4103ab1640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b4f50 con 0x7f40fc0b4170 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f410104c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f410104c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52818/0 (socket says 172.21.15.19:52818) 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f410104c640 1 -- 172.21.15.19:0/1732477392 learned_addr learned my addr 172.21.15.19:0/1732477392 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f410184d640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.386+0000 7f410204e640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40fc0b6860 0x7f40fc0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 -- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 msgr2=0x7f40fc1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 -- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40fc0b6860 msgr2=0x7f40fc0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40fc0b6860 0x7f40fc0cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 -- 172.21.15.19:0/1732477392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0cc870 con 0x7f40fc0d0a80 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f410104c640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c3f0 tx=0x7f40ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec017070 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec005ce0 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0ccb50 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0072f0 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.387+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc0c7840 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.388+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc0cd070 con 0x7f40fc0d0a80 2024-03-04T08:51:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.388+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40ec01a070 con 0x7f40fc0d0a80 2024-03-04T08:51:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.389+0000 7f40f27fc640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.389+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40ec0894d0 con 0x7f40fc0d0a80 2024-03-04T08:51:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.389+0000 7f410184d640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.389+0000 7f410184d640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 0x7f40e006d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009b40 tx=0x7f40f8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.393+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f40fc0cd070 con 0x7f40fc0d0a80 2024-03-04T08:51:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.578+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40fc04f330 con 0x7f40fc0d0a80 2024-03-04T08:51:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.579+0000 7f40f27fc640 1 -- 172.21.15.19:0/1732477392 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f40ec087e20 con 0x7f40fc0d0a80 2024-03-04T08:51:08.575 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:08.576 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 msgr2=0x7f40e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 0x7f40e006d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009b40 tx=0x7f40f8009190 comp rx=0 tx=0).stop 2024-03-04T08:51:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 msgr2=0x7f40fc0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c3f0 tx=0x7f40ec00c8b0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 shutdown_connections 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f40fc0b6860 0x7f40fc0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc0d0a80 0x7f40fc0cbcb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 --2- 172.21.15.19:0/1732477392 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f40fc0b4170 0x7f40fc1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 >> 172.21.15.19:0/1732477392 conn(0x7f40fc0d3c40 msgr2=0x7f40fc0d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 shutdown_connections 2024-03-04T08:51:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.581+0000 7f4103ab1640 1 -- 172.21.15.19:0/1732477392 wait complete. 2024-03-04T08:51:08.588 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:08.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.696+0000 7f1422be9640 1 Processor -- start 2024-03-04T08:51:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.696+0000 7f1422be9640 1 -- start start 2024-03-04T08:51:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1422be9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f141c15b940 0x7f141c0cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1422be9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f141c0cffd0 0x7f141c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1422be9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0ad900 con 0x7f141c15ea20 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1422be9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c15bd20 con 0x7f141c15b940 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1422be9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0adb70 con 0x7f141c0cffd0 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f141c15b940 0x7f141c0cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f141c15b940 0x7f141c0cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52834/0 (socket says 172.21.15.19:52834) 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 -- 172.21.15.19:0/2504556204 learned_addr learned my addr 172.21.15.19:0/2504556204 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f141bfff640 1 --2- 172.21.15.19:0/2504556204 >> v2:172.21.15.204:3300/0 conn(0x7f141c0cffd0 0x7f141c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 -- 172.21.15.19:0/2504556204 >> v2:172.21.15.204:3300/0 conn(0x7f141c0cffd0 msgr2=0x7f141c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 --2- 172.21.15.19:0/2504556204 >> v2:172.21.15.204:3300/0 conn(0x7f141c0cffd0 0x7f141c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 -- 172.21.15.19:0/2504556204 >> v1:172.21.15.204:6789/0 conn(0x7f141c15ea20 legacy=0x7f141c161910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.697+0000 7f1420985640 1 -- 172.21.15.19:0/2504556204 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0ade50 con 0x7f141c15b940 2024-03-04T08:51:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.698+0000 7f1420985640 1 --2- 172.21.15.19:0/2504556204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c15b940 0x7f141c0cfa90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f141c0d05e0 tx=0x7f141002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd40ae6e0e01e7e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.698+0000 7f141b7fe640 1 -- 172.21.15.19:0/2504556204 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410034070 con 0x7f141c15b940 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.698+0000 7f141b7fe640 1 -- 172.21.15.19:0/2504556204 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410030860 con 0x7f141c15b940 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.698+0000 7f141b7fe640 1 -- 172.21.15.19:0/2504556204 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410030c30 con 0x7f141c15b940 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 -- 172.21.15.19:0/2504556204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c15b940 msgr2=0x7f141c0cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 --2- 172.21.15.19:0/2504556204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c15b940 0x7f141c0cfa90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f141c0d05e0 tx=0x7f141002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 -- 172.21.15.19:0/2504556204 shutdown_connections 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 --2- 172.21.15.19:0/2504556204 >> v2:172.21.15.204:3300/0 conn(0x7f141c0cffd0 0x7f141c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 --2- 172.21.15.19:0/2504556204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c15b940 0x7f141c0cfa90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 -- 172.21.15.19:0/2504556204 >> 172.21.15.19:0/2504556204 conn(0x7f141c06b190 msgr2=0x7f141c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 -- 172.21.15.19:0/2504556204 shutdown_connections 2024-03-04T08:51:08.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.699+0000 7f1422be9640 1 -- 172.21.15.19:0/2504556204 wait complete. 2024-03-04T08:51:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.700+0000 7f1422be9640 1 Processor -- start 2024-03-04T08:51:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.700+0000 7f1422be9640 1 -- start start 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f141c15b940 0x7f141c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f141c15ea20 0x7f141c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15f210 con 0x7f141c0cffd0 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c071ba0 con 0x7f141c15b940 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1422be9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15ee90 con 0x7f141c15ea20 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52850/0 (socket says 172.21.15.19:52850) 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 -- 172.21.15.19:0/162087574 learned_addr learned my addr 172.21.15.19:0/162087574 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f141bfff640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f141c15b940 0x7f141c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1421186640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f141c15ea20 0x7f141c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 -- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f141c15ea20 msgr2=0x7f141c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f141c15ea20 0x7f141c15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 -- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f141c15b940 msgr2=0x7f141c0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f141c15b940 0x7f141c0af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 -- 172.21.15.19:0/162087574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0afaf0 con 0x7f141c0cffd0 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.701+0000 7f1420985640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f141002b9e0 tx=0x7f14100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.702+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410034040 con 0x7f141c0cffd0 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.702+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410039d90 con 0x7f141c0cffd0 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.702+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410043630 con 0x7f141c0cffd0 2024-03-04T08:51:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.702+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0afdd0 con 0x7f141c0cffd0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.702+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c0b0390 con 0x7f141c0cffd0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.703+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c072690 con 0x7f141c0cffd0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.703+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f141004a060 con 0x7f141c0cffd0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.703+0000 7f14197fa640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 0x7f140006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.703+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14100ac080 con 0x7f141c0cffd0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.704+0000 7f141bfff640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 0x7f140006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:08.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.704+0000 7f141bfff640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 0x7f140006d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f141c0cff50 tx=0x7f1408009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.708+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f141c072690 con 0x7f141c0cffd0 2024-03-04T08:51:08.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.888+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f141c06b570 con 0x7f141c0cffd0 2024-03-04T08:51:08.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.888+0000 7f14197fa640 1 -- 172.21.15.19:0/162087574 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f141003e070 con 0x7f141c0cffd0 2024-03-04T08:51:08.885 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 msgr2=0x7f140006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 0x7f140006d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f141c0cff50 tx=0x7f1408009190 comp rx=0 tx=0).stop 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 msgr2=0x7f141c141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f141002b9e0 tx=0x7f14100046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 shutdown_connections 2024-03-04T08:51:08.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.890+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f141c15ea20 0x7f141c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f140006b4d0 0x7f140006d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f141c15b940 0x7f141c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 --2- 172.21.15.19:0/162087574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f141c0cffd0 0x7f141c141da0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 >> 172.21.15.19:0/162087574 conn(0x7f141c06b190 msgr2=0x7f141c157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 shutdown_connections 2024-03-04T08:51:08.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:08.891+0000 7f1422be9640 1 -- 172.21.15.19:0/162087574 wait complete. 2024-03-04T08:51:08.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:09.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.005+0000 7fc123dbc640 1 Processor -- start 2024-03-04T08:51:09.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.005+0000 7fc123dbc640 1 -- start start 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc123dbc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc123dbc640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0cd4b0 con 0x7fc11c06fb40 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc123dbc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0cd790 con 0x7fc11c0d0af0 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc123dbc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c06ff80 con 0x7fc11c15c050 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc121357640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc11c06fb40 0x7fc11c0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60410/0 (socket says 172.21.15.19:60410) 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc121357640 1 -- 172.21.15.19:0/2705251098 learned_addr learned my addr 172.21.15.19:0/2705251098 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:09.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.006+0000 7fc121b58640 1 --2- 172.21.15.19:0/2705251098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196562056 0 0) 0x7fc11c0cd4b0 con 0x7fc11c06fb40 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc104003520 con 0x7fc11c06fb40 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244432084 0 0) 0x7fc11c0cd790 con 0x7fc11c0d0af0 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc121b58640 1 -- 172.21.15.19:0/2705251098 >> v1:172.21.15.204:6789/0 conn(0x7fc11c0d0af0 legacy=0x7fc11c165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc121b58640 1 -- 172.21.15.19:0/2705251098 >> v1:172.21.15.19:6789/0 conn(0x7fc11c06fb40 legacy=0x7fc11c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.007+0000 7fc121b58640 1 -- 172.21.15.19:0/2705251098 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0cda70 con 0x7fc11c15c050 2024-03-04T08:51:09.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc121b58640 1 --2- 172.21.15.19:0/2705251098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c06f600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1140097d0 tx=0x7fc11402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec877dadb47de168 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114035020 con 0x7fc11c15c050 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc114031800 con 0x7fc11c15c050 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc120b56640 1 -- 172.21.15.19:0/2705251098 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114031bd0 con 0x7fc11c15c050 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 -- 172.21.15.19:0/2705251098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 msgr2=0x7fc11c06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 --2- 172.21.15.19:0/2705251098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c06f600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1140097d0 tx=0x7fc11402b8a0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 -- 172.21.15.19:0/2705251098 shutdown_connections 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 --2- 172.21.15.19:0/2705251098 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c06f600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 -- 172.21.15.19:0/2705251098 >> 172.21.15.19:0/2705251098 conn(0x7fc11c0b3800 msgr2=0x7fc11c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 -- 172.21.15.19:0/2705251098 shutdown_connections 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.008+0000 7fc123dbc640 1 -- 172.21.15.19:0/2705251098 wait complete. 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.009+0000 7fc123dbc640 1 Processor -- start 2024-03-04T08:51:09.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.009+0000 7fc123dbc640 1 -- start start 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc11c06fb40 0x7fc11c1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0ccff0 con 0x7fc11c0d0af0 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0cce70 con 0x7fc11c06fb40 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc123dbc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0cd170 con 0x7fc11c15c050 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc121357640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc121357640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52854/0 (socket says 172.21.15.19:52854) 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc121357640 1 -- 172.21.15.19:0/4271614436 learned_addr learned my addr 172.21.15.19:0/4271614436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:09.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc122359640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.010+0000 7fc121b58640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc11c06fb40 0x7fc11c1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 -- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 msgr2=0x7fc11c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 -- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc11c06fb40 msgr2=0x7fc11c1f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc11c06fb40 0x7fc11c1f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 -- 172.21.15.19:0/4271614436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0b7340 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc121357640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc11000c390 tx=0x7fc11000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110017070 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110005ce0 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1100072f0 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c0b7620 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.011+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c154500 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.012+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c09fe60 con 0x7fc11c0d0af0 2024-03-04T08:51:09.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.012+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc11001a070 con 0x7fc11c0d0af0 2024-03-04T08:51:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.013+0000 7fc11a7fc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 0x7fc10806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.013+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1100894d0 con 0x7fc11c0d0af0 2024-03-04T08:51:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.013+0000 7fc121b58640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 0x7fc10806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.013+0000 7fc121b58640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 0x7fc10806d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc114036000 tx=0x7fc11403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.017+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc110057d90 con 0x7fc11c0d0af0 2024-03-04T08:51:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.196+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc11c1542e0 con 0x7fc11c0d0af0 2024-03-04T08:51:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.196+0000 7fc11a7fc640 1 -- 172.21.15.19:0/4271614436 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc110087e20 con 0x7fc11c0d0af0 2024-03-04T08:51:09.193 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 msgr2=0x7fc10806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 0x7fc10806d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc114036000 tx=0x7fc11403d040 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 msgr2=0x7fc11c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc11000c390 tx=0x7fc11000c850 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 shutdown_connections 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc11c15c050 0x7fc11c156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc11c0d0af0 0x7fc11c156200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc10806b4d0 0x7fc10806d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 --2- 172.21.15.19:0/4271614436 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc11c06fb40 0x7fc11c1f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 >> 172.21.15.19:0/4271614436 conn(0x7fc11c0b3800 msgr2=0x7fc11c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 shutdown_connections 2024-03-04T08:51:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.198+0000 7fc123dbc640 1 -- 172.21.15.19:0/4271614436 wait complete. 2024-03-04T08:51:09.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.313+0000 7f58d99a2640 1 Processor -- start 2024-03-04T08:51:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 -- start start 2024-03-04T08:51:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58d4161490 0x7f58d406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d40d0f90 con 0x7f58d406faa0 2024-03-04T08:51:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d406fec0 con 0x7f58d4161490 2024-03-04T08:51:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d99a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40cfef0 con 0x7f58d4162010 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.314+0000 7f58d89a0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58d4161490 0x7f58d406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d91a1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d3fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f58d406faa0 0x7f58d4161900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:34982/0 (socket says 172.21.15.19:34982) 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d3fff640 1 -- 172.21.15.19:0/2893353928 learned_addr learned my addr 172.21.15.19:0/2893353928 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d89a0640 1 -- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 msgr2=0x7f58d415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d89a0640 1 --2- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d89a0640 1 -- 172.21.15.19:0/2893353928 >> v1:172.21.15.204:6789/0 conn(0x7f58d406faa0 legacy=0x7f58d4161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.315+0000 7f58d89a0640 1 -- 172.21.15.19:0/2893353928 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40d01d0 con 0x7f58d4161490 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d89a0640 1 --2- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4161490 0x7f58d406f560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac2b34d3e098e8a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d37fe640 1 -- 172.21.15.19:0/2893353928 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc039070 con 0x7f58d4161490 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d37fe640 1 -- 172.21.15.19:0/2893353928 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc02cc50 con 0x7f58d4161490 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d37fe640 1 -- 172.21.15.19:0/2893353928 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc034440 con 0x7f58d4161490 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 -- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4161490 msgr2=0x7f58d406f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 --2- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4161490 0x7f58d406f560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc02bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 -- 172.21.15.19:0/2893353928 shutdown_connections 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 --2- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 --2- 172.21.15.19:0/2893353928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d4161490 0x7f58d406f560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 -- 172.21.15.19:0/2893353928 >> 172.21.15.19:0/2893353928 conn(0x7f58d40d1850 msgr2=0x7f58d40d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 -- 172.21.15.19:0/2893353928 shutdown_connections 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.316+0000 7f58d99a2640 1 -- 172.21.15.19:0/2893353928 wait complete. 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.317+0000 7f58d99a2640 1 Processor -- start 2024-03-04T08:51:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.317+0000 7f58d99a2640 1 -- start start 2024-03-04T08:51:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d40b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40d0a70 con 0x7f58d4161490 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40d0790 con 0x7f58d406faa0 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d99a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40cfbc0 con 0x7f58d4162010 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.318+0000 7f58d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d91a1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d40b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:42868/0 (socket says 172.21.15.19:42868) 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52858/0 (socket says 172.21.15.19:52858) 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 -- 172.21.15.19:0/1029706229 learned_addr learned my addr 172.21.15.19:0/1029706229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 -- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 msgr2=0x7f58d40b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d40b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 -- 172.21.15.19:0/1029706229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 msgr2=0x7f58d41f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 -- 172.21.15.19:0/1029706229 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d41f82f0 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d3fff640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d89a0640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc039050 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc045070 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d40b2760 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc03e610 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.319+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d40b2d20 con 0x7f58d406faa0 2024-03-04T08:51:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.320+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d40c8240 con 0x7f58d406faa0 2024-03-04T08:51:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.321+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58cc03e7b0 con 0x7f58d406faa0 2024-03-04T08:51:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.321+0000 7f58d17fa640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.321+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58cc0acb00 con 0x7f58d406faa0 2024-03-04T08:51:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.321+0000 7f58d3fff640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.322+0000 7f58d3fff640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 0x7f58b406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58d4160850 tx=0x7f58bc007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.326+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f58d40c8240 con 0x7f58d406faa0 2024-03-04T08:51:09.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.508+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58d41624a0 con 0x7f58d406faa0 2024-03-04T08:51:09.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.508+0000 7f58d17fa640 1 -- 172.21.15.19:0/1029706229 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58d41624a0 con 0x7f58d406faa0 2024-03-04T08:51:09.505 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 msgr2=0x7f58b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 0x7f58b406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58d4160850 tx=0x7f58bc007e80 comp rx=0 tx=0).stop 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 msgr2=0x7f58d40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 shutdown_connections 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58d4162010 0x7f58d40b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58d4161490 0x7f58d41f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58b406b4d0 0x7f58b406d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 --2- 172.21.15.19:0/1029706229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58d406faa0 0x7f58d40b46a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.510+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 >> 172.21.15.19:0/1029706229 conn(0x7f58d40d1850 msgr2=0x7f58d415f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:09.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.511+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 shutdown_connections 2024-03-04T08:51:09.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.511+0000 7f58d99a2640 1 -- 172.21.15.19:0/1029706229 wait complete. 2024-03-04T08:51:09.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-03-04T08:51:09.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 Processor -- start 2024-03-04T08:51:09.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 -- start start 2024-03-04T08:51:09.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 0x7f6fb815b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb8071f40 con 0x7f6fb81515e0 2024-03-04T08:51:09.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80cd2f0 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.623+0000 7f6fbdc47640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb8070a70 con 0x7f6fb80cce40 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52868/0 (socket says 172.21.15.19:52868) 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 0x7f6fb815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 -- 172.21.15.19:0/1209289469 learned_addr learned my addr 172.21.15.19:0/1209289469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 -- 172.21.15.19:0/1209289469 >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 msgr2=0x7f6fb815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 --2- 172.21.15.19:0/1209289469 >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 0x7f6fb815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 -- 172.21.15.19:0/1209289469 >> v1:172.21.15.204:6789/0 conn(0x7f6fb81515e0 legacy=0x7f6fb8071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb7fff640 1 -- 172.21.15.19:0/1209289469 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8070d50 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.624+0000 7f6fb6ffd640 1 --2- 172.21.15.19:0/1209289469 >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 0x7f6fb815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fb7fff640 1 --2- 172.21.15.19:0/1209289469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80cc110 tx=0x7f6fb0030380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d562748b901c7e31 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fb67fc640 1 -- 172.21.15.19:0/1209289469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb003c070 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fb67fc640 1 -- 172.21.15.19:0/1209289469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0037600 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fb67fc640 1 -- 172.21.15.19:0/1209289469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00379d0 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 -- 172.21.15.19:0/1209289469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cd7a0 msgr2=0x7f6fb80cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/1209289469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80cc110 tx=0x7f6fb0030380 comp rx=0 tx=0).stop 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 -- 172.21.15.19:0/1209289469 shutdown_connections 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/1209289469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb80cdb80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/1209289469 >> v2:172.21.15.204:3300/0 conn(0x7f6fb80cce40 0x7f6fb815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.625+0000 7f6fbdc47640 1 -- 172.21.15.19:0/1209289469 >> 172.21.15.19:0/1209289469 conn(0x7f6fb80cf8a0 msgr2=0x7f6fb80cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.626+0000 7f6fbdc47640 1 -- 172.21.15.19:0/1209289469 shutdown_connections 2024-03-04T08:51:09.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.626+0000 7f6fbdc47640 1 -- 172.21.15.19:0/1209289469 wait complete. 2024-03-04T08:51:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 Processor -- start 2024-03-04T08:51:09.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 -- start start 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb81515e0 0x7f6fb806d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80ce0c0 con 0x7f6fb80cce40 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8071310 con 0x7f6fb80cd7a0 2024-03-04T08:51:09.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.627+0000 7f6fbdc47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80cc3a0 con 0x7f6fb81515e0 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52878/0 (socket says 172.21.15.19:52878) 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 -- 172.21.15.19:0/2780459660 learned_addr learned my addr 172.21.15.19:0/2780459660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb7fff640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb81515e0 0x7f6fb806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb6ffd640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 -- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb81515e0 msgr2=0x7f6fb806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb81515e0 0x7f6fb806d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 -- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb80cd7a0 msgr2=0x7f6fb815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 -- 172.21.15.19:0/2780459660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb815dcf0 con 0x7f6fb80cce40 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fb77fe640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c340 tx=0x7f6fa800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8017070 con 0x7f6fb80cce40 2024-03-04T08:51:09.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8005310 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8003850 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb815dfd0 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.628+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb815e590 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.629+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8068840 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.630+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fa801a070 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.630+0000 7f6f9ffff640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 0x7f6fa406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.630+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fa8089290 con 0x7f6fb80cce40 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.630+0000 7f6fb6ffd640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 0x7f6fa406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:09.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.631+0000 7f6fb6ffd640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 0x7f6fa406d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b610 tx=0x7f6fac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:09.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.634+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6fa8057b50 con 0x7f6fb80cce40 2024-03-04T08:51:09.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:09.887+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f6fb804f330 con 0x7f6fb80cce40 2024-03-04T08:51:10.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.432+0000 7f6f9ffff640 1 -- 172.21.15.19:0/2780459660 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v45) v1 ==== 150+0+0 (secure 0 0 0) 0x7f6fa805bbf0 con 0x7f6fb80cce40 2024-03-04T08:51:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 msgr2=0x7f6fa406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 0x7f6fa406d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b610 tx=0x7f6fac008040 comp rx=0 tx=0).stop 2024-03-04T08:51:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 msgr2=0x7f6fb813e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c340 tx=0x7f6fa800c800 comp rx=0 tx=0).stop 2024-03-04T08:51:10.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 shutdown_connections 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6fb81515e0 0x7f6fb806d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6fa406b500 0x7f6fa406d9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb80cd7a0 0x7f6fb815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 --2- 172.21.15.19:0/2780459660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb80cce40 0x7f6fb813e5b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 >> 172.21.15.19:0/2780459660 conn(0x7f6fb80cf8a0 msgr2=0x7f6fb8072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 shutdown_connections 2024-03-04T08:51:10.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.436+0000 7f6fbdc47640 1 -- 172.21.15.19:0/2780459660 wait complete. 2024-03-04T08:51:10.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-04T08:51:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.554+0000 7f8c3dc65640 1 Processor -- start 2024-03-04T08:51:10.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.554+0000 7f8c3dc65640 1 -- start start 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c3dc65640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8c3806b6c0 0x7f8c3815e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c3dc65640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c3815ec40 0x7f8c38071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c3dc65640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380cea90 con 0x7f8c3815bbb0 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c3dc65640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c38161970 con 0x7f8c3815ec40 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c3dc65640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c381624f0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c3815ec40 0x7f8c38071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c3815ec40 0x7f8c38071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52888/0 (socket says 172.21.15.19:52888) 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 -- 172.21.15.19:0/2451726152 learned_addr learned my addr 172.21.15.19:0/2451726152 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c36ffd640 1 --2- 172.21.15.19:0/2451726152 >> v2:172.21.15.204:3300/0 conn(0x7f8c3806b6c0 0x7f8c3815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 -- 172.21.15.19:0/2451726152 >> v2:172.21.15.204:3300/0 conn(0x7f8c3806b6c0 msgr2=0x7f8c3815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 --2- 172.21.15.19:0/2451726152 >> v2:172.21.15.204:3300/0 conn(0x7f8c3806b6c0 0x7f8c3815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 -- 172.21.15.19:0/2451726152 >> v1:172.21.15.204:6789/0 conn(0x7f8c3815bbb0 legacy=0x7f8c3806afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.555+0000 7f8c37fff640 1 -- 172.21.15.19:0/2451726152 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38161bc0 con 0x7f8c3815ec40 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.556+0000 7f8c37fff640 1 --2- 172.21.15.19:0/2451726152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3815ec40 0x7f8c38071ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c3806dcc0 tx=0x7f8c3002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17e3cef87af82b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.556+0000 7f8c367fc640 1 -- 172.21.15.19:0/2451726152 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3002cb20 con 0x7f8c3815ec40 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.556+0000 7f8c367fc640 1 -- 172.21.15.19:0/2451726152 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3002ccc0 con 0x7f8c3815ec40 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.556+0000 7f8c367fc640 1 -- 172.21.15.19:0/2451726152 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30034610 con 0x7f8c3815ec40 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 -- 172.21.15.19:0/2451726152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3815ec40 msgr2=0x7f8c38071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/2451726152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3815ec40 0x7f8c38071ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c3806dcc0 tx=0x7f8c3002bf80 comp rx=0 tx=0).stop 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 -- 172.21.15.19:0/2451726152 shutdown_connections 2024-03-04T08:51:10.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/2451726152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3815ec40 0x7f8c38071ca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/2451726152 >> v2:172.21.15.204:3300/0 conn(0x7f8c3806b6c0 0x7f8c3815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 -- 172.21.15.19:0/2451726152 >> 172.21.15.19:0/2451726152 conn(0x7f8c380b2660 msgr2=0x7f8c380b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 -- 172.21.15.19:0/2451726152 shutdown_connections 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.557+0000 7f8c3dc65640 1 -- 172.21.15.19:0/2451726152 wait complete. 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.558+0000 7f8c3dc65640 1 Processor -- start 2024-03-04T08:51:10.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.558+0000 7f8c3dc65640 1 -- start start 2024-03-04T08:51:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 0x7f8c381f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c38160940 0x7f8c38160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3815f0d0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38162180 con 0x7f8c3815ec40 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380721e0 con 0x7f8c38160940 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52892/0 (socket says 172.21.15.19:52892) 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 -- 172.21.15.19:0/3611786560 learned_addr learned my addr 172.21.15.19:0/3611786560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c37fff640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c38160940 0x7f8c38160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c36ffd640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 0x7f8c381f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 -- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c38160940 msgr2=0x7f8c38160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c38160940 0x7f8c38160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 -- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 msgr2=0x7f8c381f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 0x7f8c381f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 -- 172.21.15.19:0/3611786560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3815f8a0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c36ffd640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 0x7f8c381f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:10.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c377fe640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c430 tx=0x7f8c2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280052d0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28005490 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28007260 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.559+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3815fb80 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.560+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38160140 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.561+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3806f6b0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.561+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c28007400 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.561+0000 7f8c1ffff640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 0x7f8c2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.561+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c28089630 con 0x7f8c3806b6c0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.561+0000 7f8c36ffd640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 0x7f8c2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.562+0000 7f8c36ffd640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 0x7f8c2406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c38072710 tx=0x7f8c2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.566+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c3806f6b0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.746+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c38068ff0 con 0x7f8c3806b6c0 2024-03-04T08:51:10.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.749+0000 7f8c1ffff640 1 -- 172.21.15.19:0/3611786560 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c2805ce20 con 0x7f8c3806b6c0 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 msgr2=0x7f8c2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 0x7f8c2406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c38072710 tx=0x7f8c2c008040 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 msgr2=0x7f8c38156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c430 tx=0x7f8c2800c8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 shutdown_connections 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c38160940 0x7f8c38160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c2406b4d0 0x7f8c2406d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c3815ec40 0x7f8c381f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 --2- 172.21.15.19:0/3611786560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c3806b6c0 0x7f8c38156010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 >> 172.21.15.19:0/3611786560 conn(0x7f8c380b2660 msgr2=0x7f8c380727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 shutdown_connections 2024-03-04T08:51:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:10.751+0000 7f8c3dc65640 1 -- 172.21.15.19:0/3611786560 wait complete. 2024-03-04T08:51:10.758 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-04T08:51:10.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:51:10.799 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:51:10.847 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-04T08:51:10.847 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:10.847 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:10.862 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:10.862 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:10.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.062+0000 7f73ec829640 1 Processor -- start 2024-03-04T08:51:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.062+0000 7f73ec829640 1 -- start start 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73ec829640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f73e815dfe0 0x7f73e80cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73ec829640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e80cf830 0x7f73e80d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73ec829640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80b3430 con 0x7f73e80d27f0 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73ec829640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80b31e0 con 0x7f73e80cf830 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73ec829640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80b3d60 con 0x7f73e815dfe0 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e80cf830 0x7f73e80d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73e5d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e80cf830 0x7f73e80d22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52906/0 (socket says 172.21.15.19:52906) 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73e5d9b640 1 -- 172.21.15.19:0/2010629093 learned_addr learned my addr 172.21.15.19:0/2010629093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.063+0000 7f73e659c640 1 --2- 172.21.15.19:0/2010629093 >> v2:172.21.15.204:3300/0 conn(0x7f73e815dfe0 0x7f73e80cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.064+0000 7f73e5d9b640 1 -- 172.21.15.19:0/2010629093 >> v2:172.21.15.204:3300/0 conn(0x7f73e815dfe0 msgr2=0x7f73e80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.064+0000 7f73e5d9b640 1 --2- 172.21.15.19:0/2010629093 >> v2:172.21.15.204:3300/0 conn(0x7f73e815dfe0 0x7f73e80cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.064+0000 7f73e5d9b640 1 -- 172.21.15.19:0/2010629093 >> v1:172.21.15.204:6789/0 conn(0x7f73e80d27f0 legacy=0x7f73e80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.064+0000 7f73e5d9b640 1 -- 172.21.15.19:0/2010629093 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80b3710 con 0x7f73e80cf830 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.064+0000 7f73e5d9b640 1 --2- 172.21.15.19:0/2010629093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e80d22b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009870 tx=0x7f73d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4587fc36b14b2e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73e559a640 1 -- 172.21.15.19:0/2010629093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0034070 con 0x7f73e80cf830 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73e559a640 1 -- 172.21.15.19:0/2010629093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0030860 con 0x7f73e80cf830 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73e559a640 1 -- 172.21.15.19:0/2010629093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0030c30 con 0x7f73e80cf830 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 -- 172.21.15.19:0/2010629093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 msgr2=0x7f73e80d22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 --2- 172.21.15.19:0/2010629093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e80d22b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009870 tx=0x7f73d002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 -- 172.21.15.19:0/2010629093 shutdown_connections 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 --2- 172.21.15.19:0/2010629093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e80d22b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 --2- 172.21.15.19:0/2010629093 >> v2:172.21.15.204:3300/0 conn(0x7f73e815dfe0 0x7f73e80cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 -- 172.21.15.19:0/2010629093 >> 172.21.15.19:0/2010629093 conn(0x7f73e80d3cd0 msgr2=0x7f73e80d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 -- 172.21.15.19:0/2010629093 shutdown_connections 2024-03-04T08:51:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.065+0000 7f73ec829640 1 -- 172.21.15.19:0/2010629093 wait complete. 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.066+0000 7f73ec829640 1 Processor -- start 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.066+0000 7f73ec829640 1 -- start start 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80d27f0 0x7f73e815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815dfe0 0x7f73e80b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80d1df0 con 0x7f73e80cf830 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80d1c70 con 0x7f73e815dfe0 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73ec829640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815e3c0 con 0x7f73e80d27f0 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73e659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73e659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52918/0 (socket says 172.21.15.19:52918) 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73e659c640 1 -- 172.21.15.19:0/2833205003 learned_addr learned my addr 172.21.15.19:0/2833205003 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73e5d9b640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80d27f0 0x7f73e815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.067+0000 7f73e6d9d640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815dfe0 0x7f73e80b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 -- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80d27f0 msgr2=0x7f73e815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80d27f0 0x7f73e815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 -- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815dfe0 msgr2=0x7f73e80b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815dfe0 0x7f73e80b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 -- 172.21.15.19:0/2833205003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e815e790 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73e659c640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73e000e9b0 tx=0x7f73e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0017070 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000c9a0 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e815ea70 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000cd90 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.068+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e815f030 con 0x7f73e80cf830 2024-03-04T08:51:11.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.069+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e804f330 con 0x7f73e80cf830 2024-03-04T08:51:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.069+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f73e001a070 con 0x7f73e80cf830 2024-03-04T08:51:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.070+0000 7f73deffd640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 0x7f73c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.070+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73e008a5c0 con 0x7f73e80cf830 2024-03-04T08:51:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.070+0000 7f73e5d9b640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 0x7f73c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.070+0000 7f73e5d9b640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 0x7f73c806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f73d0036000 tx=0x7f73d003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.074+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f73e0058d50 con 0x7f73e80cf830 2024-03-04T08:51:11.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.256+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e80b51f0 con 0x7f73e80cf830 2024-03-04T08:51:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.257+0000 7f73deffd640 1 -- 172.21.15.19:0/2833205003 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f73e005cdf0 con 0x7f73e80cf830 2024-03-04T08:51:11.254 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:11.254 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 msgr2=0x7f73c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 0x7f73c806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f73d0036000 tx=0x7f73d003b040 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 msgr2=0x7f73e8159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73e000e9b0 tx=0x7f73e000ee70 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 shutdown_connections 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f73c806b4d0 0x7f73c806d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f73e815dfe0 0x7f73e80b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f73e80d27f0 0x7f73e815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 --2- 172.21.15.19:0/2833205003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e80cf830 0x7f73e8159b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 >> 172.21.15.19:0/2833205003 conn(0x7f73e80d3cd0 msgr2=0x7f73e806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 shutdown_connections 2024-03-04T08:51:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.260+0000 7f73ec829640 1 -- 172.21.15.19:0/2833205003 wait complete. 2024-03-04T08:51:11.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:11.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:11.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.375+0000 7f7584046640 1 Processor -- start 2024-03-04T08:51:11.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 -- start start 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f757c06fd10 0x7f757c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0d0af0 0x7f757c0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0cd1e0 con 0x7f757c15c050 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0cd4b0 con 0x7f757c06fd10 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f7584046640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0cd790 con 0x7f757c0d0af0 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f75815e1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f757c06fd10 0x7f757c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f75815e1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f757c06fd10 0x7f757c0cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52934/0 (socket says 172.21.15.19:52934) 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.376+0000 7f75815e1640 1 -- 172.21.15.19:0/3306532725 learned_addr learned my addr 172.21.15.19:0/3306532725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75825e3640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0d0af0 0x7f757c0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75815e1640 1 -- 172.21.15.19:0/3306532725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0d0af0 msgr2=0x7f757c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75815e1640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0d0af0 0x7f757c0ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75815e1640 1 -- 172.21.15.19:0/3306532725 >> v1:172.21.15.204:6789/0 conn(0x7f757c15c050 legacy=0x7f757c06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75815e1640 1 -- 172.21.15.19:0/3306532725 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0cda70 con 0x7f757c06fd10 2024-03-04T08:51:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.377+0000 7f75815e1640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c06fd10 0x7f757c0cc760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db36145e0a256f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7580de0640 1 -- 172.21.15.19:0/3306532725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c035020 con 0x7f757c06fd10 2024-03-04T08:51:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7580de0640 1 -- 172.21.15.19:0/3306532725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c031640 con 0x7f757c06fd10 2024-03-04T08:51:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7580de0640 1 -- 172.21.15.19:0/3306532725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c02d040 con 0x7f757c06fd10 2024-03-04T08:51:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 -- 172.21.15.19:0/3306532725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c06fd10 msgr2=0x7f757c0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c06fd10 0x7f757c0cc760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f756c009870 tx=0x7f756c02b8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 -- 172.21.15.19:0/3306532725 shutdown_connections 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c0d0af0 0x7f757c0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 --2- 172.21.15.19:0/3306532725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c06fd10 0x7f757c0cc760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 -- 172.21.15.19:0/3306532725 >> 172.21.15.19:0/3306532725 conn(0x7f757c0b3800 msgr2=0x7f757c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 -- 172.21.15.19:0/3306532725 shutdown_connections 2024-03-04T08:51:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.378+0000 7f7584046640 1 -- 172.21.15.19:0/3306532725 wait complete. 2024-03-04T08:51:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.379+0000 7f7584046640 1 Processor -- start 2024-03-04T08:51:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 -- start start 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c06fd10 0x7f757c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0d0af0 0x7f757c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c06c240 con 0x7f757c15c050 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c06c0c0 con 0x7f757c0d0af0 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7584046640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c06c3c0 con 0x7f757c06fd10 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f75825e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f75825e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52936/0 (socket says 172.21.15.19:52936) 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f75825e3640 1 -- 172.21.15.19:0/1543936991 learned_addr learned my addr 172.21.15.19:0/1543936991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f75815e1640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0d0af0 0x7f757c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.380+0000 7f7581de2640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c06fd10 0x7f757c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 -- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c06fd10 msgr2=0x7f757c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c06fd10 0x7f757c14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 -- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0d0af0 msgr2=0x7f757c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0d0af0 0x7f757c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 -- 172.21.15.19:0/1543936991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c14ede0 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75825e3640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7574012320 tx=0x7f75740127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757401c020 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574018830 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c15a300 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574018c20 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.381+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c149020 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.382+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c148b70 con 0x7f757c15c050 2024-03-04T08:51:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.382+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7574005d10 con 0x7f757c15c050 2024-03-04T08:51:11.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.383+0000 7f75727fc640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.383+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f757408efa0 con 0x7f757c15c050 2024-03-04T08:51:11.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.383+0000 7f7581de2640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.383+0000 7f7581de2640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 0x7f756006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7578001780 tx=0x7f7578009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.387+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7574026030 con 0x7f757c15c050 2024-03-04T08:51:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.571+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f757c09fe60 con 0x7f757c15c050 2024-03-04T08:51:11.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.571+0000 7f75727fc640 1 -- 172.21.15.19:0/1543936991 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f757405d7d0 con 0x7f757c15c050 2024-03-04T08:51:11.567 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:11.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 msgr2=0x7f756006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 0x7f756006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7578001780 tx=0x7f7578009040 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 msgr2=0x7f757c147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7574012320 tx=0x7f75740127e0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 shutdown_connections 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f757c15c050 0x7f757c147ce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f757c0d0af0 0x7f757c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 --2- 172.21.15.19:0/1543936991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f757c06fd10 0x7f757c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 >> 172.21.15.19:0/1543936991 conn(0x7f757c0b3800 msgr2=0x7f757c0b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 shutdown_connections 2024-03-04T08:51:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.573+0000 7f7584046640 1 -- 172.21.15.19:0/1543936991 wait complete. 2024-03-04T08:51:11.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:11.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.687+0000 7f1b6b266640 1 Processor -- start 2024-03-04T08:51:11.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.688+0000 7f1b6b266640 1 -- start start 2024-03-04T08:51:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.688+0000 7f1b6b266640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.688+0000 7f1b6b266640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640b3320 con 0x7f1b6406c9f0 2024-03-04T08:51:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.688+0000 7f1b6b266640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640728d0 con 0x7f1b6415a220 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.688+0000 7f1b6b266640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640cf610 con 0x7f1b640719e0 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b69803640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b6406c9f0 0x7f1b6406ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60420/0 (socket says 172.21.15.19:60420) 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b69803640 1 -- 172.21.15.19:0/1543203627 learned_addr learned my addr 172.21.15.19:0/1543203627 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b68801640 1 --2- 172.21.15.19:0/1543203627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287061460 0 0) 0x7f1b640b3320 con 0x7f1b6406c9f0 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b50003520 con 0x7f1b6406c9f0 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673636397 0 0) 0x7f1b640728d0 con 0x7f1b6415a220 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b640b3320 con 0x7f1b6415a220 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b68801640 1 -- 172.21.15.19:0/1543203627 >> v1:172.21.15.204:6789/0 conn(0x7f1b6415a220 legacy=0x7f1b640712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b68801640 1 -- 172.21.15.19:0/1543203627 >> v1:172.21.15.19:6789/0 conn(0x7f1b6406c9f0 legacy=0x7f1b6406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.689+0000 7f1b68801640 1 -- 172.21.15.19:0/1543203627 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640b3590 con 0x7f1b640719e0 2024-03-04T08:51:11.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.690+0000 7f1b68801640 1 --2- 172.21.15.19:0/1543203627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640cf0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b540097d0 tx=0x7f1b5402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ef187c1ea7de3c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.690+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54035020 con 0x7f1b640719e0 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.690+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54031800 con 0x7f1b640719e0 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.690+0000 7f1b5bfff640 1 -- 172.21.15.19:0/1543203627 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54031bd0 con 0x7f1b640719e0 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 -- 172.21.15.19:0/1543203627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 msgr2=0x7f1b640cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 --2- 172.21.15.19:0/1543203627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640cf0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b540097d0 tx=0x7f1b5402b8a0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 -- 172.21.15.19:0/1543203627 shutdown_connections 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 --2- 172.21.15.19:0/1543203627 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640cf0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 -- 172.21.15.19:0/1543203627 >> 172.21.15.19:0/1543203627 conn(0x7f1b6406b190 msgr2=0x7f1b6406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 -- 172.21.15.19:0/1543203627 shutdown_connections 2024-03-04T08:51:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.691+0000 7f1b6b266640 1 -- 172.21.15.19:0/1543203627 wait complete. 2024-03-04T08:51:11.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.692+0000 7f1b6b266640 1 Processor -- start 2024-03-04T08:51:11.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.692+0000 7f1b6b266640 1 -- start start 2024-03-04T08:51:11.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b6406c9f0 0x7f1b640b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64072530 con 0x7f1b6415a220 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64072030 con 0x7f1b6406c9f0 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b6b266640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640726b0 con 0x7f1b640719e0 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52952/0 (socket says 172.21.15.19:52952) 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 -- 172.21.15.19:0/2225380516 learned_addr learned my addr 172.21.15.19:0/2225380516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b68801640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69002640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b6406c9f0 0x7f1b640b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 -- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 msgr2=0x7f1b640c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 -- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b6406c9f0 msgr2=0x7f1b640b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b6406c9f0 0x7f1b640b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 -- 172.21.15.19:0/2225380516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640c4c10 con 0x7f1b6415a220 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b69803640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cba0 tx=0x7f1b5c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.693+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b6415a220 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.694+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00ace0 con 0x7f1b6415a220 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.694+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640c4ef0 con 0x7f1b6415a220 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.694+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c012620 con 0x7f1b6415a220 2024-03-04T08:51:11.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.694+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640c54b0 con 0x7f1b6415a220 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.695+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b64068ff0 con 0x7f1b6415a220 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.695+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b5c01a070 con 0x7f1b6415a220 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.696+0000 7f1b59ffb640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 0x7f1b4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.696+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c089f00 con 0x7f1b6415a220 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.696+0000 7f1b69002640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 0x7f1b4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.696+0000 7f1b69002640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 0x7f1b4806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b600010e0 tx=0x7f1b60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.700+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1b5c0587c0 con 0x7f1b6415a220 2024-03-04T08:51:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.881+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b64070ba0 con 0x7f1b6415a220 2024-03-04T08:51:11.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.881+0000 7f1b59ffb640 1 -- 172.21.15.19:0/2225380516 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b5c05c860 con 0x7f1b6415a220 2024-03-04T08:51:11.878 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 msgr2=0x7f1b4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 0x7f1b4806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b600010e0 tx=0x7f1b60009040 comp rx=0 tx=0).stop 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 msgr2=0x7f1b6414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cba0 tx=0x7f1b5c00a430 comp rx=0 tx=0).stop 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 shutdown_connections 2024-03-04T08:51:11.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b6415a220 0x7f1b6414ff10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b640719e0 0x7f1b640c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b4806b4d0 0x7f1b4806d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 --2- 172.21.15.19:0/2225380516 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b6406c9f0 0x7f1b640b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 >> 172.21.15.19:0/2225380516 conn(0x7f1b6406b190 msgr2=0x7f1b64159480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 shutdown_connections 2024-03-04T08:51:11.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.884+0000 7f1b6b266640 1 -- 172.21.15.19:0/2225380516 wait complete. 2024-03-04T08:51:11.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.999+0000 7f0d4e20e640 1 Processor -- start 2024-03-04T08:51:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:11.999+0000 7f0d4e20e640 1 -- start start 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d4e20e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0d480cfa90 0x7f0d480cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d4e20e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d480b33a0 0x7f0d480b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d4e20e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d48158ac0 con 0x7f0d481586e0 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d4e20e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4815b2a0 con 0x7f0d480b33a0 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d4e20e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4815b540 con 0x7f0d480cfa90 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d480b33a0 0x7f0d480b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d480b33a0 0x7f0d480b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52964/0 (socket says 172.21.15.19:52964) 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 -- 172.21.15.19:0/1203355409 learned_addr learned my addr 172.21.15.19:0/1203355409 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d46ffd640 1 --2- 172.21.15.19:0/1203355409 >> v2:172.21.15.204:3300/0 conn(0x7f0d480cfa90 0x7f0d480cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 -- 172.21.15.19:0/1203355409 >> v2:172.21.15.204:3300/0 conn(0x7f0d480cfa90 msgr2=0x7f0d480cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 --2- 172.21.15.19:0/1203355409 >> v2:172.21.15.204:3300/0 conn(0x7f0d480cfa90 0x7f0d480cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 -- 172.21.15.19:0/1203355409 >> v1:172.21.15.204:6789/0 conn(0x7f0d481586e0 legacy=0x7f0d480aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.000+0000 7f0d47fff640 1 -- 172.21.15.19:0/1203355409 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4815b820 con 0x7f0d480b33a0 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d47fff640 1 --2- 172.21.15.19:0/1203355409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d480b37f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d48072e00 tx=0x7f0d4002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80528e8956cf9dc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d467fc640 1 -- 172.21.15.19:0/1203355409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4002cb20 con 0x7f0d480b33a0 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d467fc640 1 -- 172.21.15.19:0/1203355409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4002ccc0 con 0x7f0d480b33a0 2024-03-04T08:51:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d467fc640 1 -- 172.21.15.19:0/1203355409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40034610 con 0x7f0d480b33a0 2024-03-04T08:51:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d4e20e640 1 -- 172.21.15.19:0/1203355409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 msgr2=0x7f0d480b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.001+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/1203355409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d480b37f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d48072e00 tx=0x7f0d4002bf80 comp rx=0 tx=0).stop 2024-03-04T08:51:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 -- 172.21.15.19:0/1203355409 shutdown_connections 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/1203355409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d480b37f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/1203355409 >> v2:172.21.15.204:3300/0 conn(0x7f0d480cfa90 0x7f0d480cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 -- 172.21.15.19:0/1203355409 >> 172.21.15.19:0/1203355409 conn(0x7f0d4806b190 msgr2=0x7f0d4806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 -- 172.21.15.19:0/1203355409 shutdown_connections 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.002+0000 7f0d4e20e640 1 -- 172.21.15.19:0/1203355409 wait complete. 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.003+0000 7f0d4e20e640 1 Processor -- start 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.003+0000 7f0d4e20e640 1 -- start start 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d480cfa90 0x7f0d48144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d481586e0 0x7f0d481446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480af150 con 0x7f0d480b33a0 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815bde0 con 0x7f0d480cfa90 2024-03-04T08:51:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48071350 con 0x7f0d481586e0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52976/0 (socket says 172.21.15.19:52976) 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 -- 172.21.15.19:0/2048928064 learned_addr learned my addr 172.21.15.19:0/2048928064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d46ffd640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d480cfa90 0x7f0d48144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d47fff640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d481586e0 0x7f0d481446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 -- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d481586e0 msgr2=0x7f0d481446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d481586e0 0x7f0d481446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 -- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d480cfa90 msgr2=0x7f0d48144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d480cfa90 0x7f0d48144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 -- 172.21.15.19:0/2048928064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4814bd80 con 0x7f0d480b33a0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d477fe640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c400 tx=0x7f0d3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d380052d0 con 0x7f0d480b33a0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d38005490 con 0x7f0d480b33a0 2024-03-04T08:51:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38007260 con 0x7f0d480b33a0 2024-03-04T08:51:12.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4814baa0 con 0x7f0d480b33a0 2024-03-04T08:51:12.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.004+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4814d5a0 con 0x7f0d480b33a0 2024-03-04T08:51:12.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.005+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d480732b0 con 0x7f0d480b33a0 2024-03-04T08:51:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.006+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d38007400 con 0x7f0d480b33a0 2024-03-04T08:51:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.006+0000 7f0d2ffff640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 0x7f0d3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.006+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d38089770 con 0x7f0d480b33a0 2024-03-04T08:51:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.006+0000 7f0d46ffd640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 0x7f0d3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.007+0000 7f0d46ffd640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 0x7f0d3406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d480ae940 tx=0x7f0d3c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.010+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0d38057f00 con 0x7f0d480b33a0 2024-03-04T08:51:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.191+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d48068ff0 con 0x7f0d480b33a0 2024-03-04T08:51:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.191+0000 7f0d2ffff640 1 -- 172.21.15.19:0/2048928064 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d3805bfa0 con 0x7f0d480b33a0 2024-03-04T08:51:12.188 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.193+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 msgr2=0x7f0d3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.193+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 0x7f0d3406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d480ae940 tx=0x7f0d3c009190 comp rx=0 tx=0).stop 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.193+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 msgr2=0x7f0d4814fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.193+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c400 tx=0x7f0d3800c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.193+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 shutdown_connections 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0d481586e0 0x7f0d481446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0d3406b4d0 0x7f0d3406d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0d480cfa90 0x7f0d48144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 --2- 172.21.15.19:0/2048928064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d480b33a0 0x7f0d4814fc00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 >> 172.21.15.19:0/2048928064 conn(0x7f0d4806b190 msgr2=0x7f0d48157790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 shutdown_connections 2024-03-04T08:51:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.194+0000 7f0d4e20e640 1 -- 172.21.15.19:0/2048928064 wait complete. 2024-03-04T08:51:12.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.306+0000 7f7478bd7640 1 Processor -- start 2024-03-04T08:51:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.307+0000 7f7478bd7640 1 -- start start 2024-03-04T08:51:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.307+0000 7f7478bd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 0x7f74740708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.307+0000 7f7478bd7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747406d370 con 0x7f7474070e10 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.307+0000 7f7478bd7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747406d650 con 0x7f74741444c0 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.307+0000 7f7478bd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74741448a0 con 0x7f747415b2d0 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7472d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7474070e10 0x7f74740cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60424/0 (socket says 172.21.15.19:60424) 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7472d9d640 1 -- 172.21.15.19:0/1395917777 learned_addr learned my addr 172.21.15.19:0/1395917777 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7471d9b640 1 --2- 172.21.15.19:0/1395917777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 0x7f74740708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341987622 0 0) 0x7f747406d370 con 0x7f7474070e10 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c003520 con 0x7f7474070e10 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480579046 0 0) 0x7f747406d650 con 0x7f74741444c0 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747406d370 con 0x7f74741444c0 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7471d9b640 1 -- 172.21.15.19:0/1395917777 >> v1:172.21.15.204:6789/0 conn(0x7f74741444c0 legacy=0x7f747406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7471d9b640 1 -- 172.21.15.19:0/1395917777 >> v1:172.21.15.19:6789/0 conn(0x7f7474070e10 legacy=0x7f74740cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.308+0000 7f7471d9b640 1 -- 172.21.15.19:0/1395917777 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747406d930 con 0x7f747415b2d0 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f7471d9b640 1 --2- 172.21.15.19:0/1395917777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 0x7f74740708d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74680097d0 tx=0x7f746802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d41429e19f51f73 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468035020 con 0x7f747415b2d0 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7468031890 con 0x7f747415b2d0 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f747159a640 1 -- 172.21.15.19:0/1395917777 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468031c40 con 0x7f747415b2d0 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f7478bd7640 1 -- 172.21.15.19:0/1395917777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 msgr2=0x7f74740708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.309+0000 7f7478bd7640 1 --2- 172.21.15.19:0/1395917777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 0x7f74740708d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74680097d0 tx=0x7f746802b930 comp rx=0 tx=0).stop 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.310+0000 7f7478bd7640 1 -- 172.21.15.19:0/1395917777 shutdown_connections 2024-03-04T08:51:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.310+0000 7f7478bd7640 1 --2- 172.21.15.19:0/1395917777 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f747415b2d0 0x7f74740708d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.310+0000 7f7478bd7640 1 -- 172.21.15.19:0/1395917777 >> 172.21.15.19:0/1395917777 conn(0x7f74740b1c80 msgr2=0x7f74740cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.310+0000 7f7478bd7640 1 -- 172.21.15.19:0/1395917777 shutdown_connections 2024-03-04T08:51:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.310+0000 7f7478bd7640 1 -- 172.21.15.19:0/1395917777 wait complete. 2024-03-04T08:51:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.311+0000 7f7478bd7640 1 Processor -- start 2024-03-04T08:51:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.311+0000 7f7478bd7640 1 -- start start 2024-03-04T08:51:12.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7474070e10 0x7f74741eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74741444c0 0x7f747414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747406d110 con 0x7f747415b2d0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474071260 con 0x7f7474070e10 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747406def0 con 0x7f74741444c0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52984/0 (socket says 172.21.15.19:52984) 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 -- 172.21.15.19:0/2344636235 learned_addr learned my addr 172.21.15.19:0/2344636235 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7471d9b640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74741444c0 0x7f747414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f747259c640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7474070e10 0x7f74741eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 -- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74741444c0 msgr2=0x7f747414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74741444c0 0x7f747414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 -- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7474070e10 msgr2=0x7f74741eeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7474070e10 0x7f74741eeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 -- 172.21.15.19:0/2344636235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747414bb40 con 0x7f747415b2d0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7472d9d640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cb70 tx=0x7f746c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c017070 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00ad40 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747413b730 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c012600 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.312+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747413bcf0 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.313+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747404f330 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.314+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f746c01a070 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.314+0000 7f7462ffd640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.314+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f746c089eb0 con 0x7f747415b2d0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.314+0000 7f747259c640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.315+0000 7f747259c640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 0x7f745406d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7464007fd0 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.318+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f747414bb40 con 0x7f747415b2d0 2024-03-04T08:51:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.512+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f747413f8c0 con 0x7f747415b2d0 2024-03-04T08:51:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.513+0000 7f7462ffd640 1 -- 172.21.15.19:0/2344636235 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f746c0586e0 con 0x7f747415b2d0 2024-03-04T08:51:12.509 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 msgr2=0x7f745406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 0x7f745406d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7464007fd0 tx=0x7f7464009040 comp rx=0 tx=0).stop 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 msgr2=0x7f747413ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cb70 tx=0x7f746c00a430 comp rx=0 tx=0).stop 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 shutdown_connections 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f747415b2d0 0x7f747413ebf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f74741444c0 0x7f747414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 --2- 172.21.15.19:0/2344636235 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7474070e10 0x7f74741eeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 >> 172.21.15.19:0/2344636235 conn(0x7f74740b1c80 msgr2=0x7f747406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 shutdown_connections 2024-03-04T08:51:12.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.515+0000 7f7478bd7640 1 -- 172.21.15.19:0/2344636235 wait complete. 2024-03-04T08:51:12.522 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:12.522 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:12.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:12.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.682+0000 7f564d664640 1 Processor -- start 2024-03-04T08:51:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.682+0000 7f564d664640 1 -- start start 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f564d664640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f564815e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f564d664640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f564806b600 0x7f5648162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f564d664640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564815ea30 con 0x7f56480ce920 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f564d664640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5648161b70 con 0x7f564806b600 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f564d664640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564815ed10 con 0x7f564806b220 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f564806b600 0x7f5648162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f564806b600 0x7f5648162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52994/0 (socket says 172.21.15.19:52994) 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 -- 172.21.15.19:0/1006114373 learned_addr learned my addr 172.21.15.19:0/1006114373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f5646ffd640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f564815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 -- 172.21.15.19:0/1006114373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 msgr2=0x7f564815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f564815e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 -- 172.21.15.19:0/1006114373 >> v1:172.21.15.19:6789/0 conn(0x7f56480ce920 legacy=0x7f5648071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.683+0000 7f56477fe640 1 -- 172.21.15.19:0/1006114373 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564815eff0 con 0x7f564806b600 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.684+0000 7f56477fe640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f5648162000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5640009e50 tx=0x7f564002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d32d88ff585afd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.684+0000 7f56467fc640 1 -- 172.21.15.19:0/1006114373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564002cb00 con 0x7f564806b600 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.684+0000 7f56467fc640 1 -- 172.21.15.19:0/1006114373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564002cca0 con 0x7f564806b600 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.684+0000 7f56467fc640 1 -- 172.21.15.19:0/1006114373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640034610 con 0x7f564806b600 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 -- 172.21.15.19:0/1006114373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 msgr2=0x7f5648162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f5648162000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5640009e50 tx=0x7f564002bf60 comp rx=0 tx=0).stop 2024-03-04T08:51:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 -- 172.21.15.19:0/1006114373 shutdown_connections 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f5648162000 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 --2- 172.21.15.19:0/1006114373 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f564815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 -- 172.21.15.19:0/1006114373 >> 172.21.15.19:0/1006114373 conn(0x7f564806c0c0 msgr2=0x7f564806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 -- 172.21.15.19:0/1006114373 shutdown_connections 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.685+0000 7f564d664640 1 -- 172.21.15.19:0/1006114373 wait complete. 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.686+0000 7f564d664640 1 Processor -- start 2024-03-04T08:51:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.686+0000 7f564d664640 1 -- start start 2024-03-04T08:51:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f5648146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56480ce920 0x7f5648158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648072090 con 0x7f564806b600 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480ce200 con 0x7f56480ce920 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b3d80 con 0x7f564806b220 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53002/0 (socket says 172.21.15.19:53002) 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 -- 172.21.15.19:0/424540842 learned_addr learned my addr 172.21.15.19:0/424540842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f5646ffd640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f5648146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f56477fe640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56480ce920 0x7f5648158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 -- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 msgr2=0x7f5648146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f5648146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 -- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56480ce920 msgr2=0x7f5648158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56480ce920 0x7f5648158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 -- 172.21.15.19:0/424540842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480b4060 con 0x7f564806b600 2024-03-04T08:51:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563ffff640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f563000c400 tx=0x7f563000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300052d0 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630005490 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480b4340 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630007260 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.687+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481468b0 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.688+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564804f330 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.689+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5630007400 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.689+0000 7f563f7fe640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 0x7f562806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.689+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56300895d0 con 0x7f564806b600 2024-03-04T08:51:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.689+0000 7f5646ffd640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 0x7f562806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.690+0000 7f5646ffd640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 0x7f562806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5638009aa0 tx=0x7f5638009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.693+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5630057e90 con 0x7f564806b600 2024-03-04T08:51:12.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.875+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56480cdf00 con 0x7f564806b600 2024-03-04T08:51:12.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.876+0000 7f563f7fe640 1 -- 172.21.15.19:0/424540842 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f563005bf30 con 0x7f564806b600 2024-03-04T08:51:12.873 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:12.873 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 msgr2=0x7f562806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 0x7f562806d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5638009aa0 tx=0x7f5638009190 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 msgr2=0x7f56480b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f563000c400 tx=0x7f563000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 shutdown_connections 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f562806b4d0 0x7f562806d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56480ce920 0x7f5648158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f564806b600 0x7f56480b4e20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 --2- 172.21.15.19:0/424540842 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f564806b220 0x7f5648146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 >> 172.21.15.19:0/424540842 conn(0x7f564806c0c0 msgr2=0x7f5648161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 shutdown_connections 2024-03-04T08:51:12.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.878+0000 7f564d664640 1 -- 172.21.15.19:0/424540842 wait complete. 2024-03-04T08:51:12.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:12.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 Processor -- start 2024-03-04T08:51:12.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 -- start start 2024-03-04T08:51:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f415def0 0x7fd9f40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f406cab0 0x7fd9f40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f406d030 con 0x7fd9f40ce880 2024-03-04T08:51:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40cecf0 con 0x7fd9f406cab0 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.994+0000 7fd9f973e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cf1c0 con 0x7fd9f415def0 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f406cab0 0x7fd9f40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f406cab0 0x7fd9f40ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53018/0 (socket says 172.21.15.19:53018) 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 -- 172.21.15.19:0/3300544469 learned_addr learned my addr 172.21.15.19:0/3300544469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f2ffd640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f415def0 0x7fd9f40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 -- 172.21.15.19:0/3300544469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f415def0 msgr2=0x7fd9f40b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f415def0 0x7fd9f40b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 -- 172.21.15.19:0/3300544469 >> v1:172.21.15.19:6789/0 conn(0x7fd9f40ce880 legacy=0x7fd9f40cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.995+0000 7fd9f27fc640 1 -- 172.21.15.19:0/3300544469 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f406d310 con 0x7fd9f406cab0 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f27fc640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f406cab0 0x7fd9f40ce340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009870 tx=0x7fd9e802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d88360bdd1f89e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f1ffb640 1 -- 172.21.15.19:0/3300544469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e802f830 con 0x7fd9f406cab0 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f1ffb640 1 -- 172.21.15.19:0/3300544469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e802f9d0 con 0x7fd9f406cab0 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f1ffb640 1 -- 172.21.15.19:0/3300544469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e802fda0 con 0x7fd9f406cab0 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 -- 172.21.15.19:0/3300544469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f406cab0 msgr2=0x7fd9f40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f406cab0 0x7fd9f40ce340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009870 tx=0x7fd9e802ba10 comp rx=0 tx=0).stop 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 -- 172.21.15.19:0/3300544469 shutdown_connections 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f406cab0 0x7fd9f40ce340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 --2- 172.21.15.19:0/3300544469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f415def0 0x7fd9f40b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 -- 172.21.15.19:0/3300544469 >> 172.21.15.19:0/3300544469 conn(0x7fd9f40b3690 msgr2=0x7fd9f40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 -- 172.21.15.19:0/3300544469 shutdown_connections 2024-03-04T08:51:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.996+0000 7fd9f973e640 1 -- 172.21.15.19:0/3300544469 wait complete. 2024-03-04T08:51:12.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 Processor -- start 2024-03-04T08:51:12.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 -- start start 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 0x7fd9f40c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9f40ce880 0x7fd9f40cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cc3f0 con 0x7fd9f415def0 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cc760 con 0x7fd9f40ce880 2024-03-04T08:51:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.998+0000 7fd9f973e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f415e2d0 con 0x7fd9f406cab0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 0x7fd9f40c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f2ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 0x7fd9f40c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:52944/0 (socket says 172.21.15.19:52944) 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53034/0 (socket says 172.21.15.19:53034) 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f2ffd640 1 -- 172.21.15.19:0/1103028325 learned_addr learned my addr 172.21.15.19:0/1103028325 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f27fc640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9f40ce880 0x7fd9f40cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 -- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 msgr2=0x7fd9f40c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 0x7fd9f40c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 -- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9f40ce880 msgr2=0x7fd9f40cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9f40ce880 0x7fd9f40cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 -- 172.21.15.19:0/1103028325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40c7090 con 0x7fd9f415def0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f37fe640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c730 tx=0x7fd9ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec016020 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec006d50 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f40c5ab0 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec003bb0 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:12.999+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f40c6070 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.000+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f409fcf0 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.001+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9ec0050d0 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.001+0000 7fd9db7fe640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 0x7fd9e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.001+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9ec089e80 con 0x7fd9f415def0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.001+0000 7fd9f2ffd640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 0x7fd9e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.002+0000 7fd9f2ffd640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 0x7fd9e006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009b60 tx=0x7fd9e4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.005+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd9ec020020 con 0x7fd9f415def0 2024-03-04T08:51:13.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.187+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9f4068ff0 con 0x7fd9f415def0 2024-03-04T08:51:13.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.187+0000 7fd9db7fe640 1 -- 172.21.15.19:0/1103028325 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9ec0586c0 con 0x7fd9f415def0 2024-03-04T08:51:13.184 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 msgr2=0x7fd9e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 0x7fd9e006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009b60 tx=0x7fd9e4009190 comp rx=0 tx=0).stop 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 msgr2=0x7fd9f40c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c730 tx=0x7fd9ec00cbf0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 shutdown_connections 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415def0 0x7fd9f40c9dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd9e006b4d0 0x7fd9e006d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9f40ce880 0x7fd9f40cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 --2- 172.21.15.19:0/1103028325 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd9f406cab0 0x7fd9f40c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.189+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 >> 172.21.15.19:0/1103028325 conn(0x7fd9f40b3690 msgr2=0x7fd9f406f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.190+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 shutdown_connections 2024-03-04T08:51:13.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.190+0000 7fd9f973e640 1 -- 172.21.15.19:0/1103028325 wait complete. 2024-03-04T08:51:13.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.304+0000 7f750fc66640 1 Processor -- start 2024-03-04T08:51:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 -- start start 2024-03-04T08:51:13.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75080b33a0 0x7f75080b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7508158ac0 con 0x7f75081586e0 2024-03-04T08:51:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750815b2a0 con 0x7f75080b33a0 2024-03-04T08:51:13.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.305+0000 7f750fc66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750815b540 con 0x7f75080cfa90 2024-03-04T08:51:13.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:52956/0 (socket says 172.21.15.19:52956) 2024-03-04T08:51:13.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 -- 172.21.15.19:0/1531535416 learned_addr learned my addr 172.21.15.19:0/1531535416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750e203640 1 --2- 172.21.15.19:0/1531535416 >> v2:172.21.15.19:3300/0 conn(0x7f75080b33a0 0x7f75080b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 -- 172.21.15.19:0/1531535416 >> v2:172.21.15.19:3300/0 conn(0x7f75080b33a0 msgr2=0x7f75080b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 --2- 172.21.15.19:0/1531535416 >> v2:172.21.15.19:3300/0 conn(0x7f75080b33a0 0x7f75080b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 -- 172.21.15.19:0/1531535416 >> v1:172.21.15.19:6789/0 conn(0x7f75081586e0 legacy=0x7f75080aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.306+0000 7f750d201640 1 -- 172.21.15.19:0/1531535416 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750815b820 con 0x7f75080cfa90 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.307+0000 7f750d201640 1 --2- 172.21.15.19:0/1531535416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009870 tx=0x7f74f802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deef0bccc429d94 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.307+0000 7f750ca00640 1 -- 172.21.15.19:0/1531535416 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8034070 con 0x7f75080cfa90 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.307+0000 7f750ca00640 1 -- 172.21.15.19:0/1531535416 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8030840 con 0x7f75080cfa90 2024-03-04T08:51:13.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.307+0000 7f750ca00640 1 -- 172.21.15.19:0/1531535416 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8030c10 con 0x7f75080cfa90 2024-03-04T08:51:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 -- 172.21.15.19:0/1531535416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 msgr2=0x7f75080cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 --2- 172.21.15.19:0/1531535416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009870 tx=0x7f74f802b980 comp rx=0 tx=0).stop 2024-03-04T08:51:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 -- 172.21.15.19:0/1531535416 shutdown_connections 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 --2- 172.21.15.19:0/1531535416 >> v2:172.21.15.19:3300/0 conn(0x7f75080b33a0 0x7f75080b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 --2- 172.21.15.19:0/1531535416 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f75080cff10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 -- 172.21.15.19:0/1531535416 >> 172.21.15.19:0/1531535416 conn(0x7f750806b190 msgr2=0x7f750806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 -- 172.21.15.19:0/1531535416 shutdown_connections 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.308+0000 7f750fc66640 1 -- 172.21.15.19:0/1531535416 wait complete. 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.309+0000 7f750fc66640 1 Processor -- start 2024-03-04T08:51:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.309+0000 7f750fc66640 1 -- start start 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f7508145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75081586e0 0x7f7508147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080af150 con 0x7f75080b33a0 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750815bde0 con 0x7f75081586e0 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750fc66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7508071350 con 0x7f75080cfa90 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53052/0 (socket says 172.21.15.19:53052) 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 -- 172.21.15.19:0/2037046310 learned_addr learned my addr 172.21.15.19:0/2037046310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750e203640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75081586e0 0x7f7508147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750d201640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f7508145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 -- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 msgr2=0x7f7508145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f7508145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 -- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75081586e0 msgr2=0x7f7508147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75081586e0 0x7f7508147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 -- 172.21.15.19:0/2037046310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080a9990 con 0x7f75080b33a0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.310+0000 7f750da02640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f750400c430 tx=0x7f750400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.311+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040052d0 con 0x7f75080b33a0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.311+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504005490 con 0x7f75080b33a0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.311+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7508148520 con 0x7f75080b33a0 2024-03-04T08:51:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.311+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504007260 con 0x7f75080b33a0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.311+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75080ad250 con 0x7f75080b33a0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.312+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75080732b0 con 0x7f75080b33a0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.312+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7504007400 con 0x7f75080b33a0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.312+0000 7f74fe7fc640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 0x7f74ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.312+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75040895b0 con 0x7f75080b33a0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.312+0000 7f750d201640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 0x7f74ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.313+0000 7f750d201640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 0x7f74ec06d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f8036000 tx=0x7f74f8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.317+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7504057e70 con 0x7f75080b33a0 2024-03-04T08:51:13.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.497+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7508069fb0 con 0x7f75080b33a0 2024-03-04T08:51:13.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.497+0000 7f74fe7fc640 1 -- 172.21.15.19:0/2037046310 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f750405bf10 con 0x7f75080b33a0 2024-03-04T08:51:13.494 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:13.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 msgr2=0x7f74ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 0x7f74ec06d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f8036000 tx=0x7f74f8008030 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 msgr2=0x7f75080a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f750400c430 tx=0x7f750400c8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 shutdown_connections 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f74ec06b4d0 0x7f74ec06d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75081586e0 0x7f7508147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75080cfa90 0x7f7508145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 --2- 172.21.15.19:0/2037046310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75080b33a0 0x7f75080a9450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 >> 172.21.15.19:0/2037046310 conn(0x7f750806b190 msgr2=0x7f75080b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 shutdown_connections 2024-03-04T08:51:13.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.499+0000 7f750fc66640 1 -- 172.21.15.19:0/2037046310 wait complete. 2024-03-04T08:51:13.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.614+0000 7f788f3e9640 1 Processor -- start 2024-03-04T08:51:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.614+0000 7f788f3e9640 1 -- start start 2024-03-04T08:51:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.614+0000 7f788f3e9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78880d4860 0x7f78880d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.614+0000 7f788f3e9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78881618b0 con 0x7f78880b0e30 2024-03-04T08:51:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788f3e9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78880cf400 con 0x7f78881614d0 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788f3e9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78880d4cf0 con 0x7f78880d4860 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78880d4860 0x7f78880d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78880d4860 0x7f78880d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53066/0 (socket says 172.21.15.19:53066) 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 -- 172.21.15.19:0/1225672548 learned_addr learned my addr 172.21.15.19:0/1225672548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 -- 172.21.15.19:0/1225672548 >> v1:172.21.15.204:6789/0 conn(0x7f78881614d0 legacy=0x7f78880d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 -- 172.21.15.19:0/1225672548 >> v1:172.21.15.19:6789/0 conn(0x7f78880b0e30 legacy=0x7f78880b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.615+0000 7f788c984640 1 -- 172.21.15.19:0/1225672548 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78880cf6a0 con 0x7f78880d4860 2024-03-04T08:51:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788c984640 1 --2- 172.21.15.19:0/1225672548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78880d2020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7878009870 tx=0x7f787802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da57987ff067bd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f787ffff640 1 -- 172.21.15.19:0/1225672548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787802f840 con 0x7f78880d4860 2024-03-04T08:51:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f787ffff640 1 -- 172.21.15.19:0/1225672548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787802f9e0 con 0x7f78880d4860 2024-03-04T08:51:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f787ffff640 1 -- 172.21.15.19:0/1225672548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787802fdb0 con 0x7f78880d4860 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788f3e9640 1 -- 172.21.15.19:0/1225672548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 msgr2=0x7f78880d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788f3e9640 1 --2- 172.21.15.19:0/1225672548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78880d2020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7878009870 tx=0x7f787802ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788f3e9640 1 -- 172.21.15.19:0/1225672548 shutdown_connections 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788f3e9640 1 --2- 172.21.15.19:0/1225672548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78880d2020 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.616+0000 7f788f3e9640 1 -- 172.21.15.19:0/1225672548 >> 172.21.15.19:0/1225672548 conn(0x7f78880d3d40 msgr2=0x7f78880d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.617+0000 7f788f3e9640 1 -- 172.21.15.19:0/1225672548 shutdown_connections 2024-03-04T08:51:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.617+0000 7f788f3e9640 1 -- 172.21.15.19:0/1225672548 wait complete. 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 Processor -- start 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 -- start start 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78880b0e30 0x7f78881f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78881614d0 0x7f78881e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880b0910 con 0x7f78880d4860 2024-03-04T08:51:13.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880cfc60 con 0x7f78881614d0 2024-03-04T08:51:13.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788f3e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78880d2560 con 0x7f78880b0e30 2024-03-04T08:51:13.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788c984640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788c984640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53080/0 (socket says 172.21.15.19:53080) 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.618+0000 7f788c984640 1 -- 172.21.15.19:0/2679866477 learned_addr learned my addr 172.21.15.19:0/2679866477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788d986640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78881614d0 0x7f78881e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788d185640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78880b0e30 0x7f78881f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 -- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78880b0e30 msgr2=0x7f78881f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78880b0e30 0x7f78881f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 -- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78881614d0 msgr2=0x7f78881e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78881614d0 0x7f78881e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 -- 172.21.15.19:0/2679866477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78880ccd60 con 0x7f78880d4860 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788c984640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f787802ba60 tx=0x7f7878004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878047070 con 0x7f78880d4860 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878042480 con 0x7f78880d4860 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78880cd040 con 0x7f78880d4860 2024-03-04T08:51:13.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878042870 con 0x7f78880d4860 2024-03-04T08:51:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.619+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78880cd600 con 0x7f78880d4860 2024-03-04T08:51:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.620+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7888068ff0 con 0x7f78880d4860 2024-03-04T08:51:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.621+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f787804a070 con 0x7f78880d4860 2024-03-04T08:51:13.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.621+0000 7f787dffb640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 0x7f786c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.621+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78780ac660 con 0x7f78880d4860 2024-03-04T08:51:13.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.621+0000 7f788d185640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 0x7f786c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.622+0000 7f788d185640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 0x7f786c06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78840016e0 tx=0x7f7884009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.625+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7878033030 con 0x7f78880d4860 2024-03-04T08:51:13.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.806+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78880d1e70 con 0x7f78880d4860 2024-03-04T08:51:13.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.806+0000 7f787dffb640 1 -- 172.21.15.19:0/2679866477 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f787807ae90 con 0x7f78880d4860 2024-03-04T08:51:13.803 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 msgr2=0x7f786c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 0x7f786c06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78840016e0 tx=0x7f7884009040 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 msgr2=0x7f78881e77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f787802ba60 tx=0x7f7878004730 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 shutdown_connections 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f786c06b4d0 0x7f786c06d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f78881614d0 0x7f78881e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78880d4860 0x7f78881e77d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 --2- 172.21.15.19:0/2679866477 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f78880b0e30 0x7f78881f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 >> 172.21.15.19:0/2679866477 conn(0x7f78880d3d40 msgr2=0x7f78881e67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 shutdown_connections 2024-03-04T08:51:13.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.808+0000 7f788f3e9640 1 -- 172.21.15.19:0/2679866477 wait complete. 2024-03-04T08:51:13.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.922+0000 7fc1575f7640 1 Processor -- start 2024-03-04T08:51:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 -- start start 2024-03-04T08:51:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc1500d0d90 0x7fc1500ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1500c90f0 0x7fc1500ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500d25e0 con 0x7fc15015e000 2024-03-04T08:51:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1500c7c50 con 0x7fc1500c90f0 2024-03-04T08:51:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc1575f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1500d2880 con 0x7fc1500d0d90 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc155b94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1500c90f0 0x7fc1500ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc155b94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc1500c90f0 0x7fc1500ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53086/0 (socket says 172.21.15.19:53086) 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.923+0000 7fc155b94640 1 -- 172.21.15.19:0/2764431976 learned_addr learned my addr 172.21.15.19:0/2764431976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.924+0000 7fc154b92640 1 --2- 172.21.15.19:0/2764431976 >> v2:172.21.15.204:3300/0 conn(0x7fc1500d0d90 0x7fc1500ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.924+0000 7fc155b94640 1 -- 172.21.15.19:0/2764431976 >> v2:172.21.15.204:3300/0 conn(0x7fc1500d0d90 msgr2=0x7fc1500ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.924+0000 7fc155b94640 1 --2- 172.21.15.19:0/2764431976 >> v2:172.21.15.204:3300/0 conn(0x7fc1500d0d90 0x7fc1500ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.924+0000 7fc155b94640 1 -- 172.21.15.19:0/2764431976 >> v1:172.21.15.19:6789/0 conn(0x7fc15015e000 legacy=0x7fc1500d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.924+0000 7fc155b94640 1 -- 172.21.15.19:0/2764431976 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500d2b40 con 0x7fc1500c90f0 2024-03-04T08:51:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc155b94640 1 --2- 172.21.15.19:0/2764431976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500c90f0 0x7fc1500ced00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc15006b7f0 tx=0x7fc14802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c8c5cc37423c7d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc147fff640 1 -- 172.21.15.19:0/2764431976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14802cbb0 con 0x7fc1500c90f0 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc147fff640 1 -- 172.21.15.19:0/2764431976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14802cd50 con 0x7fc1500c90f0 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc147fff640 1 -- 172.21.15.19:0/2764431976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148034610 con 0x7fc1500c90f0 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 -- 172.21.15.19:0/2764431976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500c90f0 msgr2=0x7fc1500ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2764431976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500c90f0 0x7fc1500ced00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc15006b7f0 tx=0x7fc14802c010 comp rx=0 tx=0).stop 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 -- 172.21.15.19:0/2764431976 shutdown_connections 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2764431976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500c90f0 0x7fc1500ced00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2764431976 >> v2:172.21.15.204:3300/0 conn(0x7fc1500d0d90 0x7fc1500ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 -- 172.21.15.19:0/2764431976 >> 172.21.15.19:0/2764431976 conn(0x7fc1500d3cf0 msgr2=0x7fc1500d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 -- 172.21.15.19:0/2764431976 shutdown_connections 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.925+0000 7fc1575f7640 1 -- 172.21.15.19:0/2764431976 wait complete. 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.926+0000 7fc1575f7640 1 Processor -- start 2024-03-04T08:51:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 -- start start 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1500c90f0 0x7fc1501f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc15015e000 0x7fc15009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15015e3e0 con 0x7fc1500d0d90 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500d22d0 con 0x7fc1500c90f0 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc1575f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500d4810 con 0x7fc15015e000 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc154b92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc154b92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53090/0 (socket says 172.21.15.19:53090) 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc154b92640 1 -- 172.21.15.19:0/2959448141 learned_addr learned my addr 172.21.15.19:0/2959448141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc155393640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1500c90f0 0x7fc1501f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.927+0000 7fc155b94640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc15015e000 0x7fc15009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 -- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc15015e000 msgr2=0x7fc15009dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc15015e000 0x7fc15009dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 -- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1500c90f0 msgr2=0x7fc1501f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1500c90f0 0x7fc1501f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 -- 172.21.15.19:0/2959448141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15009fa80 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc154b92640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc14000e9b0 tx=0x7fc14000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000c9a0 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15009fd60 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000cd90 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.928+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500a0320 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.929+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15004f330 con 0x7fc1500d0d90 2024-03-04T08:51:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.930+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc14001a070 con 0x7fc1500d0d90 2024-03-04T08:51:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.930+0000 7fc145ffb640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 0x7fc13406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.930+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc14008a4e0 con 0x7fc1500d0d90 2024-03-04T08:51:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.930+0000 7fc155393640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 0x7fc13406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.931+0000 7fc155393640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 0x7fc13406d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0016e0 tx=0x7fc14c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:13.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:13.935+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc140058d10 con 0x7fc1500d0d90 2024-03-04T08:51:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.126+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1500b23d0 con 0x7fc1500d0d90 2024-03-04T08:51:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.126+0000 7fc145ffb640 1 -- 172.21.15.19:0/2959448141 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc14005cdb0 con 0x7fc1500d0d90 2024-03-04T08:51:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 msgr2=0x7fc13406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 0x7fc13406d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0016e0 tx=0x7fc14c009040 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 msgr2=0x7fc1501574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc14000e9b0 tx=0x7fc14000ee70 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 shutdown_connections 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc15015e000 0x7fc15009dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1500d0d90 0x7fc1501574f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc13406b4d0 0x7fc13406d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 --2- 172.21.15.19:0/2959448141 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1500c90f0 0x7fc1501f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 >> 172.21.15.19:0/2959448141 conn(0x7fc1500d3cf0 msgr2=0x7fc1500b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 shutdown_connections 2024-03-04T08:51:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.128+0000 7fc1575f7640 1 -- 172.21.15.19:0/2959448141 wait complete. 2024-03-04T08:51:14.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:51:14.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:14.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:14.163 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:14.163 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:51:14.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:14.163 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:51:14.223 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:14.223 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:14.240 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:14.240 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:14.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:14.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.402+0000 7f8e2dcfb640 1 Processor -- start 2024-03-04T08:51:14.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.402+0000 7f8e2dcfb640 1 -- start start 2024-03-04T08:51:14.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8e2815dfe0 0x7f8e280cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e280cf830 0x7f8e280d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e280d27f0 0x7f8e280d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280d2c50 con 0x7f8e280d27f0 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280b31e0 con 0x7f8e2815dfe0 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e2dcfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280b3d60 con 0x7f8e280cf830 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e280d27f0 0x7f8e280d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e280d27f0 0x7f8e280d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53100/0 (socket says 172.21.15.19:53100) 2024-03-04T08:51:14.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 -- 172.21.15.19:0/4188379847 learned_addr learned my addr 172.21.15.19:0/4188379847 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:14.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e26ffd640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e280cf830 0x7f8e280d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e277fe640 1 --2- 172.21.15.19:0/4188379847 >> v2:172.21.15.204:3300/0 conn(0x7f8e2815dfe0 0x7f8e280cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 -- 172.21.15.19:0/4188379847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e280cf830 msgr2=0x7f8e280d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e280cf830 0x7f8e280d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 -- 172.21.15.19:0/4188379847 >> v2:172.21.15.204:3300/0 conn(0x7f8e2815dfe0 msgr2=0x7f8e280cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 --2- 172.21.15.19:0/4188379847 >> v2:172.21.15.204:3300/0 conn(0x7f8e2815dfe0 0x7f8e280cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.403+0000 7f8e27fff640 1 -- 172.21.15.19:0/4188379847 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280b3430 con 0x7f8e280d27f0 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.404+0000 7f8e27fff640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e280d0300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e28067990 tx=0x7f8e2002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7995133c6e7206 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.404+0000 7f8e267fc640 1 -- 172.21.15.19:0/4188379847 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2002ca70 con 0x7f8e280d27f0 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.404+0000 7f8e267fc640 1 -- 172.21.15.19:0/4188379847 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2002cc10 con 0x7f8e280d27f0 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.404+0000 7f8e267fc640 1 -- 172.21.15.19:0/4188379847 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200343f0 con 0x7f8e280d27f0 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4188379847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 msgr2=0x7f8e280d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e280d0300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e28067990 tx=0x7f8e2002bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4188379847 shutdown_connections 2024-03-04T08:51:14.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e280d0300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4188379847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e280cf830 0x7f8e280d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4188379847 >> v2:172.21.15.204:3300/0 conn(0x7f8e2815dfe0 0x7f8e280cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4188379847 >> 172.21.15.19:0/4188379847 conn(0x7f8e280d3cd0 msgr2=0x7f8e280d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4188379847 shutdown_connections 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.405+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4188379847 wait complete. 2024-03-04T08:51:14.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.406+0000 7f8e2dcfb640 1 Processor -- start 2024-03-04T08:51:14.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.406+0000 7f8e2dcfb640 1 -- start start 2024-03-04T08:51:14.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e280cf830 0x7f8e2815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e2815dfe0 0x7f8e280b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280d1c70 con 0x7f8e280d27f0 2024-03-04T08:51:14.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280b39f0 con 0x7f8e280cf830 2024-03-04T08:51:14.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e2dcfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280d1df0 con 0x7f8e2815dfe0 2024-03-04T08:51:14.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53112/0 (socket says 172.21.15.19:53112) 2024-03-04T08:51:14.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 -- 172.21.15.19:0/4135596421 learned_addr learned my addr 172.21.15.19:0/4135596421 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:14.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e277fe640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e280cf830 0x7f8e2815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e27fff640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e2815dfe0 0x7f8e280b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 -- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e2815dfe0 msgr2=0x7f8e280b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e2815dfe0 0x7f8e280b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 -- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e280cf830 msgr2=0x7f8e2815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e280cf830 0x7f8e2815ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 -- 172.21.15.19:0/4135596421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e281609a0 con 0x7f8e280d27f0 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.407+0000 7f8e26ffd640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e860 tx=0x7f8e1c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.408+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c017070 con 0x7f8e280d27f0 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.408+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c00c940 con 0x7f8e280d27f0 2024-03-04T08:51:14.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.408+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e281f3470 con 0x7f8e280d27f0 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.408+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00cd10 con 0x7f8e280d27f0 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.408+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e28160f30 con 0x7f8e280d27f0 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.409+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2804f330 con 0x7f8e280d27f0 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.409+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e1c01a070 con 0x7f8e280d27f0 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.409+0000 7f8e0ffff640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 0x7f8e1406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.410+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e1c08a170 con 0x7f8e280d27f0 2024-03-04T08:51:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.410+0000 7f8e277fe640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 0x7f8e1406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.410+0000 7f8e277fe640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 0x7f8e1406d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009aa0 tx=0x7f8e18009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:14.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.415+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8e1c058a60 con 0x7f8e280d27f0 2024-03-04T08:51:14.423 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:14.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.601+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e2814e4f0 con 0x7f8e280d27f0 2024-03-04T08:51:14.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.602+0000 7f8e0ffff640 1 -- 172.21.15.19:0/4135596421 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f8e1c05cb00 con 0x7f8e280d27f0 2024-03-04T08:51:14.598 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:14.598 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:14.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 msgr2=0x7f8e1406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 0x7f8e1406d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009aa0 tx=0x7f8e18009190 comp rx=0 tx=0).stop 2024-03-04T08:51:14.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 msgr2=0x7f8e28160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e860 tx=0x7f8e1c00ed20 comp rx=0 tx=0).stop 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 shutdown_connections 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8e2815dfe0 0x7f8e280b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e280d27f0 0x7f8e28160460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8e1406b500 0x7f8e1406d9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 --2- 172.21.15.19:0/4135596421 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8e280cf830 0x7f8e2815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 >> 172.21.15.19:0/4135596421 conn(0x7f8e280d3cd0 msgr2=0x7f8e2806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 shutdown_connections 2024-03-04T08:51:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.604+0000 7f8e2dcfb640 1 -- 172.21.15.19:0/4135596421 wait complete. 2024-03-04T08:51:14.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:14.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:14.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.721+0000 7f6cc0d5e640 1 Processor -- start 2024-03-04T08:51:14.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.721+0000 7f6cc0d5e640 1 -- start start 2024-03-04T08:51:14.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cc0d5e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cc0d5e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc158ac0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cc0d5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc15b2a0 con 0x7f6cbc1586e0 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cc0d5e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc15b540 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cb9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cb9d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53120/0 (socket says 172.21.15.19:53120) 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.722+0000 7f6cb9d9b640 1 -- 172.21.15.19:0/369640460 learned_addr learned my addr 172.21.15.19:0/369640460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb959a640 1 -- 172.21.15.19:0/369640460 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607421646 0 0) 0x7f6cbc15b2a0 con 0x7f6cbc1586e0 2024-03-04T08:51:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb959a640 1 -- 172.21.15.19:0/369640460 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca4003520 con 0x7f6cbc1586e0 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb9d9b640 1 -- 172.21.15.19:0/369640460 >> v1:172.21.15.204:6789/0 conn(0x7f6cbc1586e0 legacy=0x7f6cbc0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb9d9b640 1 -- 172.21.15.19:0/369640460 >> v1:172.21.15.19:6789/0 conn(0x7f6cbc0b33a0 legacy=0x7f6cbc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb9d9b640 1 -- 172.21.15.19:0/369640460 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc15b820 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.723+0000 7f6cb9d9b640 1 --2- 172.21.15.19:0/369640460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009870 tx=0x7f6cac02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26e9eb10f322c90 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cb959a640 1 -- 172.21.15.19:0/369640460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac02f840 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cb959a640 1 -- 172.21.15.19:0/369640460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac02f9e0 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cb959a640 1 -- 172.21.15.19:0/369640460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac02fd90 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/369640460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc0cfa90 msgr2=0x7f6cbc0cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/369640460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009870 tx=0x7f6cac02ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/369640460 shutdown_connections 2024-03-04T08:51:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/369640460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc0cfa90 0x7f6cbc0cff40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/369640460 >> 172.21.15.19:0/369640460 conn(0x7f6cbc06b190 msgr2=0x7f6cbc06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/369640460 shutdown_connections 2024-03-04T08:51:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.724+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/369640460 wait complete. 2024-03-04T08:51:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 Processor -- start 2024-03-04T08:51:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 -- start start 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 0x7f6cbc0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0cfa90 0x7f6cbc1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0af150 con 0x7f6cbc1586e0 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc15bde0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cc0d5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc071350 con 0x7f6cbc0cfa90 2024-03-04T08:51:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.726+0000 7f6cbad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cbad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53124/0 (socket says 172.21.15.19:53124) 2024-03-04T08:51:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cbad9d640 1 -- 172.21.15.19:0/2783451873 learned_addr learned my addr 172.21.15.19:0/2783451873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 0x7f6cbc0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cb9d9b640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0cfa90 0x7f6cbc1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 -- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0cfa90 msgr2=0x7f6cbc1527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0cfa90 0x7f6cbc1527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 -- 172.21.15.19:0/2783451873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 msgr2=0x7f6cbc0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 -- 172.21.15.19:0/2783451873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc1f4cf0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cbad9d640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cba59c640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 0x7f6cbc0af2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c3c0 tx=0x7f6cb000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb00052f0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc1f4170 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0003830 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.727+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc1f4730 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.728+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc0732b0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.729+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6cb001a070 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.729+0000 7f6caaffd640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 0x7f6c9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.729+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cb0089330 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.729+0000 7f6cb9d9b640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 0x7f6c9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.730+0000 7f6cb9d9b640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 0x7f6c9c06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6cac036000 tx=0x7f6cac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.734+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6cb0057bf0 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.915+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cbc0cdc10 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.916+0000 7f6caaffd640 1 -- 172.21.15.19:0/2783451873 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cb005bc90 con 0x7f6cbc0b33a0 2024-03-04T08:51:14.912 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 msgr2=0x7f6c9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 0x7f6c9c06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6cac036000 tx=0x7f6cac008030 comp rx=0 tx=0).stop 2024-03-04T08:51:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 msgr2=0x7f6cbc0af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:14.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 0x7f6cbc0af2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c3c0 tx=0x7f6cb000c880 comp rx=0 tx=0).stop 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 shutdown_connections 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cbc1586e0 0x7f6cbc0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6cbc0cfa90 0x7f6cbc1527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c9c06b4d0 0x7f6c9c06d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 --2- 172.21.15.19:0/2783451873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6cbc0b33a0 0x7f6cbc0af2d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 >> 172.21.15.19:0/2783451873 conn(0x7f6cbc06b190 msgr2=0x7f6cbc0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 shutdown_connections 2024-03-04T08:51:14.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:14.918+0000 7f6cc0d5e640 1 -- 172.21.15.19:0/2783451873 wait complete. 2024-03-04T08:51:14.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.034+0000 7f668f18a640 1 Processor -- start 2024-03-04T08:51:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.034+0000 7f668f18a640 1 -- start start 2024-03-04T08:51:15.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668f18a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f668815c050 0x7f668806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668f18a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f66880d0af0 0x7f66880cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668f18a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880cd4b0 con 0x7f668806fb40 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668f18a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668806ffb0 con 0x7f66880d0af0 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668f18a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880cd790 con 0x7f668815c050 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668d727640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f66880d0af0 0x7f66880cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668d727640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f66880d0af0 0x7f66880cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53136/0 (socket says 172.21.15.19:53136) 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668d727640 1 -- 172.21.15.19:0/397388546 learned_addr learned my addr 172.21.15.19:0/397388546 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.035+0000 7f668cf26640 1 --2- 172.21.15.19:0/397388546 >> v2:172.21.15.204:3300/0 conn(0x7f668815c050 0x7f668806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f668d727640 1 -- 172.21.15.19:0/397388546 >> v2:172.21.15.204:3300/0 conn(0x7f668815c050 msgr2=0x7f668806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f668d727640 1 --2- 172.21.15.19:0/397388546 >> v2:172.21.15.204:3300/0 conn(0x7f668815c050 0x7f668806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f668d727640 1 -- 172.21.15.19:0/397388546 >> v1:172.21.15.19:6789/0 conn(0x7f668806fb40 legacy=0x7f66880cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f668d727640 1 -- 172.21.15.19:0/397388546 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880cda70 con 0x7f66880d0af0 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f668d727640 1 --2- 172.21.15.19:0/397388546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880cce70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6688070ef0 tx=0x7f668002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf182007155fe9e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.036+0000 7f66877fe640 1 -- 172.21.15.19:0/397388546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668002ca80 con 0x7f66880d0af0 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f66877fe640 1 -- 172.21.15.19:0/397388546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668002cc20 con 0x7f66880d0af0 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f66877fe640 1 -- 172.21.15.19:0/397388546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800343f0 con 0x7f66880d0af0 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 -- 172.21.15.19:0/397388546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 msgr2=0x7f66880cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 --2- 172.21.15.19:0/397388546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880cce70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6688070ef0 tx=0x7f668002bee0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 -- 172.21.15.19:0/397388546 shutdown_connections 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 --2- 172.21.15.19:0/397388546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880cce70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 --2- 172.21.15.19:0/397388546 >> v2:172.21.15.204:3300/0 conn(0x7f668815c050 0x7f668806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 -- 172.21.15.19:0/397388546 >> 172.21.15.19:0/397388546 conn(0x7f66880b3800 msgr2=0x7f66880b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 -- 172.21.15.19:0/397388546 shutdown_connections 2024-03-04T08:51:15.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.037+0000 7f668f18a640 1 -- 172.21.15.19:0/397388546 wait complete. 2024-03-04T08:51:15.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.038+0000 7f668f18a640 1 Processor -- start 2024-03-04T08:51:15.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.038+0000 7f668f18a640 1 -- start start 2024-03-04T08:51:15.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f668806fb40 0x7f668814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f668815c050 0x7f668814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688165c30 con 0x7f66880d0af0 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688165ab0 con 0x7f668815c050 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668f18a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6688165db0 con 0x7f668806fb40 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f6687fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f6687fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53144/0 (socket says 172.21.15.19:53144) 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f6687fff640 1 -- 172.21.15.19:0/1248419146 learned_addr learned my addr 172.21.15.19:0/1248419146 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668d727640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f668815c050 0x7f668814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.039+0000 7f668cf26640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f668806fb40 0x7f668814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 -- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f668806fb40 msgr2=0x7f668814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f668806fb40 0x7f668814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 -- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f668815c050 msgr2=0x7f668814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f668815c050 0x7f668814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 -- 172.21.15.19:0/1248419146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668814c440 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f6687fff640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f667400c3c0 tx=0x7f667400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740052d0 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674005490 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674007260 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880d1f70 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.040+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880d2530 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.041+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66880cc340 con 0x7f66880d0af0 2024-03-04T08:51:15.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.041+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6674007400 con 0x7f66880d0af0 2024-03-04T08:51:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.042+0000 7f66857fa640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 0x7f666c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.042+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6674089570 con 0x7f66880d0af0 2024-03-04T08:51:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.042+0000 7f668cf26640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 0x7f666c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.042+0000 7f668cf26640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 0x7f666c06d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f667c009aa0 tx=0x7f667c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.046+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f66880cc340 con 0x7f66880d0af0 2024-03-04T08:51:15.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.226+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6688068ff0 con 0x7f66880d0af0 2024-03-04T08:51:15.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.226+0000 7f66857fa640 1 -- 172.21.15.19:0/1248419146 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6674057e30 con 0x7f66880d0af0 2024-03-04T08:51:15.223 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 msgr2=0x7f666c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 0x7f666c06d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f667c009aa0 tx=0x7f667c009190 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 msgr2=0x7f66880d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f667400c3c0 tx=0x7f667400c880 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 shutdown_connections 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f666c06b4d0 0x7f666c06d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f668815c050 0x7f668814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66880d0af0 0x7f66880d18e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 --2- 172.21.15.19:0/1248419146 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f668806fb40 0x7f668814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 >> 172.21.15.19:0/1248419146 conn(0x7f66880b3800 msgr2=0x7f66880b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 shutdown_connections 2024-03-04T08:51:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.228+0000 7f668f18a640 1 -- 172.21.15.19:0/1248419146 wait complete. 2024-03-04T08:51:15.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.343+0000 7f7b8ede9640 1 Processor -- start 2024-03-04T08:51:15.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.343+0000 7f7b8ede9640 1 -- start start 2024-03-04T08:51:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8ede9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b8815c050 0x7f7b8806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8ede9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880cd4b0 con 0x7f7b8806fb40 2024-03-04T08:51:15.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8ede9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880cd790 con 0x7f7b880d0af0 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8ede9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8806ffb0 con 0x7f7b8815c050 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b87fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7b8806fb40 0x7f7b880cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60502/0 (socket says 172.21.15.19:60502) 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b87fff640 1 -- 172.21.15.19:0/2489720653 learned_addr learned my addr 172.21.15.19:0/2489720653 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8cb85640 1 --2- 172.21.15.19:0/2489720653 >> v2:172.21.15.204:3300/0 conn(0x7f7b8815c050 0x7f7b8806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b877fe640 1 -- 172.21.15.19:0/2489720653 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236561999 0 0) 0x7f7b880cd4b0 con 0x7f7b8806fb40 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8cb85640 1 -- 172.21.15.19:0/2489720653 >> v1:172.21.15.204:6789/0 conn(0x7f7b880d0af0 legacy=0x7f7b88165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8cb85640 1 -- 172.21.15.19:0/2489720653 >> v1:172.21.15.19:6789/0 conn(0x7f7b8806fb40 legacy=0x7f7b880cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.344+0000 7f7b8cb85640 1 -- 172.21.15.19:0/2489720653 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880cda70 con 0x7f7b8815c050 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.345+0000 7f7b8cb85640 1 --2- 172.21.15.19:0/2489720653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b8806f600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009720 tx=0x7f7b7c02b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525bbde440b22ca1 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.345+0000 7f7b877fe640 1 -- 172.21.15.19:0/2489720653 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c037070 con 0x7f7b8815c050 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.345+0000 7f7b877fe640 1 -- 172.21.15.19:0/2489720653 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c030710 con 0x7f7b8815c050 2024-03-04T08:51:15.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.345+0000 7f7b877fe640 1 -- 172.21.15.19:0/2489720653 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c030ae0 con 0x7f7b8815c050 2024-03-04T08:51:15.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 -- 172.21.15.19:0/2489720653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 msgr2=0x7f7b8806f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/2489720653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b8806f600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009720 tx=0x7f7b7c02b6a0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 -- 172.21.15.19:0/2489720653 shutdown_connections 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/2489720653 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b8806f600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 -- 172.21.15.19:0/2489720653 >> 172.21.15.19:0/2489720653 conn(0x7f7b880b3800 msgr2=0x7f7b880b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 -- 172.21.15.19:0/2489720653 shutdown_connections 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.346+0000 7f7b8ede9640 1 -- 172.21.15.19:0/2489720653 wait complete. 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.347+0000 7f7b8ede9640 1 Processor -- start 2024-03-04T08:51:15.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.347+0000 7f7b8ede9640 1 -- start start 2024-03-04T08:51:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 0x7f7b88157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b88150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880ccff0 con 0x7f7b8806fb40 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880cce70 con 0x7f7b8815c050 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8ede9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880cd170 con 0x7f7b880d0af0 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8cb85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8cb85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53154/0 (socket says 172.21.15.19:53154) 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8cb85640 1 -- 172.21.15.19:0/1448440947 learned_addr learned my addr 172.21.15.19:0/1448440947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 0x7f7b88157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.348+0000 7f7b8d386640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b88150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 -- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 msgr2=0x7f7b88150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b88150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 -- 172.21.15.19:0/1448440947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 msgr2=0x7f7b881561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 -- 172.21.15.19:0/1448440947 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88157570 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b8d386640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b88150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b8cb85640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b87fff640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 0x7f7b88157030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c3e0 tx=0x7f7b7400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740074e0 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b740047e0 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b88155430 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74004c10 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.349+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b881559f0 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.350+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8809fe60 con 0x7f7b880d0af0 2024-03-04T08:51:15.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.351+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b74011070 con 0x7f7b880d0af0 2024-03-04T08:51:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.351+0000 7f7b857fa640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 0x7f7b6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.351+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b74089b90 con 0x7f7b880d0af0 2024-03-04T08:51:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.351+0000 7f7b8cb85640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 0x7f7b6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.352+0000 7f7b8cb85640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 0x7f7b6c06d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009720 tx=0x7f7b7c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.356+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7b740583d0 con 0x7f7b880d0af0 2024-03-04T08:51:15.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.538+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b88068ff0 con 0x7f7b880d0af0 2024-03-04T08:51:15.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.538+0000 7f7b857fa640 1 -- 172.21.15.19:0/1448440947 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b7405c470 con 0x7f7b880d0af0 2024-03-04T08:51:15.535 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:15.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 msgr2=0x7f7b6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 0x7f7b6c06d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009720 tx=0x7f7b7c008030 comp rx=0 tx=0).stop 2024-03-04T08:51:15.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 msgr2=0x7f7b88157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 0x7f7b88157030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c3e0 tx=0x7f7b7400c8a0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 shutdown_connections 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b6c06b4d0 0x7f7b6c06d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b8815c050 0x7f7b88150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b880d0af0 0x7f7b88157030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 --2- 172.21.15.19:0/1448440947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b8806fb40 0x7f7b881561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 >> 172.21.15.19:0/1448440947 conn(0x7f7b880b3800 msgr2=0x7f7b880aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 shutdown_connections 2024-03-04T08:51:15.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.541+0000 7f7b8ede9640 1 -- 172.21.15.19:0/1448440947 wait complete. 2024-03-04T08:51:15.548 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:15.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.654+0000 7f9a77ceb640 1 Processor -- start 2024-03-04T08:51:15.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.654+0000 7f9a77ceb640 1 -- start start 2024-03-04T08:51:15.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a77ceb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a70158880 0x7f9a7006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a77ceb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a7006cb90 0x7f9a700cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a77ceb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7006d030 con 0x7f9a7015b380 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a77ceb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7006d310 con 0x7f9a70158880 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a77ceb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006d5f0 con 0x7f9a7006cb90 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a75a87640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a70158880 0x7f9a7006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a75a87640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a70158880 0x7f9a7006c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53158/0 (socket says 172.21.15.19:53158) 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a75a87640 1 -- 172.21.15.19:0/3342169279 learned_addr learned my addr 172.21.15.19:0/3342169279 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.655+0000 7f9a76288640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a7006cb90 0x7f9a700cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a75a87640 1 -- 172.21.15.19:0/3342169279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a7006cb90 msgr2=0x7f9a700cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a75a87640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a7006cb90 0x7f9a700cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a75a87640 1 -- 172.21.15.19:0/3342169279 >> v1:172.21.15.204:6789/0 conn(0x7f9a7015b380 legacy=0x7f9a700708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a75a87640 1 -- 172.21.15.19:0/3342169279 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7006d8d0 con 0x7f9a70158880 2024-03-04T08:51:15.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a75a87640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a70158880 0x7f9a7006c650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009870 tx=0x7f9a6c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43d7f3c51e6272f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a74a85640 1 -- 172.21.15.19:0/3342169279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c034070 con 0x7f9a70158880 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a74a85640 1 -- 172.21.15.19:0/3342169279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c030840 con 0x7f9a70158880 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.656+0000 7f9a74a85640 1 -- 172.21.15.19:0/3342169279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c030c10 con 0x7f9a70158880 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 -- 172.21.15.19:0/3342169279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a70158880 msgr2=0x7f9a7006c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a70158880 0x7f9a7006c650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009870 tx=0x7f9a6c02b980 comp rx=0 tx=0).stop 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 -- 172.21.15.19:0/3342169279 shutdown_connections 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a7006cb90 0x7f9a700cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/3342169279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a70158880 0x7f9a7006c650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 -- 172.21.15.19:0/3342169279 >> 172.21.15.19:0/3342169279 conn(0x7f9a700b1c80 msgr2=0x7f9a700cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 -- 172.21.15.19:0/3342169279 shutdown_connections 2024-03-04T08:51:15.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.657+0000 7f9a77ceb640 1 -- 172.21.15.19:0/3342169279 wait complete. 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.658+0000 7f9a77ceb640 1 Processor -- start 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.658+0000 7f9a77ceb640 1 -- start start 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a7006cb90 0x7f9a70159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a70158880 0x7f9a701e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70071160 con 0x7f9a7015b380 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70070fe0 con 0x7f9a7006cb90 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a77ceb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700cdd00 con 0x7f9a70158880 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53162/0 (socket says 172.21.15.19:53162) 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 -- 172.21.15.19:0/2910924757 learned_addr learned my addr 172.21.15.19:0/2910924757 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a75286640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a70158880 0x7f9a701e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a75a87640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a7006cb90 0x7f9a70159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 -- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a70158880 msgr2=0x7f9a701e54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a70158880 0x7f9a701e54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 -- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a7006cb90 msgr2=0x7f9a70159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a7006cb90 0x7f9a70159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.659+0000 7f9a76288640 1 -- 172.21.15.19:0/2910924757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a701e5c20 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a76288640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800ef90 tx=0x7f9a6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68018020 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a68014480 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a701e5f00 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68014870 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.660+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a701e64c0 con 0x7f9a7015b380 2024-03-04T08:51:15.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.661+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7004f330 con 0x7f9a7015b380 2024-03-04T08:51:15.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.661+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a68005d10 con 0x7f9a7015b380 2024-03-04T08:51:15.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.662+0000 7f9a667fc640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 0x7f9a5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.662+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a6808aef0 con 0x7f9a7015b380 2024-03-04T08:51:15.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.662+0000 7f9a75a87640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 0x7f9a5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.662+0000 7f9a75a87640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 0x7f9a5406d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c036000 tx=0x7f9a6c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.666+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9a68022030 con 0x7f9a7015b380 2024-03-04T08:51:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.858+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a700d0300 con 0x7f9a7015b380 2024-03-04T08:51:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.859+0000 7f9a667fc640 1 -- 172.21.15.19:0/2910924757 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a68010040 con 0x7f9a7015b380 2024-03-04T08:51:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 msgr2=0x7f9a5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 0x7f9a5406d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c036000 tx=0x7f9a6c008030 comp rx=0 tx=0).stop 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 msgr2=0x7f9a7014c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800ef90 tx=0x7f9a6800c490 comp rx=0 tx=0).stop 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 shutdown_connections 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a7015b380 0x7f9a7014c280 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9a70158880 0x7f9a701e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9a5406b4d0 0x7f9a5406d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 --2- 172.21.15.19:0/2910924757 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9a7006cb90 0x7f9a70159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.860+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 >> 172.21.15.19:0/2910924757 conn(0x7f9a700b1c80 msgr2=0x7f9a700708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.861+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 shutdown_connections 2024-03-04T08:51:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.861+0000 7f9a77ceb640 1 -- 172.21.15.19:0/2910924757 wait complete. 2024-03-04T08:51:15.867 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:15.868 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:15.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.987+0000 7f4d9e415640 1 Processor -- start 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.987+0000 7f4d9e415640 1 -- start start 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d9e415640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d980d22b0 0x7f4d980d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d9e415640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980b3430 con 0x7f4d980b41f0 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d9e415640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980b3710 con 0x7f4d9815dfe0 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d9e415640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980d2c50 con 0x7f4d980d22b0 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d977fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d980d22b0 0x7f4d980d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d977fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d980d22b0 0x7f4d980d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53174/0 (socket says 172.21.15.19:53174) 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.988+0000 7f4d977fe640 1 -- 172.21.15.19:0/2337915097 learned_addr learned my addr 172.21.15.19:0/2337915097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d977fe640 1 -- 172.21.15.19:0/2337915097 >> v1:172.21.15.204:6789/0 conn(0x7f4d9815dfe0 legacy=0x7f4d980cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d977fe640 1 -- 172.21.15.19:0/2337915097 >> v1:172.21.15.19:6789/0 conn(0x7f4d980b41f0 legacy=0x7f4d980b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d977fe640 1 -- 172.21.15.19:0/2337915097 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980b39f0 con 0x7f4d980d22b0 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d977fe640 1 --2- 172.21.15.19:0/2337915097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980d22b0 0x7f4d980d2710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4d880098a0 tx=0x7f4d8802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10569949097c520 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d96ffd640 1 -- 172.21.15.19:0/2337915097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802f840 con 0x7f4d980d22b0 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d96ffd640 1 -- 172.21.15.19:0/2337915097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8802f9e0 con 0x7f4d980d22b0 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.989+0000 7f4d96ffd640 1 -- 172.21.15.19:0/2337915097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802fdb0 con 0x7f4d980d22b0 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 -- 172.21.15.19:0/2337915097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980d22b0 msgr2=0x7f4d980d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 --2- 172.21.15.19:0/2337915097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980d22b0 0x7f4d980d2710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4d880098a0 tx=0x7f4d8802ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 -- 172.21.15.19:0/2337915097 shutdown_connections 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 --2- 172.21.15.19:0/2337915097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980d22b0 0x7f4d980d2710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 -- 172.21.15.19:0/2337915097 >> 172.21.15.19:0/2337915097 conn(0x7f4d980d3cd0 msgr2=0x7f4d980d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 -- 172.21.15.19:0/2337915097 shutdown_connections 2024-03-04T08:51:15.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.990+0000 7f4d9e415640 1 -- 172.21.15.19:0/2337915097 wait complete. 2024-03-04T08:51:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.991+0000 7f4d9e415640 1 Processor -- start 2024-03-04T08:51:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.991+0000 7f4d9e415640 1 -- start start 2024-03-04T08:51:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d980d22b0 0x7f4d9815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9815dfe0 0x7f4d9815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980b3d60 con 0x7f4d980b41f0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980b31e0 con 0x7f4d9815dfe0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9e415640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980d1c70 con 0x7f4d980d22b0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53176/0 (socket says 172.21.15.19:53176) 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 -- 172.21.15.19:0/141848808 learned_addr learned my addr 172.21.15.19:0/141848808 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d9c9b2640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9815dfe0 0x7f4d9815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d977fe640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d980d22b0 0x7f4d9815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 -- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d980d22b0 msgr2=0x7f4d9815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d980d22b0 0x7f4d9815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 -- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9815dfe0 msgr2=0x7f4d9815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.992+0000 7f4d97fff640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9815dfe0 0x7f4d9815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d97fff640 1 -- 172.21.15.19:0/141848808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9815ee10 con 0x7f4d980b41f0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d97fff640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000c400 tx=0x7f4d8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80017070 con 0x7f4d980b41f0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d800052d0 con 0x7f4d980b41f0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9815f0f0 con 0x7f4d980b41f0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80003830 con 0x7f4d980b41f0 2024-03-04T08:51:15.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.993+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9815f6b0 con 0x7f4d980b41f0 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.994+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9804f330 con 0x7f4d980b41f0 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.994+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d8001a070 con 0x7f4d980b41f0 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.995+0000 7f4d94ff9640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 0x7f4d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.995+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d80089440 con 0x7f4d980b41f0 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.995+0000 7f4d977fe640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 0x7f4d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:15.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.995+0000 7f4d977fe640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 0x7f4d7806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d88036000 tx=0x7f4d88008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:15.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:15.999+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4d80057d00 con 0x7f4d980b41f0 2024-03-04T08:51:16.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.181+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d9815fad0 con 0x7f4d980b41f0 2024-03-04T08:51:16.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.182+0000 7f4d94ff9640 1 -- 172.21.15.19:0/141848808 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f4d8005bda0 con 0x7f4d980b41f0 2024-03-04T08:51:16.178 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:16.178 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:16.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 msgr2=0x7f4d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 0x7f4d7806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d88036000 tx=0x7f4d88008030 comp rx=0 tx=0).stop 2024-03-04T08:51:16.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 msgr2=0x7f4d981547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000c400 tx=0x7f4d8000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 shutdown_connections 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d7806b4d0 0x7f4d7806d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d9815dfe0 0x7f4d9815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d980d22b0 0x7f4d9815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 --2- 172.21.15.19:0/141848808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d980b41f0 0x7f4d981547c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 >> 172.21.15.19:0/141848808 conn(0x7f4d980d3cd0 msgr2=0x7f4d9806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 shutdown_connections 2024-03-04T08:51:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.184+0000 7f4d9e415640 1 -- 172.21.15.19:0/141848808 wait complete. 2024-03-04T08:51:16.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:16.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.299+0000 7fc024281640 1 Processor -- start 2024-03-04T08:51:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.299+0000 7fc024281640 1 -- start start 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc024281640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc01c06cab0 0x7fc01c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc024281640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06d030 con 0x7fc01c15def0 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc024281640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06d310 con 0x7fc01c0cea50 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc024281640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0cf1c0 con 0x7fc01c06cab0 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc02281e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc01c06cab0 0x7fc01c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc02281e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc01c06cab0 0x7fc01c0b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53190/0 (socket says 172.21.15.19:53190) 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.300+0000 7fc02281e640 1 -- 172.21.15.19:0/3982008322 learned_addr learned my addr 172.21.15.19:0/3982008322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02281e640 1 -- 172.21.15.19:0/3982008322 >> v1:172.21.15.204:6789/0 conn(0x7fc01c0cea50 legacy=0x7fc01c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02281e640 1 -- 172.21.15.19:0/3982008322 >> v1:172.21.15.19:6789/0 conn(0x7fc01c15def0 legacy=0x7fc01c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02281e640 1 -- 172.21.15.19:0/3982008322 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0cc110 con 0x7fc01c06cab0 2024-03-04T08:51:16.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02281e640 1 --2- 172.21.15.19:0/3982008322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c06cab0 0x7fc01c0b41b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcae303bad2c472 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02101b640 1 -- 172.21.15.19:0/3982008322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01802cbb0 con 0x7fc01c06cab0 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02101b640 1 -- 172.21.15.19:0/3982008322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01802cd50 con 0x7fc01c06cab0 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.301+0000 7fc02101b640 1 -- 172.21.15.19:0/3982008322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018034610 con 0x7fc01c06cab0 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 -- 172.21.15.19:0/3982008322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c06cab0 msgr2=0x7fc01c0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 --2- 172.21.15.19:0/3982008322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c06cab0 0x7fc01c0b41b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01802c010 comp rx=0 tx=0).stop 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 -- 172.21.15.19:0/3982008322 shutdown_connections 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 --2- 172.21.15.19:0/3982008322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c06cab0 0x7fc01c0b41b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 -- 172.21.15.19:0/3982008322 >> 172.21.15.19:0/3982008322 conn(0x7fc01c0b3690 msgr2=0x7fc01c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 -- 172.21.15.19:0/3982008322 shutdown_connections 2024-03-04T08:51:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.302+0000 7fc024281640 1 -- 172.21.15.19:0/3982008322 wait complete. 2024-03-04T08:51:16.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.303+0000 7fc024281640 1 Processor -- start 2024-03-04T08:51:16.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.303+0000 7fc024281640 1 -- start start 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc01c06cab0 0x7fc01c0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc01c0cea50 0x7fc01c1e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15e2d0 con 0x7fc01c15def0 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0cc760 con 0x7fc01c06cab0 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc024281640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15e450 con 0x7fc01c0cea50 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53198/0 (socket says 172.21.15.19:53198) 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 -- 172.21.15.19:0/1705174570 learned_addr learned my addr 172.21.15.19:0/1705174570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02201d640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc01c06cab0 0x7fc01c0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02181c640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc01c0cea50 0x7fc01c1e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 -- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc01c0cea50 msgr2=0x7fc01c1e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc01c0cea50 0x7fc01c1e8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 -- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc01c06cab0 msgr2=0x7fc01c0c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc01c06cab0 0x7fc01c0c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.304+0000 7fc02281e640 1 -- 172.21.15.19:0/1705174570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c1e7910 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc02281e640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc018036040 tx=0x7fc018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018043020 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01803e450 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c1e7bf0 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018009510 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.305+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c1e81b0 con 0x7fc01c15def0 2024-03-04T08:51:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.306+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c09fcf0 con 0x7fc01c15def0 2024-03-04T08:51:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.306+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc018046020 con 0x7fc01c15def0 2024-03-04T08:51:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.306+0000 7fc012ffd640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 0x7fc00006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.307+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0180ac9a0 con 0x7fc01c15def0 2024-03-04T08:51:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.307+0000 7fc02201d640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 0x7fc00006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.307+0000 7fc02201d640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 0x7fc00006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc014000f60 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.311+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc01804d030 con 0x7fc01c15def0 2024-03-04T08:51:16.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.490+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc01c0d2640 con 0x7fc01c15def0 2024-03-04T08:51:16.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.490+0000 7fc012ffd640 1 -- 172.21.15.19:0/1705174570 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc01807b1d0 con 0x7fc01c15def0 2024-03-04T08:51:16.487 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 msgr2=0x7fc00006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 0x7fc00006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc014000f60 tx=0x7fc014009040 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 msgr2=0x7fc01c1e9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc018036040 tx=0x7fc018004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 shutdown_connections 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc01c15def0 0x7fc01c1e9170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc01c0cea50 0x7fc01c1e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc00006b4d0 0x7fc00006d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 --2- 172.21.15.19:0/1705174570 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc01c06cab0 0x7fc01c0c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.492+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 >> 172.21.15.19:0/1705174570 conn(0x7fc01c0b3690 msgr2=0x7fc01c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.493+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 shutdown_connections 2024-03-04T08:51:16.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.493+0000 7fc024281640 1 -- 172.21.15.19:0/1705174570 wait complete. 2024-03-04T08:51:16.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:16.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.607+0000 7f27ebadf640 1 Processor -- start 2024-03-04T08:51:16.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.607+0000 7f27ebadf640 1 -- start start 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ebadf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 0x7f27e415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ebadf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40ad900 con 0x7f27e415ea20 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ebadf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e415bd20 con 0x7f27e415b940 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ebadf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40adb70 con 0x7f27e40d01a0 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ea07c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f27e415ea20 0x7f27e4070b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60530/0 (socket says 172.21.15.19:60530) 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27ea07c640 1 -- 172.21.15.19:0/4016326071 learned_addr learned my addr 172.21.15.19:0/4016326071 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27e907a640 1 --2- 172.21.15.19:0/4016326071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 0x7f27e415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689880719 0 0) 0x7f27e40ad900 con 0x7f27e415ea20 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.608+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc003520 con 0x7f27e415ea20 2024-03-04T08:51:16.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676272614 0 0) 0x7f27e415bd20 con 0x7f27e415b940 2024-03-04T08:51:16.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e40ad900 con 0x7f27e415b940 2024-03-04T08:51:16.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e907a640 1 -- 172.21.15.19:0/4016326071 >> v1:172.21.15.204:6789/0 conn(0x7f27e415b940 legacy=0x7f27e40cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e907a640 1 -- 172.21.15.19:0/4016326071 >> v1:172.21.15.19:6789/0 conn(0x7f27e415ea20 legacy=0x7f27e4070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e907a640 1 -- 172.21.15.19:0/4016326071 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40ade50 con 0x7f27e40d01a0 2024-03-04T08:51:16.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.609+0000 7f27e907a640 1 --2- 172.21.15.19:0/4016326071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 0x7f27e415e4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097d0 tx=0x7f27d802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdd648da2772e17 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8035020 con 0x7f27e40d01a0 2024-03-04T08:51:16.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8031890 con 0x7f27e40d01a0 2024-03-04T08:51:16.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27e8879640 1 -- 172.21.15.19:0/4016326071 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8031c40 con 0x7f27e40d01a0 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 -- 172.21.15.19:0/4016326071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 msgr2=0x7f27e415e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 --2- 172.21.15.19:0/4016326071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 0x7f27e415e4e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097d0 tx=0x7f27d802b930 comp rx=0 tx=0).stop 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 -- 172.21.15.19:0/4016326071 shutdown_connections 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 --2- 172.21.15.19:0/4016326071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e40d01a0 0x7f27e415e4e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 -- 172.21.15.19:0/4016326071 >> 172.21.15.19:0/4016326071 conn(0x7f27e406b190 msgr2=0x7f27e406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 -- 172.21.15.19:0/4016326071 shutdown_connections 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.610+0000 7f27ebadf640 1 -- 172.21.15.19:0/4016326071 wait complete. 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.611+0000 7f27ebadf640 1 Processor -- start 2024-03-04T08:51:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.611+0000 7f27ebadf640 1 -- start start 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e40d01a0 0x7f27e41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e415ea20 0x7f27e40b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415f210 con 0x7f27e415b940 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415eed0 con 0x7f27e40d01a0 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ebadf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ae650 con 0x7f27e415ea20 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53212/0 (socket says 172.21.15.19:53212) 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 -- 172.21.15.19:0/1875664449 learned_addr learned my addr 172.21.15.19:0/1875664449 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27ea07c640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e415ea20 0x7f27e40b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e987b640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e40d01a0 0x7f27e41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 -- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e415ea20 msgr2=0x7f27e40b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e415ea20 0x7f27e40b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 -- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e40d01a0 msgr2=0x7f27e41541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e40d01a0 0x7f27e41541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.612+0000 7f27e907a640 1 -- 172.21.15.19:0/1875664449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4160d70 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27e907a640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27d802b970 tx=0x7f27d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8040070 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8030d20 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e415ffb0 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8035040 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.613+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4160570 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.614+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40732b0 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.614+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f27d804b060 con 0x7f27e415b940 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.615+0000 7f27e27fc640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 0x7f27d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.615+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27d80abed0 con 0x7f27e415b940 2024-03-04T08:51:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.615+0000 7f27e987b640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 0x7f27d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.615+0000 7f27e987b640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 0x7f27d006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001ea0 tx=0x7f27dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.619+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f27d802d040 con 0x7f27e415b940 2024-03-04T08:51:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.798+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27e41547b0 con 0x7f27e415b940 2024-03-04T08:51:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.799+0000 7f27e27fc640 1 -- 172.21.15.19:0/1875664449 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27d807a5d0 con 0x7f27e415b940 2024-03-04T08:51:16.795 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 msgr2=0x7f27d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 0x7f27d006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001ea0 tx=0x7f27dc009040 comp rx=0 tx=0).stop 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 msgr2=0x7f27e41549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27d802b970 tx=0x7f27d80046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 shutdown_connections 2024-03-04T08:51:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f27e415ea20 0x7f27e40b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27e415b940 0x7f27e41549d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27d006b500 0x7f27d006d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 --2- 172.21.15.19:0/1875664449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f27e40d01a0 0x7f27e41541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 >> 172.21.15.19:0/1875664449 conn(0x7f27e406b190 msgr2=0x7f27e40cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 shutdown_connections 2024-03-04T08:51:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.801+0000 7f27ebadf640 1 -- 172.21.15.19:0/1875664449 wait complete. 2024-03-04T08:51:16.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:16.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.915+0000 7f43efa4e640 1 Processor -- start 2024-03-04T08:51:16.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.916+0000 7f43efa4e640 1 -- start start 2024-03-04T08:51:16.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.916+0000 7f43efa4e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 0x7f43e806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.916+0000 7f43efa4e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80b3320 con 0x7f43e815a220 2024-03-04T08:51:16.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.916+0000 7f43efa4e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80cf560 con 0x7f43e80719e0 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.916+0000 7f43efa4e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80728d0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43ed7ea640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f43e815a220 0x7f43e80712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60542/0 (socket says 172.21.15.19:60542) 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43ed7ea640 1 -- 172.21.15.19:0/4225424535 learned_addr learned my addr 172.21.15.19:0/4225424535 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43edfeb640 1 --2- 172.21.15.19:0/4225424535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 0x7f43e806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151953190 0 0) 0x7f43e80b3320 con 0x7f43e815a220 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003520 con 0x7f43e815a220 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43edfeb640 1 -- 172.21.15.19:0/4225424535 >> v1:172.21.15.204:6789/0 conn(0x7f43e80719e0 legacy=0x7f43e806c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43edfeb640 1 -- 172.21.15.19:0/4225424535 >> v1:172.21.15.19:6789/0 conn(0x7f43e815a220 legacy=0x7f43e80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848068368 0 0) 0x7f43e80cf560 con 0x7f43e80719e0 2024-03-04T08:51:16.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.917+0000 7f43edfeb640 1 -- 172.21.15.19:0/4225424535 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80b3590 con 0x7f43e80cf0d0 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43edfeb640 1 --2- 172.21.15.19:0/4225424535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 0x7f43e806d100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43e000aed0 tx=0x7f43e002cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a372aaa4ef2c4a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e002db30 con 0x7f43e80cf0d0 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e002dcd0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43dffff640 1 -- 172.21.15.19:0/4225424535 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0008660 con 0x7f43e80cf0d0 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43efa4e640 1 -- 172.21.15.19:0/4225424535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 msgr2=0x7f43e806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43efa4e640 1 --2- 172.21.15.19:0/4225424535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 0x7f43e806d100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43e000aed0 tx=0x7f43e002cf90 comp rx=0 tx=0).stop 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43efa4e640 1 -- 172.21.15.19:0/4225424535 shutdown_connections 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43efa4e640 1 --2- 172.21.15.19:0/4225424535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80cf0d0 0x7f43e806d100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.918+0000 7f43efa4e640 1 -- 172.21.15.19:0/4225424535 >> 172.21.15.19:0/4225424535 conn(0x7f43e806b190 msgr2=0x7f43e806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.919+0000 7f43efa4e640 1 -- 172.21.15.19:0/4225424535 shutdown_connections 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.919+0000 7f43efa4e640 1 -- 172.21.15.19:0/4225424535 wait complete. 2024-03-04T08:51:16.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 Processor -- start 2024-03-04T08:51:16.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 -- start start 2024-03-04T08:51:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80719e0 0x7f43e814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43e815a220 0x7f43e806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8072530 con 0x7f43e80cf0d0 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8072030 con 0x7f43e815a220 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.920+0000 7f43efa4e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80726b0 con 0x7f43e80719e0 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53224/0 (socket says 172.21.15.19:53224) 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 -- 172.21.15.19:0/2340302551 learned_addr learned my addr 172.21.15.19:0/2340302551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ed7ea640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80719e0 0x7f43e814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43edfeb640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43e815a220 0x7f43e806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 -- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80719e0 msgr2=0x7f43e814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80719e0 0x7f43e814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 -- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43e815a220 msgr2=0x7f43e806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43e815a220 0x7f43e806cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 -- 172.21.15.19:0/2340302551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e81f75d0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ecfe9640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c4e0 tx=0x7f43d800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8017070 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80035f0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e81f7870 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80039e0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.921+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e81f7e30 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.922+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e80732b0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.923+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43d801a070 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.923+0000 7f43ddffb640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 0x7f43cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.923+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43d80893f0 con 0x7f43e80cf0d0 2024-03-04T08:51:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.923+0000 7f43ed7ea640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 0x7f43cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.924+0000 7f43ed7ea640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 0x7f43cc06d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005880 tx=0x7f43e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:16.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:16.927+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f43d8057cb0 con 0x7f43e80cf0d0 2024-03-04T08:51:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.107+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43e8068ff0 con 0x7f43e80cf0d0 2024-03-04T08:51:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.107+0000 7f43ddffb640 1 -- 172.21.15.19:0/2340302551 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43d805bd50 con 0x7f43e80cf0d0 2024-03-04T08:51:17.104 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 msgr2=0x7f43cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 0x7f43cc06d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005880 tx=0x7f43e4009040 comp rx=0 tx=0).stop 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 msgr2=0x7f43e806c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c4e0 tx=0x7f43d800c9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 shutdown_connections 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f43cc06b500 0x7f43cc06d9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f43e815a220 0x7f43e806cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e80cf0d0 0x7f43e806c810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 --2- 172.21.15.19:0/2340302551 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f43e80719e0 0x7f43e814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 >> 172.21.15.19:0/2340302551 conn(0x7f43e806b190 msgr2=0x7f43e806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 shutdown_connections 2024-03-04T08:51:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.109+0000 7f43efa4e640 1 -- 172.21.15.19:0/2340302551 wait complete. 2024-03-04T08:51:17.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:17.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.223+0000 7fc3025f7640 1 Processor -- start 2024-03-04T08:51:17.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.223+0000 7fc3025f7640 1 -- start start 2024-03-04T08:51:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc3025f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 0x7fc2fc15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc3025f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2fc0b4a50 0x7fc2fc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc3025f7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc06e770 con 0x7fc2fc0cc920 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc3025f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc15e660 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc3025f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc06e490 con 0x7fc2fc06e000 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2fc0b4a50 0x7fc2fc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc2fb7fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 0x7fc2fc15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2fc0b4a50 0x7fc2fc150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53234/0 (socket says 172.21.15.19:53234) 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 -- 172.21.15.19:0/1969513560 learned_addr learned my addr 172.21.15.19:0/1969513560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc2fbfff640 1 --1- 172.21.15.19:0/1969513560 >> v1:172.21.15.204:6789/0 conn(0x7fc2fc0cc920 0x7fc2fc072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:35136/0 (socket says 172.21.15.19:35136) 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 -- 172.21.15.19:0/1969513560 >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 msgr2=0x7fc2fc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 --2- 172.21.15.19:0/1969513560 >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 0x7fc2fc15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 -- 172.21.15.19:0/1969513560 >> v1:172.21.15.204:6789/0 conn(0x7fc2fc0cc920 legacy=0x7fc2fc072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc300b94640 1 -- 172.21.15.19:0/1969513560 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc15e010 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.224+0000 7fc2fb7fe640 1 --2- 172.21.15.19:0/1969513560 >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 0x7fc2fc15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.225+0000 7fc300b94640 1 --2- 172.21.15.19:0/1969513560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc150b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0b1600 tx=0x7fc2f402e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b85850c87dbff4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.225+0000 7fc2faffd640 1 -- 172.21.15.19:0/1969513560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4034070 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.225+0000 7fc2faffd640 1 -- 172.21.15.19:0/1969513560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4038400 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.225+0000 7fc2faffd640 1 -- 172.21.15.19:0/1969513560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40387d0 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 -- 172.21.15.19:0/1969513560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0b4a50 msgr2=0x7fc2fc150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 --2- 172.21.15.19:0/1969513560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc150b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0b1600 tx=0x7fc2f402e180 comp rx=0 tx=0).stop 2024-03-04T08:51:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 -- 172.21.15.19:0/1969513560 shutdown_connections 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 --2- 172.21.15.19:0/1969513560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc150b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 --2- 172.21.15.19:0/1969513560 >> v2:172.21.15.204:3300/0 conn(0x7fc2fc06e000 0x7fc2fc15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 -- 172.21.15.19:0/1969513560 >> 172.21.15.19:0/1969513560 conn(0x7fc2fc0b1c80 msgr2=0x7fc2fc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 -- 172.21.15.19:0/1969513560 shutdown_connections 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.226+0000 7fc3025f7640 1 -- 172.21.15.19:0/1969513560 wait complete. 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.227+0000 7fc3025f7640 1 Processor -- start 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.227+0000 7fc3025f7640 1 -- start start 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2fc1569a0 0x7fc2fc15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0cce80 con 0x7fc2fc0cc920 2024-03-04T08:51:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0ccd00 con 0x7fc2fc0b4a50 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc3025f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc070940 con 0x7fc2fc1569a0 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53250/0 (socket says 172.21.15.19:53250) 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 -- 172.21.15.19:0/2036384153 learned_addr learned my addr 172.21.15.19:0/2036384153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc300b94640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2fc1569a0 0x7fc2fc15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fbfff640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 -- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2fc1569a0 msgr2=0x7fc2fc15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2fc1569a0 0x7fc2fc15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 -- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2fc0b4a50 msgr2=0x7fc2fc155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.228+0000 7fc2fb7fe640 1 -- 172.21.15.19:0/2036384153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0b0b20 con 0x7fc2fc0cc920 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc2fb7fe640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ebb0 tx=0x7fc2ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec017070 con 0x7fc2fc0cc920 2024-03-04T08:51:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec00cc30 con 0x7fc2fc0cc920 2024-03-04T08:51:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc0b0e00 con 0x7fc2fc0cc920 2024-03-04T08:51:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec013470 con 0x7fc2fc0cc920 2024-03-04T08:51:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.229+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc15bbe0 con 0x7fc2fc0cc920 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.230+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc0b11f0 con 0x7fc2fc0cc920 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.230+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2ec01a070 con 0x7fc2fc0cc920 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.231+0000 7fc2f8ff9640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 0x7fc2e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.231+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2ec08a3f0 con 0x7fc2fc0cc920 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.231+0000 7fc2fbfff640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 0x7fc2e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.231+0000 7fc2fbfff640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 0x7fc2e806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007fd0 tx=0x7fc2f0007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.235+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc2ec058c20 con 0x7fc2fc0cc920 2024-03-04T08:51:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.430+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2fc04f330 con 0x7fc2fc0cc920 2024-03-04T08:51:17.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.430+0000 7fc2f8ff9640 1 -- 172.21.15.19:0/2036384153 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2ec05ccc0 con 0x7fc2fc0cc920 2024-03-04T08:51:17.427 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 msgr2=0x7fc2e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 0x7fc2e806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007fd0 tx=0x7fc2f0007e80 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 msgr2=0x7fc2fc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ebb0 tx=0x7fc2ec00c520 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 shutdown_connections 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc2fc1569a0 0x7fc2fc15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2fc0cc920 0x7fc2fc0b32e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc2e806b500 0x7fc2e806d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 --2- 172.21.15.19:0/2036384153 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc2fc0b4a50 0x7fc2fc155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 >> 172.21.15.19:0/2036384153 conn(0x7fc2fc0b1c80 msgr2=0x7fc2fc15a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 shutdown_connections 2024-03-04T08:51:17.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.432+0000 7fc3025f7640 1 -- 172.21.15.19:0/2036384153 wait complete. 2024-03-04T08:51:17.439 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2024-03-04T08:51:17.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:17.439 DEBUG:teuthology.orchestra.run.smithi204:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-04T08:51:17.468 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:17.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:51:17.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:17.468 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-04T08:51:17.537 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:17.537 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:17.553 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:17.553 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:17.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:17.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.755+0000 7fe6b19e4640 1 Processor -- start 2024-03-04T08:51:17.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.755+0000 7fe6b19e4640 1 -- start start 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6b19e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 0x7fe6ac06df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6b19e4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 0x7fe6ac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6b19e4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac06dc10 con 0x7fe6ac06d7a0 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6b19e4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac15e3a0 con 0x7fe6ac06e480 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6b19e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac06e8e0 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6aa7fc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 0x7fe6ac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6aaffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 0x7fe6ac06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6ab7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe6ac06d7a0 0x7fe6ac0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:52712/0 (socket says 172.21.15.19:52712) 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.756+0000 7fe6ab7fe640 1 -- 172.21.15.19:0/1171643909 learned_addr learned my addr 172.21.15.19:0/1171643909 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aaffd640 1 -- 172.21.15.19:0/1171643909 >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 msgr2=0x7fe6ac06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aaffd640 1 --2- 172.21.15.19:0/1171643909 >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 0x7fe6ac06d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aaffd640 1 -- 172.21.15.19:0/1171643909 >> v1:172.21.15.204:6789/0 conn(0x7fe6ac06d7a0 legacy=0x7fe6ac0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aaffd640 1 -- 172.21.15.19:0/1171643909 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac06bb60 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aa7fc640 1 --2- 172.21.15.19:0/1171643909 >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 0x7fe6ac06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.757+0000 7fe6aaffd640 1 --2- 172.21.15.19:0/1171643909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 0x7fe6ac06df40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097a0 tx=0x7fe6a402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d65b59beb78c46 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6a9ffb640 1 -- 172.21.15.19:0/1171643909 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40315a0 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6a9ffb640 1 -- 172.21.15.19:0/1171643909 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4037070 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6a9ffb640 1 -- 172.21.15.19:0/1171643909 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4031960 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 -- 172.21.15.19:0/1171643909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 msgr2=0x7fe6ac06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/1171643909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 0x7fe6ac06df40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40097a0 tx=0x7fe6a402b840 comp rx=0 tx=0).stop 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 -- 172.21.15.19:0/1171643909 shutdown_connections 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/1171643909 >> v2:172.21.15.204:3300/0 conn(0x7fe6ac06e480 0x7fe6ac06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/1171643909 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac15dfc0 0x7fe6ac06df40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 -- 172.21.15.19:0/1171643909 >> 172.21.15.19:0/1171643909 conn(0x7fe6ac0d00e0 msgr2=0x7fe6ac0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 -- 172.21.15.19:0/1171643909 shutdown_connections 2024-03-04T08:51:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.758+0000 7fe6b19e4640 1 -- 172.21.15.19:0/1171643909 wait complete. 2024-03-04T08:51:17.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.759+0000 7fe6b19e4640 1 Processor -- start 2024-03-04T08:51:17.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 -- start start 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 0x7fe6ac154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6ac15dfc0 0x7fe6ac0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac06c400 con 0x7fe6ac06e480 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac06c120 con 0x7fe6ac15dfc0 2024-03-04T08:51:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6b19e4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0ae320 con 0x7fe6ac06d7a0 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6aa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6ac15dfc0 0x7fe6ac0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6aaffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 0x7fe6ac154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6aa7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36070/0 (socket says 172.21.15.19:36070) 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.760+0000 7fe6aa7fc640 1 -- 172.21.15.19:0/3296224198 learned_addr learned my addr 172.21.15.19:0/3296224198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 -- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 msgr2=0x7fe6ac154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 0x7fe6ac154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 -- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6ac15dfc0 msgr2=0x7fe6ac0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6ac15dfc0 0x7fe6ac0ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 -- 172.21.15.19:0/3296224198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0b51f0 con 0x7fe6ac06e480 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aaffd640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 0x7fe6ac154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6aa7fc640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ebe0 tx=0x7fe69400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694017070 con 0x7fe6ac06e480 2024-03-04T08:51:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac0b54d0 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400cc30 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694013470 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.761+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac0b2e90 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.762+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac04f330 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.762+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe69401a070 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.763+0000 7fe6a3fff640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 0x7fe68c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.763+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe69408a430 con 0x7fe6ac06e480 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.763+0000 7fe6aaffd640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 0x7fe68c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:17.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.764+0000 7fe6aaffd640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 0x7fe68c06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4036000 tx=0x7fe6a403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.767+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe694058c70 con 0x7fe6ac06e480 2024-03-04T08:51:17.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.948+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6ac0cd950 con 0x7fe6ac06e480 2024-03-04T08:51:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.949+0000 7fe6a3fff640 1 -- 172.21.15.19:0/3296224198 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fe69405cd10 con 0x7fe6ac06e480 2024-03-04T08:51:17.945 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:17.945 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 msgr2=0x7fe68c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 0x7fe68c06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4036000 tx=0x7fe6a403d040 comp rx=0 tx=0).stop 2024-03-04T08:51:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 msgr2=0x7fe6ac160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ebe0 tx=0x7fe69400c520 comp rx=0 tx=0).stop 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 shutdown_connections 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68c06b4d0 0x7fe68c06d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6ac15dfc0 0x7fe6ac0ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6ac06e480 0x7fe6ac160260 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 --2- 172.21.15.19:0/3296224198 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6ac06d7a0 0x7fe6ac154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 >> 172.21.15.19:0/3296224198 conn(0x7fe6ac0d00e0 msgr2=0x7fe6ac15cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 shutdown_connections 2024-03-04T08:51:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:17.951+0000 7fe6b19e4640 1 -- 172.21.15.19:0/3296224198 wait complete. 2024-03-04T08:51:17.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:17.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:18.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.067+0000 7fcf530eb640 1 Processor -- start 2024-03-04T08:51:18.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.067+0000 7fcf530eb640 1 -- start start 2024-03-04T08:51:18.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf530eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf530eb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c158ac0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf530eb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c15b2a0 con 0x7fcf4c0d01a0 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf530eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15b540 con 0x7fcf4c1586e0 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf4c0aef80 0x7fcf4c0cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42262/0 (socket says 172.21.15.19:42262) 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4bfff640 1 -- 172.21.15.19:0/4124129912 learned_addr learned my addr 172.21.15.19:0/4124129912 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf50e87640 1 --2- 172.21.15.19:0/4124129912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570584616 0 0) 0x7fcf4c158ac0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf3c003520 con 0x7fcf4c0aef80 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394936892 0 0) 0x7fcf4c15b2a0 con 0x7fcf4c0d01a0 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c158ac0 con 0x7fcf4c0d01a0 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf50e87640 1 -- 172.21.15.19:0/4124129912 >> v1:172.21.15.204:6789/0 conn(0x7fcf4c0d01a0 legacy=0x7fcf4c0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf50e87640 1 -- 172.21.15.19:0/4124129912 >> v1:172.21.15.19:6789/0 conn(0x7fcf4c0aef80 legacy=0x7fcf4c0cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.068+0000 7fcf50e87640 1 -- 172.21.15.19:0/4124129912 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c15b820 con 0x7fcf4c1586e0 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.069+0000 7fcf50e87640 1 --2- 172.21.15.19:0/4124129912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c0aea40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097d0 tx=0x7fcf4002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdfcd343cb34b452 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.069+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40035020 con 0x7fcf4c1586e0 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.069+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40031890 con 0x7fcf4c1586e0 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.069+0000 7fcf4b7fe640 1 -- 172.21.15.19:0/4124129912 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031c40 con 0x7fcf4c1586e0 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 -- 172.21.15.19:0/4124129912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 msgr2=0x7fcf4c0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 --2- 172.21.15.19:0/4124129912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c0aea40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097d0 tx=0x7fcf4002b930 comp rx=0 tx=0).stop 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 -- 172.21.15.19:0/4124129912 shutdown_connections 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 --2- 172.21.15.19:0/4124129912 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c0aea40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 -- 172.21.15.19:0/4124129912 >> 172.21.15.19:0/4124129912 conn(0x7fcf4c06b190 msgr2=0x7fcf4c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 -- 172.21.15.19:0/4124129912 shutdown_connections 2024-03-04T08:51:18.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.070+0000 7fcf530eb640 1 -- 172.21.15.19:0/4124129912 wait complete. 2024-03-04T08:51:18.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.071+0000 7fcf530eb640 1 Processor -- start 2024-03-04T08:51:18.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.071+0000 7fcf530eb640 1 -- start start 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcf4c0d01a0 0x7fcf4c0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c071350 con 0x7fcf4c0aef80 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15bde0 con 0x7fcf4c0d01a0 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0714d0 con 0x7fcf4c1586e0 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36082/0 (socket says 172.21.15.19:36082) 2024-03-04T08:51:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 -- 172.21.15.19:0/1902866907 learned_addr learned my addr 172.21.15.19:0/1902866907 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf4bfff640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcf4c0d01a0 0x7fcf4c0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf51688640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 -- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 msgr2=0x7fcf4c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c06db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 -- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcf4c0d01a0 msgr2=0x7fcf4c0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcf4c0d01a0 0x7fcf4c0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 -- 172.21.15.19:0/1902866907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c149d10 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf50e87640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf40034040 tx=0x7fcf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40035040 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40030d20 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0a9ab0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400456a0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.072+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c06cd70 con 0x7fcf4c0aef80 2024-03-04T08:51:18.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.073+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0732b0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.074+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf40038020 con 0x7fcf4c0aef80 2024-03-04T08:51:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.074+0000 7fcf497fa640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 0x7fcf3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.075+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf400ac410 con 0x7fcf4c0aef80 2024-03-04T08:51:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.075+0000 7fcf4bfff640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 0x7fcf3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.075+0000 7fcf4bfff640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 0x7fcf3006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c14fe00 tx=0x7fcf38007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.079+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcf4c149d10 con 0x7fcf4c0aef80 2024-03-04T08:51:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.261+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf4c068ff0 con 0x7fcf4c0aef80 2024-03-04T08:51:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.261+0000 7fcf497fa640 1 -- 172.21.15.19:0/1902866907 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf4002d040 con 0x7fcf4c0aef80 2024-03-04T08:51:18.258 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 msgr2=0x7fcf3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 0x7fcf3006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c14fe00 tx=0x7fcf38007d70 comp rx=0 tx=0).stop 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 msgr2=0x7fcf4c1497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf40034040 tx=0x7fcf400046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 shutdown_connections 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcf4c1586e0 0x7fcf4c06db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcf3006b4d0 0x7fcf3006d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcf4c0d01a0 0x7fcf4c0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 --2- 172.21.15.19:0/1902866907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4c0aef80 0x7fcf4c1497d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.263+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 >> 172.21.15.19:0/1902866907 conn(0x7fcf4c06b190 msgr2=0x7fcf4c159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.264+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 shutdown_connections 2024-03-04T08:51:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.264+0000 7fcf530eb640 1 -- 172.21.15.19:0/1902866907 wait complete. 2024-03-04T08:51:18.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.380+0000 7fa5e3963640 1 Processor -- start 2024-03-04T08:51:18.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.380+0000 7fa5e3963640 1 -- start start 2024-03-04T08:51:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e3963640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa5dc15def0 0x7fa5dc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e3963640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5dc06cab0 0x7fa5dc0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e3963640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc06d030 con 0x7fa5dc0ce880 2024-03-04T08:51:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e3963640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc0cf1c0 con 0x7fa5dc06cab0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e3963640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc0cc760 con 0x7fa5dc15def0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e0efe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5dc06cab0 0x7fa5dc0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e1f00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa5dc0ce880 0x7fa5dc0cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42272/0 (socket says 172.21.15.19:42272) 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e1f00640 1 -- 172.21.15.19:0/3023415882 learned_addr learned my addr 172.21.15.19:0/3023415882 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e16ff640 1 --2- 172.21.15.19:0/3023415882 >> v2:172.21.15.204:3300/0 conn(0x7fa5dc15def0 0x7fa5dc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3023415882 >> v2:172.21.15.204:3300/0 conn(0x7fa5dc15def0 msgr2=0x7fa5dc0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e0efe640 1 --2- 172.21.15.19:0/3023415882 >> v2:172.21.15.204:3300/0 conn(0x7fa5dc15def0 0x7fa5dc0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3023415882 >> v1:172.21.15.19:6789/0 conn(0x7fa5dc0ce880 legacy=0x7fa5dc0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3023415882 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc06d310 con 0x7fa5dc06cab0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.381+0000 7fa5dbfff640 1 -- 172.21.15.19:0/3023415882 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649547492 0 0) 0x7fa5dc06d030 con 0x7fa5dc0ce880 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.382+0000 7fa5e0efe640 1 --2- 172.21.15.19:0/3023415882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc0ce340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc071f60 tx=0x7fa5d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c877e3974c693b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.382+0000 7fa5dbfff640 1 -- 172.21.15.19:0/3023415882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0034070 con 0x7fa5dc06cab0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.382+0000 7fa5dbfff640 1 -- 172.21.15.19:0/3023415882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0030610 con 0x7fa5dc06cab0 2024-03-04T08:51:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.382+0000 7fa5dbfff640 1 -- 172.21.15.19:0/3023415882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00309e0 con 0x7fa5dc06cab0 2024-03-04T08:51:18.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 -- 172.21.15.19:0/3023415882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc06cab0 msgr2=0x7fa5dc0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3023415882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc0ce340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc071f60 tx=0x7fa5d002b960 comp rx=0 tx=0).stop 2024-03-04T08:51:18.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 -- 172.21.15.19:0/3023415882 shutdown_connections 2024-03-04T08:51:18.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3023415882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc0ce340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3023415882 >> v2:172.21.15.204:3300/0 conn(0x7fa5dc15def0 0x7fa5dc0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 -- 172.21.15.19:0/3023415882 >> 172.21.15.19:0/3023415882 conn(0x7fa5dc0b3690 msgr2=0x7fa5dc0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 -- 172.21.15.19:0/3023415882 shutdown_connections 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.383+0000 7fa5e3963640 1 -- 172.21.15.19:0/3023415882 wait complete. 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.384+0000 7fa5e3963640 1 Processor -- start 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.384+0000 7fa5e3963640 1 -- start start 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 0x7fa5dc15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0cc3f0 con 0x7fa5dc0ce880 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0cecb0 con 0x7fa5dc06cab0 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc15e2d0 con 0x7fa5dc15def0 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36108/0 (socket says 172.21.15.19:36108) 2024-03-04T08:51:18.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3491312928 learned_addr learned my addr 172.21.15.19:0/3491312928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e16ff640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e1f00640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 0x7fa5dc15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 msgr2=0x7fa5dc15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 0x7fa5dc15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc06cab0 msgr2=0x7fa5dc14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 -- 172.21.15.19:0/3491312928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc14d320 con 0x7fa5dc0ce880 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e1f00640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 0x7fa5dc15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e0efe640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009890 tx=0x7fa5d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0047070 con 0x7fa5dc0ce880 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0030410 con 0x7fa5dc0ce880 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc15f440 con 0x7fa5dc0ce880 2024-03-04T08:51:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.385+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0034040 con 0x7fa5dc0ce880 2024-03-04T08:51:18.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.386+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc15fa00 con 0x7fa5dc0ce880 2024-03-04T08:51:18.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.387+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc09fcf0 con 0x7fa5dc0ce880 2024-03-04T08:51:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.387+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5d004a070 con 0x7fa5dc0ce880 2024-03-04T08:51:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.387+0000 7fa5d9ffb640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 0x7fa5c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.388+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5d00abc00 con 0x7fa5dc0ce880 2024-03-04T08:51:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.388+0000 7fa5e16ff640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 0x7fa5c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.388+0000 7fa5e16ff640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 0x7fa5c806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4003b80 tx=0x7fa5d40098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.392+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa5d00b2080 con 0x7fa5dc0ce880 2024-03-04T08:51:18.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.572+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5dc06ee90 con 0x7fa5dc0ce880 2024-03-04T08:51:18.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.572+0000 7fa5d9ffb640 1 -- 172.21.15.19:0/3491312928 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5d007a4c0 con 0x7fa5dc0ce880 2024-03-04T08:51:18.569 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 msgr2=0x7fa5c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 0x7fa5c806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4003b80 tx=0x7fa5d40098d0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 msgr2=0x7fa5dc1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009890 tx=0x7fa5d00046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 shutdown_connections 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa5dc15def0 0x7fa5dc15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc0ce880 0x7fa5dc1604e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa5c806b4d0 0x7fa5c806d990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 --2- 172.21.15.19:0/3491312928 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa5dc06cab0 0x7fa5dc14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 >> 172.21.15.19:0/3491312928 conn(0x7fa5dc0b3690 msgr2=0x7fa5dc0d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 shutdown_connections 2024-03-04T08:51:18.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.574+0000 7fa5e3963640 1 -- 172.21.15.19:0/3491312928 wait complete. 2024-03-04T08:51:18.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:18.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.689+0000 7fdd6375c640 1 Processor -- start 2024-03-04T08:51:18.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.689+0000 7fdd6375c640 1 -- start start 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd6375c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdd5c15bdd0 0x7fdd5c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd6375c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0d0240 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd6375c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0cf210 con 0x7fdd5c0ce300 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd6375c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0cf4f0 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd61cf9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdd5c0b15c0 0x7fdd5c0b19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42282/0 (socket says 172.21.15.19:42282) 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd61cf9640 1 -- 172.21.15.19:0/1804049732 learned_addr learned my addr 172.21.15.19:0/1804049732 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:18.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.690+0000 7fdd614f8640 1 --2- 172.21.15.19:0/1804049732 >> v2:172.21.15.204:3300/0 conn(0x7fdd5c15bdd0 0x7fdd5c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148158454 0 0) 0x7fdd5c0d0240 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd48003520 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675537743 0 0) 0x7fdd5c0cf210 con 0x7fdd5c0ce300 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd5c0d0240 con 0x7fdd5c0ce300 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd614f8640 1 -- 172.21.15.19:0/1804049732 >> v1:172.21.15.204:6789/0 conn(0x7fdd5c0ce300 legacy=0x7fdd5c0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd614f8640 1 -- 172.21.15.19:0/1804049732 >> v1:172.21.15.19:6789/0 conn(0x7fdd5c0b15c0 legacy=0x7fdd5c0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd614f8640 1 -- 172.21.15.19:0/1804049732 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0d04e0 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.691+0000 7fdd614f8640 1 --2- 172.21.15.19:0/1804049732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c15bdd0 0x7fdd5c0b41b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097a0 tx=0x7fdd5402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f2ab0e9bb13833 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54034070 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54030610 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd53fff640 1 -- 172.21.15.19:0/1804049732 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540309c0 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 -- 172.21.15.19:0/1804049732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c15bdd0 msgr2=0x7fdd5c0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1804049732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c15bdd0 0x7fdd5c0b41b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097a0 tx=0x7fdd5402b960 comp rx=0 tx=0).stop 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 -- 172.21.15.19:0/1804049732 shutdown_connections 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1804049732 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c15bdd0 0x7fdd5c0b41b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 -- 172.21.15.19:0/1804049732 >> 172.21.15.19:0/1804049732 conn(0x7fdd5c0b3690 msgr2=0x7fdd5c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 -- 172.21.15.19:0/1804049732 shutdown_connections 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.692+0000 7fdd6375c640 1 -- 172.21.15.19:0/1804049732 wait complete. 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.693+0000 7fdd6375c640 1 Processor -- start 2024-03-04T08:51:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.693+0000 7fdd6375c640 1 -- start start 2024-03-04T08:51:18.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c0ce300 0x7fdd5c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd5c15bdd0 0x7fdd5c1f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c15c1b0 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0d0850 con 0x7fdd5c0ce300 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd6375c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0b10c0 con 0x7fdd5c15bdd0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd614f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd614f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36112/0 (socket says 172.21.15.19:36112) 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd614f8640 1 -- 172.21.15.19:0/1009513625 learned_addr learned my addr 172.21.15.19:0/1009513625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd60cf7640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c0ce300 0x7fdd5c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.694+0000 7fdd61cf9640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd5c15bdd0 0x7fdd5c1f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 -- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd5c15bdd0 msgr2=0x7fdd5c1f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd5c15bdd0 0x7fdd5c1f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 -- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c0ce300 msgr2=0x7fdd5c0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c0ce300 0x7fdd5c0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 -- 172.21.15.19:0/1009513625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c1f2580 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd614f8640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000c00 tx=0x7fdd540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54034040 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5403aaa0 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c15f070 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54006e10 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.695+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c15c790 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.696+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c09fcf0 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.696+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd5404b060 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.697+0000 7fdd51ffb640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 0x7fdd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.697+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd540abdb0 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.697+0000 7fdd60cf7640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 0x7fdd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.697+0000 7fdd60cf7640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 0x7fdd4006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007fd0 tx=0x7fdd4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.701+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdd5c1f2580 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.881+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd5c068ff0 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.881+0000 7fdd51ffb640 1 -- 172.21.15.19:0/1009513625 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd5403f070 con 0x7fdd5c0b15c0 2024-03-04T08:51:18.878 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 msgr2=0x7fdd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 0x7fdd4006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007fd0 tx=0x7fdd4c009040 comp rx=0 tx=0).stop 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 msgr2=0x7fdd5c0c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000c00 tx=0x7fdd540046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 shutdown_connections 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdd5c15bdd0 0x7fdd5c1f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdd4006b4d0 0x7fdd4006d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd5c0ce300 0x7fdd5c0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 --2- 172.21.15.19:0/1009513625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd5c0b15c0 0x7fdd5c0c8070 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 >> 172.21.15.19:0/1009513625 conn(0x7fdd5c0b3690 msgr2=0x7fdd5c0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 shutdown_connections 2024-03-04T08:51:18.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.883+0000 7fdd6375c640 1 -- 172.21.15.19:0/1009513625 wait complete. 2024-03-04T08:51:18.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.996+0000 7f498badf640 1 Processor -- start 2024-03-04T08:51:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 -- start start 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 0x7f498406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498406d030 con 0x7f498406cb90 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498406d310 con 0x7f498415b380 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.997+0000 7f498badf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498406d5f0 con 0x7f4984158880 2024-03-04T08:51:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498907a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498a07c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f498406cb90 0x7f498415e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42286/0 (socket says 172.21.15.19:42286) 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498907a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36118/0 (socket says 172.21.15.19:36118) 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498a07c640 1 -- 172.21.15.19:0/3238274355 learned_addr learned my addr 172.21.15.19:0/3238274355 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498987b640 1 --2- 172.21.15.19:0/3238274355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 0x7f498406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498987b640 1 -- 172.21.15.19:0/3238274355 >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 msgr2=0x7f49840708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498987b640 1 --2- 172.21.15.19:0/3238274355 >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498987b640 1 -- 172.21.15.19:0/3238274355 >> v1:172.21.15.19:6789/0 conn(0x7f498406cb90 legacy=0x7f498415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498987b640 1 -- 172.21.15.19:0/3238274355 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498406d8d0 con 0x7f4984158880 2024-03-04T08:51:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.998+0000 7f498907a640 1 --2- 172.21.15.19:0/3238274355 >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498987b640 1 --2- 172.21.15.19:0/3238274355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 0x7f498406c650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f497c0097a0 tx=0x7f497c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c0b3dbb3bf0bd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f4988879640 1 -- 172.21.15.19:0/3238274355 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c035020 con 0x7f4984158880 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f4988879640 1 -- 172.21.15.19:0/3238274355 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c031810 con 0x7f4984158880 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f4988879640 1 -- 172.21.15.19:0/3238274355 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c031be0 con 0x7f4984158880 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 -- 172.21.15.19:0/3238274355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 msgr2=0x7f498406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 --2- 172.21.15.19:0/3238274355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 0x7f498406c650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f497c0097a0 tx=0x7f497c02b8b0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 -- 172.21.15.19:0/3238274355 shutdown_connections 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 --2- 172.21.15.19:0/3238274355 >> v2:172.21.15.19:3300/0 conn(0x7f498415b380 0x7f49840708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 --2- 172.21.15.19:0/3238274355 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4984158880 0x7f498406c650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 -- 172.21.15.19:0/3238274355 >> 172.21.15.19:0/3238274355 conn(0x7f49840b1c80 msgr2=0x7f49840cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 -- 172.21.15.19:0/3238274355 shutdown_connections 2024-03-04T08:51:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:18.999+0000 7f498badf640 1 -- 172.21.15.19:0/3238274355 wait complete. 2024-03-04T08:51:18.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 Processor -- start 2024-03-04T08:51:18.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 -- start start 2024-03-04T08:51:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f498406cb90 0x7f49840ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498415b380 0x7f49840ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ce950 con 0x7f4984158880 2024-03-04T08:51:19.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ce7d0 con 0x7f498406cb90 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498badf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4984070e10 con 0x7f498415b380 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498907a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498907a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36132/0 (socket says 172.21.15.19:36132) 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.001+0000 7f498907a640 1 -- 172.21.15.19:0/2836494836 learned_addr learned my addr 172.21.15.19:0/2836494836 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498a07c640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498415b380 0x7f49840ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498987b640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f498406cb90 0x7f49840ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 -- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498415b380 msgr2=0x7f49840ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498415b380 0x7f49840ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 -- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f498406cb90 msgr2=0x7f49840ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f498406cb90 0x7f49840ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 -- 172.21.15.19:0/2836494836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840ad100 con 0x7f4984158880 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498907a640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4978010b70 tx=0x7f497800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497801e070 con 0x7f4984158880 2024-03-04T08:51:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497800ce30 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49840abc80 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011670 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.002+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49840ad660 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.003+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498404f330 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.004+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4978021070 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.004+0000 7f49827fc640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 0x7f497006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.004+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f497808c000 con 0x7f4984158880 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.004+0000 7f498987b640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 0x7f497006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.005+0000 7f498987b640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 0x7f497006d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f497c036000 tx=0x7f497c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.008+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f49840ad100 con 0x7f4984158880 2024-03-04T08:51:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.202+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f498415d460 con 0x7f4984158880 2024-03-04T08:51:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.202+0000 7f49827fc640 1 -- 172.21.15.19:0/2836494836 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f497805a8c0 con 0x7f4984158880 2024-03-04T08:51:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:19.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 msgr2=0x7f497006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 0x7f497006d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f497c036000 tx=0x7f497c008030 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 msgr2=0x7f49841572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4978010b70 tx=0x7f497800c520 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 shutdown_connections 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f498415b380 0x7f49840ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4984158880 0x7f49841572c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f497006b4d0 0x7f497006d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 --2- 172.21.15.19:0/2836494836 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f498406cb90 0x7f49840ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 >> 172.21.15.19:0/2836494836 conn(0x7f49840b1c80 msgr2=0x7f49840b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 shutdown_connections 2024-03-04T08:51:19.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.204+0000 7f498badf640 1 -- 172.21.15.19:0/2836494836 wait complete. 2024-03-04T08:51:19.211 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:19.211 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:19.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.371+0000 7f5be77f6640 1 Processor -- start 2024-03-04T08:51:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.371+0000 7f5be77f6640 1 -- start start 2024-03-04T08:51:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be77f6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5be015dfe0 0x7f5be00cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be77f6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be77f6640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00b3430 con 0x7f5be00cf830 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be77f6640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00b31e0 con 0x7f5be015dfe0 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be77f6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00b3d60 con 0x7f5be00d29c0 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be5592640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5be015dfe0 0x7f5be00cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be5592640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5be015dfe0 0x7f5be00cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36148/0 (socket says 172.21.15.19:36148) 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be5592640 1 -- 172.21.15.19:0/64540364 learned_addr learned my addr 172.21.15.19:0/64540364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.372+0000 7f5be5d93640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5592640 1 -- 172.21.15.19:0/64540364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 msgr2=0x7f5be00b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5592640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5592640 1 -- 172.21.15.19:0/64540364 >> v1:172.21.15.204:6789/0 conn(0x7f5be00cf830 legacy=0x7f5be00d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5592640 1 -- 172.21.15.19:0/64540364 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00b3710 con 0x7f5be015dfe0 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5d93640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.373+0000 7f5be5592640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be015dfe0 0x7f5be00cf2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eec30aa6d3159b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5bdffff640 1 -- 172.21.15.19:0/64540364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8034070 con 0x7f5be015dfe0 2024-03-04T08:51:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5bdffff640 1 -- 172.21.15.19:0/64540364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8030840 con 0x7f5be015dfe0 2024-03-04T08:51:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5bdffff640 1 -- 172.21.15.19:0/64540364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8030c10 con 0x7f5be015dfe0 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 -- 172.21.15.19:0/64540364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be015dfe0 msgr2=0x7f5be00cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be015dfe0 0x7f5be00cf2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd802b980 comp rx=0 tx=0).stop 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 -- 172.21.15.19:0/64540364 shutdown_connections 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 --2- 172.21.15.19:0/64540364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be015dfe0 0x7f5be00cf2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 -- 172.21.15.19:0/64540364 >> 172.21.15.19:0/64540364 conn(0x7f5be00d3cd0 msgr2=0x7f5be00d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 -- 172.21.15.19:0/64540364 shutdown_connections 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.374+0000 7f5be77f6640 1 -- 172.21.15.19:0/64540364 wait complete. 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.375+0000 7f5be77f6640 1 Processor -- start 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.375+0000 7f5be77f6640 1 -- start start 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5be015dfe0 0x7f5be01f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00d1df0 con 0x7f5be00cf830 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00d1c70 con 0x7f5be015dfe0 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be77f6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be015e3c0 con 0x7f5be00d29c0 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be5592640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be5592640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36152/0 (socket says 172.21.15.19:36152) 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be5592640 1 -- 172.21.15.19:0/2053703504 learned_addr learned my addr 172.21.15.19:0/2053703504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be4d91640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.376+0000 7f5be5d93640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5be015dfe0 0x7f5be01f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 -- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 msgr2=0x7f5be00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 -- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5be015dfe0 msgr2=0x7f5be01f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5be015dfe0 0x7f5be01f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 -- 172.21.15.19:0/2053703504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00cb3b0 con 0x7f5be00cf830 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be5592640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8034040 con 0x7f5be00cf830 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8039d90 con 0x7f5be00cf830 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00cb690 con 0x7f5be00cf830 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8043610 con 0x7f5be00cf830 2024-03-04T08:51:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.377+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be00cbc50 con 0x7f5be00cf830 2024-03-04T08:51:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.378+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be004f330 con 0x7f5be00cf830 2024-03-04T08:51:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.378+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5bd804a060 con 0x7f5be00cf830 2024-03-04T08:51:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.379+0000 7f5bddffb640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 0x7f5bcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.379+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bd80ac050 con 0x7f5be00cf830 2024-03-04T08:51:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.379+0000 7f5be4d91640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 0x7f5bcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.379+0000 7f5be4d91640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 0x7f5bcc06d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5be00cb2e0 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.383+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5bd803e070 con 0x7f5be00cf830 2024-03-04T08:51:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.567+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5be00b5460 con 0x7f5be00cf830 2024-03-04T08:51:19.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.568+0000 7f5bddffb640 1 -- 172.21.15.19:0/2053703504 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f5bd807aed0 con 0x7f5be00cf830 2024-03-04T08:51:19.564 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:19.565 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 msgr2=0x7f5bcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 0x7f5bcc06d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5be00cb2e0 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 msgr2=0x7f5be00cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd80046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 shutdown_connections 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5bcc06b4d0 0x7f5bcc06d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5be015dfe0 0x7f5be01f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5be00d29c0 0x7f5be00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 --2- 172.21.15.19:0/2053703504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5be00cf830 0x7f5be00cada0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 >> 172.21.15.19:0/2053703504 conn(0x7f5be00d3cd0 msgr2=0x7f5be00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 shutdown_connections 2024-03-04T08:51:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.570+0000 7f5be77f6640 1 -- 172.21.15.19:0/2053703504 wait complete. 2024-03-04T08:51:19.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:19.577 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:19.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.687+0000 7fbd52864640 1 Processor -- start 2024-03-04T08:51:19.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.687+0000 7fbd52864640 1 -- start start 2024-03-04T08:51:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd52864640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd52864640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd4c0b55e0 0x7fbd4c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd52864640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c06b710 con 0x7fbd4c066d90 2024-03-04T08:51:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd52864640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c06b150 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd52864640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06b430 con 0x7fbd4c0cf9a0 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbd4c066d90 0x7fbd4c0b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42300/0 (socket says 172.21.15.19:42300) 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4b7fe640 1 -- 172.21.15.19:0/1133731582 learned_addr learned my addr 172.21.15.19:0/1133731582 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4bfff640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd50e01640 1 --2- 172.21.15.19:0/1133731582 >> v2:172.21.15.19:3300/0 conn(0x7fbd4c0b55e0 0x7fbd4c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4affd640 1 -- 172.21.15.19:0/1133731582 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411325708 0 0) 0x7fbd4c06b710 con 0x7fbd4c066d90 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4affd640 1 -- 172.21.15.19:0/1133731582 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003520 con 0x7fbd4c066d90 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd50e01640 1 -- 172.21.15.19:0/1133731582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 msgr2=0x7fbd4c0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd50e01640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd50e01640 1 -- 172.21.15.19:0/1133731582 >> v1:172.21.15.19:6789/0 conn(0x7fbd4c066d90 legacy=0x7fbd4c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd50e01640 1 -- 172.21.15.19:0/1133731582 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0b0970 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.688+0000 7fbd4bfff640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.689+0000 7fbd50e01640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0ce040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee3d5dbe44cbd1d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.689+0000 7fbd4affd640 1 -- 172.21.15.19:0/1133731582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44039070 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.689+0000 7fbd4affd640 1 -- 172.21.15.19:0/1133731582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4402cc50 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.689+0000 7fbd4affd640 1 -- 172.21.15.19:0/1133731582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44034440 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 -- 172.21.15.19:0/1133731582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 msgr2=0x7fbd4c0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0ce040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4402bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 -- 172.21.15.19:0/1133731582 shutdown_connections 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0ce040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 --2- 172.21.15.19:0/1133731582 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 -- 172.21.15.19:0/1133731582 >> 172.21.15.19:0/1133731582 conn(0x7fbd4c0b1d70 msgr2=0x7fbd4c0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 -- 172.21.15.19:0/1133731582 shutdown_connections 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.690+0000 7fbd52864640 1 -- 172.21.15.19:0/1133731582 wait complete. 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.691+0000 7fbd52864640 1 Processor -- start 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.691+0000 7fbd52864640 1 -- start start 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c066d90 0x7fbd4c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b6170 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b5ff0 con 0x7fbd4c0cf9a0 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd52864640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cfd80 con 0x7fbd4c066d90 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36158/0 (socket says 172.21.15.19:36158) 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 -- 172.21.15.19:0/1896581345 learned_addr learned my addr 172.21.15.19:0/1896581345 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:19.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4bfff640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c066d90 0x7fbd4c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd50e01640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 -- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c066d90 msgr2=0x7fbd4c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c066d90 0x7fbd4c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 -- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd4c0cf9a0 msgr2=0x7fbd4c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 -- 172.21.15.19:0/1896581345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0c5ca0 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.692+0000 7fbd4b7fe640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c430 tx=0x7fbd3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.693+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c017070 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.693+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c005d00 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.693+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0c9760 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.693+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c007310 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.693+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c0c9d20 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.694+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c09e3d0 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.694+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd3c01a070 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.694+0000 7fbd48ff9640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.695+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd3c089670 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.695+0000 7fbd4bfff640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.695+0000 7fbd4bfff640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 0x7fbd3806d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009560 tx=0x7fbd40009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.699+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd3c057e00 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.882+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd4c099420 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.882+0000 7fbd48ff9640 1 -- 172.21.15.19:0/1896581345 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd3c05bea0 con 0x7fbd4c0b55e0 2024-03-04T08:51:19.878 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 msgr2=0x7fbd3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 0x7fbd3806d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009560 tx=0x7fbd40009190 comp rx=0 tx=0).stop 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 msgr2=0x7fbd4c0c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c430 tx=0x7fbd3c00c8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 shutdown_connections 2024-03-04T08:51:19.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd4c0cf9a0 0x7fbd4c0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0b55e0 0x7fbd4c0c74d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 --2- 172.21.15.19:0/1896581345 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd4c066d90 0x7fbd4c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 >> 172.21.15.19:0/1896581345 conn(0x7fbd4c0b1d70 msgr2=0x7fbd4c0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 shutdown_connections 2024-03-04T08:51:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.884+0000 7fbd52864640 1 -- 172.21.15.19:0/1896581345 wait complete. 2024-03-04T08:51:19.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:19.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.998+0000 7f4b3b3e9640 1 Processor -- start 2024-03-04T08:51:19.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.998+0000 7f4b3b3e9640 1 -- start start 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b3b3e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 0x7f4b3415e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b3b3e9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4b3415ec40 0x7f4b34071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b3b3e9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340cea90 con 0x7f4b3415bbb0 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b3b3e9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b34161970 con 0x7f4b3415ec40 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b3b3e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b341624f0 con 0x7f4b3406b6c0 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b39185640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4b3415bbb0 0x7f4b3406afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42310/0 (socket says 172.21.15.19:42310) 2024-03-04T08:51:19.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b39185640 1 -- 172.21.15.19:0/2011788664 learned_addr learned my addr 172.21.15.19:0/2011788664 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b38984640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 0x7f4b3415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:19.999+0000 7f4b39986640 1 --2- 172.21.15.19:0/2011788664 >> v2:172.21.15.204:3300/0 conn(0x7f4b3415ec40 0x7f4b34071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b2bfff640 1 -- 172.21.15.19:0/2011788664 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406798012 0 0) 0x7f4b30001110 con 0x7f4b3415bbb0 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b2bfff640 1 -- 172.21.15.19:0/2011788664 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b20003520 con 0x7f4b3415bbb0 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b39986640 1 -- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 msgr2=0x7f4b3415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b39986640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 0x7f4b3415e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b39986640 1 -- 172.21.15.19:0/2011788664 >> v1:172.21.15.19:6789/0 conn(0x7f4b3415bbb0 legacy=0x7f4b3406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b39986640 1 -- 172.21.15.19:0/2011788664 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34161bc0 con 0x7f4b3415ec40 2024-03-04T08:51:19.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.000+0000 7f4b38984640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 0x7f4b3415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:19.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b39986640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3415ec40 0x7f4b34071ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d90 tx=0x7f4b2c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8e89273165480d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b2bfff640 1 -- 172.21.15.19:0/2011788664 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c039070 con 0x7f4b3415ec40 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b2bfff640 1 -- 172.21.15.19:0/2011788664 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c02cc50 con 0x7f4b3415ec40 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b2bfff640 1 -- 172.21.15.19:0/2011788664 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c034440 con 0x7f4b3415ec40 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3415ec40 msgr2=0x7f4b34071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3415ec40 0x7f4b34071ca0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d90 tx=0x7f4b2c02bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/2011788664 shutdown_connections 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3415ec40 0x7f4b34071ca0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/2011788664 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3406b6c0 0x7f4b3415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/2011788664 >> 172.21.15.19:0/2011788664 conn(0x7f4b340b2660 msgr2=0x7f4b340b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/2011788664 shutdown_connections 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.001+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/2011788664 wait complete. 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 Processor -- start 2024-03-04T08:51:19.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 -- start start 2024-03-04T08:51:20.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3415ec40 0x7f4b341507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 0x7f4b3415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415f0f0 con 0x7f4b340b5fc0 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34162180 con 0x7f4b3406b6c0 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b3b3e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340721e0 con 0x7f4b3415ec40 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b39986640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 0x7f4b3415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b39185640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b39185640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:58336/0 (socket says 172.21.15.19:58336) 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b38984640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3415ec40 0x7f4b341507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.003+0000 7f4b39185640 1 -- 172.21.15.19:0/774808210 learned_addr learned my addr 172.21.15.19:0/774808210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 -- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3415ec40 msgr2=0x7f4b341507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3415ec40 0x7f4b341507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 -- 172.21.15.19:0/774808210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 msgr2=0x7f4b3415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 0x7f4b3415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 -- 172.21.15.19:0/774808210 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340cc200 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39986640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 0x7f4b3415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b39185640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c760 tx=0x7f4b3000cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30017070 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30005ad0 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340cc4e0 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30007e20 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.004+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340cbf10 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.005+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b340733b0 con 0x7f4b3406b6c0 2024-03-04T08:51:20.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.006+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b3001a070 con 0x7f4b3406b6c0 2024-03-04T08:51:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.006+0000 7f4b29ffb640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 0x7f4b1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.006+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b30089560 con 0x7f4b3406b6c0 2024-03-04T08:51:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.006+0000 7f4b38984640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 0x7f4b1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.007+0000 7f4b38984640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 0x7f4b1806d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009560 tx=0x7f4b24009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.010+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4b340cea90 con 0x7f4b3406b6c0 2024-03-04T08:51:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.190+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b34072790 con 0x7f4b3406b6c0 2024-03-04T08:51:20.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.190+0000 7f4b29ffb640 1 -- 172.21.15.19:0/774808210 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b3005e0d0 con 0x7f4b3406b6c0 2024-03-04T08:51:20.187 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 msgr2=0x7f4b1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 0x7f4b1806d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009560 tx=0x7f4b24009190 comp rx=0 tx=0).stop 2024-03-04T08:51:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 msgr2=0x7f4b340cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c760 tx=0x7f4b3000cc20 comp rx=0 tx=0).stop 2024-03-04T08:51:20.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 shutdown_connections 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b340b5fc0 0x7f4b3415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4b3415ec40 0x7f4b341507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4b1806b4d0 0x7f4b1806d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 --2- 172.21.15.19:0/774808210 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4b3406b6c0 0x7f4b340cb9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 >> 172.21.15.19:0/774808210 conn(0x7f4b340b2660 msgr2=0x7f4b340cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 shutdown_connections 2024-03-04T08:51:20.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.192+0000 7f4b3b3e9640 1 -- 172.21.15.19:0/774808210 wait complete. 2024-03-04T08:51:20.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 Processor -- start 2024-03-04T08:51:20.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 -- start start 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f619c0d4860 0x7f619c0d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f619c0b0e30 0x7f619c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c1618b0 con 0x7f619c1614d0 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0d4cf0 con 0x7f619c0b0e30 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a2e22640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0cf400 con 0x7f619c0d4860 2024-03-04T08:51:20.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a13bf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f619c0b0e30 0x7f619c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a0bbe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f619c1614d0 0x7f619c0d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42324/0 (socket says 172.21.15.19:42324) 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.308+0000 7f61a0bbe640 1 -- 172.21.15.19:0/840770518 learned_addr learned my addr 172.21.15.19:0/840770518 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f619bfff640 1 --2- 172.21.15.19:0/840770518 >> v2:172.21.15.204:3300/0 conn(0x7f619c0d4860 0x7f619c0d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f61a13bf640 1 -- 172.21.15.19:0/840770518 >> v2:172.21.15.204:3300/0 conn(0x7f619c0d4860 msgr2=0x7f619c0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f61a13bf640 1 --2- 172.21.15.19:0/840770518 >> v2:172.21.15.204:3300/0 conn(0x7f619c0d4860 0x7f619c0d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f61a13bf640 1 -- 172.21.15.19:0/840770518 >> v1:172.21.15.19:6789/0 conn(0x7f619c1614d0 legacy=0x7f619c0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f61a13bf640 1 -- 172.21.15.19:0/840770518 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0cf6a0 con 0x7f619c0b0e30 2024-03-04T08:51:20.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.309+0000 7f619b7fe640 1 -- 172.21.15.19:0/840770518 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454711565 0 0) 0x7f619c1618b0 con 0x7f619c1614d0 2024-03-04T08:51:20.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a13bf640 1 --2- 172.21.15.19:0/840770518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c0b1260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ce550 tx=0x7f619402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb49efce394cfa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f619b7fe640 1 -- 172.21.15.19:0/840770518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194039070 con 0x7f619c0b0e30 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f619b7fe640 1 -- 172.21.15.19:0/840770518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619402cc80 con 0x7f619c0b0e30 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f619b7fe640 1 -- 172.21.15.19:0/840770518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194034660 con 0x7f619c0b0e30 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 -- 172.21.15.19:0/840770518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 msgr2=0x7f619c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 --2- 172.21.15.19:0/840770518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c0b1260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ce550 tx=0x7f619402bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 -- 172.21.15.19:0/840770518 shutdown_connections 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 --2- 172.21.15.19:0/840770518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c0b1260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 --2- 172.21.15.19:0/840770518 >> v2:172.21.15.204:3300/0 conn(0x7f619c0d4860 0x7f619c0d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 -- 172.21.15.19:0/840770518 >> 172.21.15.19:0/840770518 conn(0x7f619c0d3d40 msgr2=0x7f619c0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 -- 172.21.15.19:0/840770518 shutdown_connections 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.310+0000 7f61a2e22640 1 -- 172.21.15.19:0/840770518 wait complete. 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.311+0000 7f61a2e22640 1 Processor -- start 2024-03-04T08:51:20.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.311+0000 7f61a2e22640 1 -- start start 2024-03-04T08:51:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619c0d4860 0x7f619c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619c1614d0 0x7f619c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0b0910 con 0x7f619c0b0e30 2024-03-04T08:51:20.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0cfc60 con 0x7f619c0d4860 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a2e22640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0d2560 con 0x7f619c1614d0 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a0bbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a0bbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36190/0 (socket says 172.21.15.19:36190) 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f61a0bbe640 1 -- 172.21.15.19:0/2984722372 learned_addr learned my addr 172.21.15.19:0/2984722372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.312+0000 7f619bfff640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619c0d4860 0x7f619c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a13bf640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619c1614d0 0x7f619c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 -- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619c1614d0 msgr2=0x7f619c0cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619c1614d0 0x7f619c0cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 -- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619c0d4860 msgr2=0x7f619c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619c0d4860 0x7f619c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 -- 172.21.15.19:0/2984722372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c1f81a0 con 0x7f619c0b0e30 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a0bbe640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f619000c400 tx=0x7f619000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190017070 con 0x7f619c0b0e30 2024-03-04T08:51:20.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190005ce0 con 0x7f619c0b0e30 2024-03-04T08:51:20.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c0cb1b0 con 0x7f619c0b0e30 2024-03-04T08:51:20.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190007310 con 0x7f619c0b0e30 2024-03-04T08:51:20.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.313+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c0cb770 con 0x7f619c0b0e30 2024-03-04T08:51:20.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.314+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c06c070 con 0x7f619c0b0e30 2024-03-04T08:51:20.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.315+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f619001a070 con 0x7f619c0b0e30 2024-03-04T08:51:20.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.315+0000 7f61997fa640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 0x7f618006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.315+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6190089570 con 0x7f619c0b0e30 2024-03-04T08:51:20.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.315+0000 7f619bfff640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 0x7f618006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.316+0000 7f619bfff640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 0x7f618006d9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f619c15e450 tx=0x7f6188009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.319+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f619c06c070 con 0x7f619c0b0e30 2024-03-04T08:51:20.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.499+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f619c069e80 con 0x7f619c0b0e30 2024-03-04T08:51:20.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.500+0000 7f61997fa640 1 -- 172.21.15.19:0/2984722372 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f619c069e80 con 0x7f619c0b0e30 2024-03-04T08:51:20.496 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.501+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 msgr2=0x7f618006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.501+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 0x7f618006d9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f619c15e450 tx=0x7f6188009190 comp rx=0 tx=0).stop 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.501+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 msgr2=0x7f619c1f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.501+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f619000c400 tx=0x7f619000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 shutdown_connections 2024-03-04T08:51:20.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619c1614d0 0x7f619c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f618006b500 0x7f618006d9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619c0d4860 0x7f619c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 --2- 172.21.15.19:0/2984722372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c0b0e30 0x7f619c1f7c60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 >> 172.21.15.19:0/2984722372 conn(0x7f619c0d3d40 msgr2=0x7f619c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 shutdown_connections 2024-03-04T08:51:20.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.502+0000 7f61a2e22640 1 -- 172.21.15.19:0/2984722372 wait complete. 2024-03-04T08:51:20.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:20.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.615+0000 7fccad442640 1 Processor -- start 2024-03-04T08:51:20.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.615+0000 7fccad442640 1 -- start start 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcca8162970 0x7fcca80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcca8161cf0 0x7fcca8162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca8161b00 con 0x7fcca8162970 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca80cecc0 con 0x7fcca8161cf0 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fccad442640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80d22c0 con 0x7fcca80b4460 2024-03-04T08:51:20.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcca8162970 0x7fcca80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcca8162970 0x7fcca80b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36192/0 (socket says 172.21.15.19:36192) 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 -- 172.21.15.19:0/3091967490 learned_addr learned my addr 172.21.15.19:0/3091967490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca77fe640 1 --2- 172.21.15.19:0/3091967490 >> v2:172.21.15.204:3300/0 conn(0x7fcca8161cf0 0x7fcca8162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca6ffd640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 -- 172.21.15.19:0/3091967490 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 msgr2=0x7fcca80d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 -- 172.21.15.19:0/3091967490 >> v2:172.21.15.204:3300/0 conn(0x7fcca8161cf0 msgr2=0x7fcca8162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 --2- 172.21.15.19:0/3091967490 >> v2:172.21.15.204:3300/0 conn(0x7fcca8161cf0 0x7fcca8162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.616+0000 7fcca67fc640 1 -- 172.21.15.19:0/3091967490 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80d25a0 con 0x7fcca8162970 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.617+0000 7fcca67fc640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80b3580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcca80ce2c0 tx=0x7fcc9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b8306372019247 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.617+0000 7fcca5ffb640 1 -- 172.21.15.19:0/3091967490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c035020 con 0x7fcca8162970 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.617+0000 7fcca5ffb640 1 -- 172.21.15.19:0/3091967490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c031870 con 0x7fcca8162970 2024-03-04T08:51:20.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.617+0000 7fcca5ffb640 1 -- 172.21.15.19:0/3091967490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c031c40 con 0x7fcca8162970 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 -- 172.21.15.19:0/3091967490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 msgr2=0x7fcca80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80b3580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcca80ce2c0 tx=0x7fcc9c02b910 comp rx=0 tx=0).stop 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 -- 172.21.15.19:0/3091967490 shutdown_connections 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 --2- 172.21.15.19:0/3091967490 >> v2:172.21.15.204:3300/0 conn(0x7fcca8161cf0 0x7fcca8162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80b3580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 --2- 172.21.15.19:0/3091967490 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 -- 172.21.15.19:0/3091967490 >> 172.21.15.19:0/3091967490 conn(0x7fcca80d3ce0 msgr2=0x7fcca80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 -- 172.21.15.19:0/3091967490 shutdown_connections 2024-03-04T08:51:20.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.618+0000 7fccad442640 1 -- 172.21.15.19:0/3091967490 wait complete. 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.619+0000 7fccad442640 1 Processor -- start 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.619+0000 7fccad442640 1 -- start start 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcca8161cf0 0x7fcca81601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80ce950 con 0x7fcca8162970 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80d2b60 con 0x7fcca8161cf0 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80b3ac0 con 0x7fcca80b4460 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36194/0 (socket says 172.21.15.19:36194) 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 -- 172.21.15.19:0/1358176620 learned_addr learned my addr 172.21.15.19:0/1358176620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca6ffd640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca67fc640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcca8161cf0 0x7fcca81601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 -- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 msgr2=0x7fcca80ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 -- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcca8161cf0 msgr2=0x7fcca81601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcca8161cf0 0x7fcca81601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 -- 172.21.15.19:0/1358176620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80b8670 con 0x7fcca8162970 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcca77fe640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcca000efc0 tx=0x7fcca000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0018020 con 0x7fcca8162970 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca0014480 con 0x7fcca8162970 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0014870 con 0x7fcca8162970 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.620+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca80b8950 con 0x7fcca8162970 2024-03-04T08:51:20.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.621+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca80b91f0 con 0x7fcca8162970 2024-03-04T08:51:20.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.622+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca80b8b20 con 0x7fcca8162970 2024-03-04T08:51:20.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.622+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcca0005d10 con 0x7fcca8162970 2024-03-04T08:51:20.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.622+0000 7fcc8f7fe640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 0x7fcc9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:20.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.622+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcca008aa30 con 0x7fcca8162970 2024-03-04T08:51:20.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.623+0000 7fcca6ffd640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 0x7fcc9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.623+0000 7fcca6ffd640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 0x7fcc9406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009aa0 tx=0x7fcc98009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.627+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcca0022070 con 0x7fcca8162970 2024-03-04T08:51:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.818+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcca804f330 con 0x7fcca8162970 2024-03-04T08:51:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.819+0000 7fcc8f7fe640 1 -- 172.21.15.19:0/1358176620 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcca0010040 con 0x7fcca8162970 2024-03-04T08:51:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.820+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 msgr2=0x7fcc9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.820+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 0x7fcc9406d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009aa0 tx=0x7fcc98009190 comp rx=0 tx=0).stop 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.820+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 msgr2=0x7fcca80c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.820+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcca000efc0 tx=0x7fcca000c490 comp rx=0 tx=0).stop 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 shutdown_connections 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcca8162970 0x7fcca80c9270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcc9406b4d0 0x7fcc9406d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcca8161cf0 0x7fcca81601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 --2- 172.21.15.19:0/1358176620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcca80b4460 0x7fcca80ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 >> 172.21.15.19:0/1358176620 conn(0x7fcca80d3ce0 msgr2=0x7fcca806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 shutdown_connections 2024-03-04T08:51:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:20.821+0000 7fccad442640 1 -- 172.21.15.19:0/1358176620 wait complete. 2024-03-04T08:51:20.827 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:51:20.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:20.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-03-04T08:51:20.854 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:20.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:51:20.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:20.855 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-04T08:51:20.910 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:20.910 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:20.925 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:20.926 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:20.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.086+0000 7f406173e640 1 Processor -- start 2024-03-04T08:51:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.086+0000 7f406173e640 1 -- start start 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f406173e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f405c0d00c0 0x7f405c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f406173e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f405c06cf20 0x7f405c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f406173e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0d09e0 con 0x7f405c0cf850 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f406173e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c06ca90 con 0x7f405c0d00c0 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f406173e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c15e380 con 0x7f405c06cf20 2024-03-04T08:51:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f405c0d00c0 0x7f405c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f405c0d00c0 0x7f405c0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36206/0 (socket says 172.21.15.19:36206) 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 -- 172.21.15.19:0/4059526548 learned_addr learned my addr 172.21.15.19:0/4059526548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405b7fe640 1 --2- 172.21.15.19:0/4059526548 >> v2:172.21.15.204:3300/0 conn(0x7f405c06cf20 0x7f405c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 -- 172.21.15.19:0/4059526548 >> v2:172.21.15.204:3300/0 conn(0x7f405c06cf20 msgr2=0x7f405c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 --2- 172.21.15.19:0/4059526548 >> v2:172.21.15.204:3300/0 conn(0x7f405c06cf20 0x7f405c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 -- 172.21.15.19:0/4059526548 >> v1:172.21.15.204:6789/0 conn(0x7f405c0cf850 legacy=0x7f405c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.087+0000 7f405affd640 1 -- 172.21.15.19:0/4059526548 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0cdc10 con 0x7f405c0d00c0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.088+0000 7f405affd640 1 --2- 172.21.15.19:0/4059526548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c0d00c0 0x7f405c0d04a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cfda0 tx=0x7f405402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4b9756ba4eb9af server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.088+0000 7f4059ffb640 1 -- 172.21.15.19:0/4059526548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054034070 con 0x7f405c0d00c0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.088+0000 7f4059ffb640 1 -- 172.21.15.19:0/4059526548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054030860 con 0x7f405c0d00c0 2024-03-04T08:51:21.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.088+0000 7f4059ffb640 1 -- 172.21.15.19:0/4059526548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054030c30 con 0x7f405c0d00c0 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 -- 172.21.15.19:0/4059526548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c0d00c0 msgr2=0x7f405c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 --2- 172.21.15.19:0/4059526548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c0d00c0 0x7f405c0d04a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cfda0 tx=0x7f405402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 -- 172.21.15.19:0/4059526548 shutdown_connections 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 --2- 172.21.15.19:0/4059526548 >> v2:172.21.15.204:3300/0 conn(0x7f405c06cf20 0x7f405c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 --2- 172.21.15.19:0/4059526548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c0d00c0 0x7f405c0d04a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 -- 172.21.15.19:0/4059526548 >> 172.21.15.19:0/4059526548 conn(0x7f405c0b35a0 msgr2=0x7f405c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 -- 172.21.15.19:0/4059526548 shutdown_connections 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.089+0000 7f406173e640 1 -- 172.21.15.19:0/4059526548 wait complete. 2024-03-04T08:51:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.090+0000 7f406173e640 1 Processor -- start 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.090+0000 7f406173e640 1 -- start start 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 0x7f405c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f405c0d00c0 0x7f405c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c06c720 con 0x7f405c06cf20 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c06c440 con 0x7f405c0cf850 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b1030 con 0x7f405c0d00c0 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36220/0 (socket says 172.21.15.19:36220) 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 -- 172.21.15.19:0/367532959 learned_addr learned my addr 172.21.15.19:0/367532959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405b7fe640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f405c0d00c0 0x7f405c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405a7fc640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 0x7f405c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 -- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f405c0d00c0 msgr2=0x7f405c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f405c0d00c0 0x7f405c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 -- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 msgr2=0x7f405c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 0x7f405c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 -- 172.21.15.19:0/367532959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0c9420 con 0x7f405c06cf20 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405a7fc640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 0x7f405c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f405affd640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4054000c00 tx=0x7f4054004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054048070 con 0x7f405c06cf20 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054030660 con 0x7f405c06cf20 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0c9700 con 0x7f405c06cf20 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054034040 con 0x7f405c06cf20 2024-03-04T08:51:21.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.091+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c0c9cc0 con 0x7f405c06cf20 2024-03-04T08:51:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.092+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c04f330 con 0x7f405c06cf20 2024-03-04T08:51:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.093+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f405404b070 con 0x7f405c06cf20 2024-03-04T08:51:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.093+0000 7f40537fe640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 0x7f403c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.093+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40540ac0a0 con 0x7f405c06cf20 2024-03-04T08:51:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.093+0000 7f405a7fc640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 0x7f403c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.094+0000 7f405a7fc640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 0x7f403c06d9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cbb40 tx=0x7f4044009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.098+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f405407a9f0 con 0x7f405c06cf20 2024-03-04T08:51:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.280+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405c06ff60 con 0x7f405c06cf20 2024-03-04T08:51:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.281+0000 7f40537fe640 1 -- 172.21.15.19:0/367532959 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f405407ea90 con 0x7f405c06cf20 2024-03-04T08:51:21.278 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:21.278 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 msgr2=0x7f403c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 0x7f403c06d9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f405c0cbb40 tx=0x7f4044009040 comp rx=0 tx=0).stop 2024-03-04T08:51:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 msgr2=0x7f405c14a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4054000c00 tx=0x7f4054004730 comp rx=0 tx=0).stop 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 shutdown_connections 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f405c0d00c0 0x7f405c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f403c06b500 0x7f403c06d9c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f405c0cf850 0x7f405c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 --2- 172.21.15.19:0/367532959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c06cf20 0x7f405c14a020 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 >> 172.21.15.19:0/367532959 conn(0x7f405c0b35a0 msgr2=0x7f405c06f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 shutdown_connections 2024-03-04T08:51:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.283+0000 7f406173e640 1 -- 172.21.15.19:0/367532959 wait complete. 2024-03-04T08:51:21.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:21.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.399+0000 7f619b73a640 1 Processor -- start 2024-03-04T08:51:21.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.399+0000 7f619b73a640 1 -- start start 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f619b73a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 0x7f61940cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f619b73a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 0x7f61940ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f619b73a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940cd1e0 con 0x7f619415c050 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f619b73a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61940cd4b0 con 0x7f619406fd10 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f619b73a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940cd790 con 0x7f61940d0af0 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f61994d6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f619415c050 0x7f619406f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42328/0 (socket says 172.21.15.19:42328) 2024-03-04T08:51:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f61994d6640 1 -- 172.21.15.19:0/1152361452 learned_addr learned my addr 172.21.15.19:0/1152361452 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f6199cd7640 1 --2- 172.21.15.19:0/1152361452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 0x7f61940ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.400+0000 7f6198cd5640 1 --2- 172.21.15.19:0/1152361452 >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 0x7f61940cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f618bfff640 1 -- 172.21.15.19:0/1152361452 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378214496 0 0) 0x7f61940cd1e0 con 0x7f619415c050 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f618bfff640 1 -- 172.21.15.19:0/1152361452 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6180003520 con 0x7f619415c050 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f6199cd7640 1 -- 172.21.15.19:0/1152361452 >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 msgr2=0x7f61940cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f6199cd7640 1 --2- 172.21.15.19:0/1152361452 >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 0x7f61940cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f6199cd7640 1 -- 172.21.15.19:0/1152361452 >> v1:172.21.15.19:6789/0 conn(0x7f619415c050 legacy=0x7f619406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f6199cd7640 1 -- 172.21.15.19:0/1152361452 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940cda70 con 0x7f61940d0af0 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.401+0000 7f6198cd5640 1 --2- 172.21.15.19:0/1152361452 >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 0x7f61940cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f6199cd7640 1 --2- 172.21.15.19:0/1152361452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 0x7f61940ccca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6190009d90 tx=0x7f619002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700fb146ec424eb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f618bfff640 1 -- 172.21.15.19:0/1152361452 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190039070 con 0x7f61940d0af0 2024-03-04T08:51:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f618bfff640 1 -- 172.21.15.19:0/1152361452 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619002cbc0 con 0x7f61940d0af0 2024-03-04T08:51:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f618bfff640 1 -- 172.21.15.19:0/1152361452 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190034440 con 0x7f61940d0af0 2024-03-04T08:51:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 -- 172.21.15.19:0/1152361452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 msgr2=0x7f61940ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 --2- 172.21.15.19:0/1152361452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 0x7f61940ccca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6190009d90 tx=0x7f619002be10 comp rx=0 tx=0).stop 2024-03-04T08:51:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 -- 172.21.15.19:0/1152361452 shutdown_connections 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 --2- 172.21.15.19:0/1152361452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61940d0af0 0x7f61940ccca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 --2- 172.21.15.19:0/1152361452 >> v2:172.21.15.204:3300/0 conn(0x7f619406fd10 0x7f61940cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 -- 172.21.15.19:0/1152361452 >> 172.21.15.19:0/1152361452 conn(0x7f61940b3800 msgr2=0x7f61940b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 -- 172.21.15.19:0/1152361452 shutdown_connections 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.402+0000 7f619b73a640 1 -- 172.21.15.19:0/1152361452 wait complete. 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 Processor -- start 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 -- start start 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619406fd10 0x7f6194158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619415c050 0x7f61940b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194165c30 con 0x7f61940d0af0 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6194165ab0 con 0x7f619406fd10 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f619b73a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6194165db0 con 0x7f619415c050 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f6198cd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f61994d6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619406fd10 0x7f6194158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f6198cd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36228/0 (socket says 172.21.15.19:36228) 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f6198cd5640 1 -- 172.21.15.19:0/3581021530 learned_addr learned my addr 172.21.15.19:0/3581021530 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.404+0000 7f6199cd7640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619415c050 0x7f61940b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 -- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619415c050 msgr2=0x7f61940b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619415c050 0x7f61940b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 -- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619406fd10 msgr2=0x7f6194158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619406fd10 0x7f6194158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 -- 172.21.15.19:0/3581021530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61941572b0 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6198cd5640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f618400e960 tx=0x7f618400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184017070 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400ca00 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6194157590 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400cdd0 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.405+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6194157b50 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.406+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619409fe60 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.407+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f618401a070 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.407+0000 7f6189ffb640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.407+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f618408a0a0 con 0x7f61940d0af0 2024-03-04T08:51:21.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.407+0000 7f61994d6640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.408+0000 7f61994d6640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 0x7f617806d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f618c005880 tx=0x7f618c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.411+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6184058850 con 0x7f61940d0af0 2024-03-04T08:51:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.592+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6194155bd0 con 0x7f61940d0af0 2024-03-04T08:51:21.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.592+0000 7f6189ffb640 1 -- 172.21.15.19:0/3581021530 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f618405c8f0 con 0x7f61940d0af0 2024-03-04T08:51:21.589 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 msgr2=0x7f617806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 0x7f617806d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f618c005880 tx=0x7f618c009040 comp rx=0 tx=0).stop 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 msgr2=0x7f61940b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f618400e960 tx=0x7f618400ee20 comp rx=0 tx=0).stop 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 shutdown_connections 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f619415c050 0x7f61940b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61940d0af0 0x7f61940b5e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 --2- 172.21.15.19:0/3581021530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f619406fd10 0x7f6194158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 >> 172.21.15.19:0/3581021530 conn(0x7f61940b3800 msgr2=0x7f619415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.594+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 shutdown_connections 2024-03-04T08:51:21.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.595+0000 7f619b73a640 1 -- 172.21.15.19:0/3581021530 wait complete. 2024-03-04T08:51:21.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.709+0000 7fe944c40640 1 Processor -- start 2024-03-04T08:51:21.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.709+0000 7fe944c40640 1 -- start start 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe944c40640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9401586e0 0x7fe9400aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe944c40640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe9400aef80 0x7fe9400cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe944c40640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe940158ac0 con 0x7fe9400cffd0 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe944c40640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94015b2a0 con 0x7fe9401586e0 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe944c40640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94015b540 con 0x7fe9400aef80 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9401586e0 0x7fe9400aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9401586e0 0x7fe9400aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36240/0 (socket says 172.21.15.19:36240) 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 -- 172.21.15.19:0/2587301881 learned_addr learned my addr 172.21.15.19:0/2587301881 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe937fff640 1 --2- 172.21.15.19:0/2587301881 >> v2:172.21.15.204:3300/0 conn(0x7fe9400aef80 0x7fe9400cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 -- 172.21.15.19:0/2587301881 >> v2:172.21.15.204:3300/0 conn(0x7fe9400aef80 msgr2=0x7fe9400cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 --2- 172.21.15.19:0/2587301881 >> v2:172.21.15.204:3300/0 conn(0x7fe9400aef80 0x7fe9400cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 -- 172.21.15.19:0/2587301881 >> v1:172.21.15.204:6789/0 conn(0x7fe9400cffd0 legacy=0x7fe94006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.710+0000 7fe93e59c640 1 -- 172.21.15.19:0/2587301881 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94015b820 con 0x7fe9401586e0 2024-03-04T08:51:21.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.711+0000 7fe93e59c640 1 --2- 172.21.15.19:0/2587301881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9401586e0 0x7fe9400aea40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe940072e30 tx=0x7fe93002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faefb9bf3575a4f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.711+0000 7fe93dd9b640 1 -- 172.21.15.19:0/2587301881 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93003b070 con 0x7fe9401586e0 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.711+0000 7fe93dd9b640 1 -- 172.21.15.19:0/2587301881 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930036440 con 0x7fe9401586e0 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.711+0000 7fe93dd9b640 1 -- 172.21.15.19:0/2587301881 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930036810 con 0x7fe9401586e0 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 -- 172.21.15.19:0/2587301881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9401586e0 msgr2=0x7fe9400aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 --2- 172.21.15.19:0/2587301881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9401586e0 0x7fe9400aea40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe940072e30 tx=0x7fe93002e170 comp rx=0 tx=0).stop 2024-03-04T08:51:21.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 -- 172.21.15.19:0/2587301881 shutdown_connections 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 --2- 172.21.15.19:0/2587301881 >> v2:172.21.15.204:3300/0 conn(0x7fe9400aef80 0x7fe9400cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 --2- 172.21.15.19:0/2587301881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9401586e0 0x7fe9400aea40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 -- 172.21.15.19:0/2587301881 >> 172.21.15.19:0/2587301881 conn(0x7fe94006b190 msgr2=0x7fe94006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 -- 172.21.15.19:0/2587301881 shutdown_connections 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.712+0000 7fe944c40640 1 -- 172.21.15.19:0/2587301881 wait complete. 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.713+0000 7fe944c40640 1 Processor -- start 2024-03-04T08:51:21.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.713+0000 7fe944c40640 1 -- start start 2024-03-04T08:51:21.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9400aef80 0x7fe9400a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9401586e0 0x7fe9401578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940071350 con 0x7fe9400cffd0 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94015bde0 con 0x7fe9401586e0 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400714d0 con 0x7fe9400aef80 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36254/0 (socket says 172.21.15.19:36254) 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 -- 172.21.15.19:0/2452436100 learned_addr learned my addr 172.21.15.19:0/2452436100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe93ed9d640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9401586e0 0x7fe9401578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe93e59c640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9400aef80 0x7fe9400a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 -- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9400aef80 msgr2=0x7fe9400a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9400aef80 0x7fe9400a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 -- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9401586e0 msgr2=0x7fe9401578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9401586e0 0x7fe9401578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 -- 172.21.15.19:0/2452436100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400a9b50 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe937fff640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e980 tx=0x7fe92800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928017070 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800c9a0 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400a9e30 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.714+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92800cd70 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.715+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400aa3f0 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.716+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940158240 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.716+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe92801a070 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.716+0000 7fe936ffd640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 0x7fe92006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.717+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe92808a3b0 con 0x7fe9400cffd0 2024-03-04T08:51:21.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.717+0000 7fe93e59c640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 0x7fe92006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:21.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.717+0000 7fe93e59c640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 0x7fe92006d9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe930038000 tx=0x7fe930032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:21.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.721+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe940158240 con 0x7fe9400cffd0 2024-03-04T08:51:21.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.905+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9400732b0 con 0x7fe9400cffd0 2024-03-04T08:51:21.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.905+0000 7fe936ffd640 1 -- 172.21.15.19:0/2452436100 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe928058c70 con 0x7fe9400cffd0 2024-03-04T08:51:21.902 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 msgr2=0x7fe92006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 0x7fe92006d9c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe930038000 tx=0x7fe930032000 comp rx=0 tx=0).stop 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 msgr2=0x7fe9401484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e980 tx=0x7fe92800ee40 comp rx=0 tx=0).stop 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 shutdown_connections 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe92006b500 0x7fe92006d9c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe9401586e0 0x7fe9401578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9400cffd0 0x7fe9401484c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 --2- 172.21.15.19:0/2452436100 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe9400aef80 0x7fe9400a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:21.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 >> 172.21.15.19:0/2452436100 conn(0x7fe94006b190 msgr2=0x7fe940072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:21.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 shutdown_connections 2024-03-04T08:51:21.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:21.907+0000 7fe944c40640 1 -- 172.21.15.19:0/2452436100 wait complete. 2024-03-04T08:51:21.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:22.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.022+0000 7fe0425a2640 1 Processor -- start 2024-03-04T08:51:22.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.022+0000 7fe0425a2640 1 -- start start 2024-03-04T08:51:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0425a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 0x7fe03c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0425a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0d4870 con 0x7fe03c0b50a0 2024-03-04T08:51:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0425a2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0ce750 con 0x7fe03c0d02e0 2024-03-04T08:51:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0425a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0b5480 con 0x7fe03c0d0720 2024-03-04T08:51:22.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0415a0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe03c0b50a0 0x7fe03c0d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42336/0 (socket says 172.21.15.19:42336) 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe0415a0640 1 -- 172.21.15.19:0/2034203900 learned_addr learned my addr 172.21.15.19:0/2034203900 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.023+0000 7fe041da1640 1 --2- 172.21.15.19:0/2034203900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 0x7fe03c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639839748 0 0) 0x7fe03c0d4870 con 0x7fe03c0b50a0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe024003520 con 0x7fe03c0b50a0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196518103 0 0) 0x7fe03c0ce750 con 0x7fe03c0d02e0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c0d4870 con 0x7fe03c0d02e0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307143681 0 0) 0x7fe024003520 con 0x7fe03c0b50a0 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe041da1640 1 -- 172.21.15.19:0/2034203900 >> v1:172.21.15.204:6789/0 conn(0x7fe03c0d02e0 legacy=0x7fe03c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe041da1640 1 -- 172.21.15.19:0/2034203900 >> v1:172.21.15.19:6789/0 conn(0x7fe03c0b50a0 legacy=0x7fe03c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.024+0000 7fe041da1640 1 -- 172.21.15.19:0/2034203900 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0ce9f0 con 0x7fe03c0d0720 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe041da1640 1 --2- 172.21.15.19:0/2034203900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 0x7fe03c15dea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009dc0 tx=0x7fe02c02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadd6ea693a4a09e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c039070 con 0x7fe03c0d0720 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c02c9a0 con 0x7fe03c0d0720 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe03bfff640 1 -- 172.21.15.19:0/2034203900 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034001670 con 0x7fe03c0d0720 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 -- 172.21.15.19:0/2034203900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 msgr2=0x7fe03c15dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 --2- 172.21.15.19:0/2034203900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 0x7fe03c15dea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009dc0 tx=0x7fe02c02be70 comp rx=0 tx=0).stop 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 -- 172.21.15.19:0/2034203900 shutdown_connections 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 --2- 172.21.15.19:0/2034203900 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d0720 0x7fe03c15dea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 -- 172.21.15.19:0/2034203900 >> 172.21.15.19:0/2034203900 conn(0x7fe03c09ce10 msgr2=0x7fe03c0d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 -- 172.21.15.19:0/2034203900 shutdown_connections 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.025+0000 7fe0425a2640 1 -- 172.21.15.19:0/2034203900 wait complete. 2024-03-04T08:51:22.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 Processor -- start 2024-03-04T08:51:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 -- start start 2024-03-04T08:51:22.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d02e0 0x7fe03c0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe03c0d0720 0x7fe03c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0cf290 con 0x7fe03c0b50a0 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0cefb0 con 0x7fe03c0d0720 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0425a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0cf570 con 0x7fe03c0d02e0 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0415a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0415a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36266/0 (socket says 172.21.15.19:36266) 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe0415a0640 1 -- 172.21.15.19:0/4157127452 learned_addr learned my addr 172.21.15.19:0/4157127452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe041da1640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe03c0d0720 0x7fe03c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.027+0000 7fe040d9f640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d02e0 0x7fe03c0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 -- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d02e0 msgr2=0x7fe03c0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d02e0 0x7fe03c0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 -- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe03c0d0720 msgr2=0x7fe03c1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe03c0d0720 0x7fe03c1f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 -- 172.21.15.19:0/4157127452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0c7ec0 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0415a0640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c780 tx=0x7fe03400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034017070 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034005af0 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c0c81a0 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034007070 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.028+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c0c8760 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.029+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c068f10 con 0x7fe03c0b50a0 2024-03-04T08:51:22.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.030+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe03401a070 con 0x7fe03c0b50a0 2024-03-04T08:51:22.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.030+0000 7fe039ffb640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 0x7fe02806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.030+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe034089730 con 0x7fe03c0b50a0 2024-03-04T08:51:22.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.030+0000 7fe040d9f640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 0x7fe02806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.031+0000 7fe040d9f640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 0x7fe02806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0cabc0 tx=0x7fe030009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.034+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe034057f60 con 0x7fe03c0b50a0 2024-03-04T08:51:22.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.216+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe03c1f36d0 con 0x7fe03c0b50a0 2024-03-04T08:51:22.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.216+0000 7fe039ffb640 1 -- 172.21.15.19:0/4157127452 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe03405c000 con 0x7fe03c0b50a0 2024-03-04T08:51:22.213 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:22.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 msgr2=0x7fe02806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 0x7fe02806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0cabc0 tx=0x7fe030009040 comp rx=0 tx=0).stop 2024-03-04T08:51:22.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 msgr2=0x7fe03c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c780 tx=0x7fe03400cc40 comp rx=0 tx=0).stop 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 shutdown_connections 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe02806b4d0 0x7fe02806d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe03c0d0720 0x7fe03c1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe03c0d02e0 0x7fe03c0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 --2- 172.21.15.19:0/4157127452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe03c0b50a0 0x7fe03c0c9db0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 >> 172.21.15.19:0/4157127452 conn(0x7fe03c09ce10 msgr2=0x7fe03c1612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 shutdown_connections 2024-03-04T08:51:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.218+0000 7fe0425a2640 1 -- 172.21.15.19:0/4157127452 wait complete. 2024-03-04T08:51:22.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.331+0000 7f19f5cfb640 1 Processor -- start 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.331+0000 7f19f5cfb640 1 -- start start 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19f5cfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f00d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19f5cfb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00d22c0 con 0x7f19f00b4460 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19f5cfb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00d25a0 con 0x7f19f0161cf0 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19f5cfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0161b00 con 0x7f19f0162970 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19ef7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f19f00b4460 0x7f19f00b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42346/0 (socket says 172.21.15.19:42346) 2024-03-04T08:51:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19ef7fe640 1 -- 172.21.15.19:0/139346729 learned_addr learned my addr 172.21.15.19:0/139346729 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19eeffd640 1 --2- 172.21.15.19:0/139346729 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f00d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.332+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436487882 0 0) 0x7f19f00d22c0 con 0x7f19f00b4460 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d8003520 con 0x7f19f00b4460 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606653831 0 0) 0x7f19f00d25a0 con 0x7f19f0161cf0 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19eeffd640 1 -- 172.21.15.19:0/139346729 >> v1:172.21.15.204:6789/0 conn(0x7f19f0161cf0 legacy=0x7f19f00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19eeffd640 1 -- 172.21.15.19:0/139346729 >> v1:172.21.15.19:6789/0 conn(0x7f19f00b4460 legacy=0x7f19f00b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19eeffd640 1 -- 172.21.15.19:0/139346729 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00d2880 con 0x7f19f0162970 2024-03-04T08:51:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.333+0000 7f19eeffd640 1 --2- 172.21.15.19:0/139346729 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f00d4800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19e40097d0 tx=0x7f19e402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8650c87a2eae7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4035020 con 0x7f19f0162970 2024-03-04T08:51:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4031890 con 0x7f19f0162970 2024-03-04T08:51:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19ee7fc640 1 -- 172.21.15.19:0/139346729 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4031c60 con 0x7f19f0162970 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 -- 172.21.15.19:0/139346729 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 msgr2=0x7f19f00d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/139346729 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f00d4800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19e40097d0 tx=0x7f19e402b930 comp rx=0 tx=0).stop 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 -- 172.21.15.19:0/139346729 shutdown_connections 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/139346729 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f00d4800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 -- 172.21.15.19:0/139346729 >> 172.21.15.19:0/139346729 conn(0x7f19f00d3ce0 msgr2=0x7f19f00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 -- 172.21.15.19:0/139346729 shutdown_connections 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.334+0000 7f19f5cfb640 1 -- 172.21.15.19:0/139346729 wait complete. 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.335+0000 7f19f5cfb640 1 Processor -- start 2024-03-04T08:51:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.335+0000 7f19f5cfb640 1 -- start start 2024-03-04T08:51:22.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19f00b4460 0x7f19f01592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f01f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00ce950 con 0x7f19f0161cf0 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00cecc0 con 0x7f19f00b4460 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19f5cfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00b4840 con 0x7f19f0162970 2024-03-04T08:51:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36276/0 (socket says 172.21.15.19:36276) 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19eeffd640 1 -- 172.21.15.19:0/2711028642 learned_addr learned my addr 172.21.15.19:0/2711028642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19ef7fe640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19f00b4460 0x7f19f01592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.336+0000 7f19effff640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f01f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 -- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 msgr2=0x7f19f01f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f01f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 -- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19f00b4460 msgr2=0x7f19f01592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19f00b4460 0x7f19f01592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 -- 172.21.15.19:0/2711028642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f01f4720 con 0x7f19f0161cf0 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19eeffd640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000c00 tx=0x7f19e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4035050 con 0x7f19f0161cf0 2024-03-04T08:51:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e403bd70 con 0x7f19f0161cf0 2024-03-04T08:51:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f01f4a00 con 0x7f19f0161cf0 2024-03-04T08:51:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4045630 con 0x7f19f0161cf0 2024-03-04T08:51:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.337+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00b77e0 con 0x7f19f0161cf0 2024-03-04T08:51:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.338+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f01f4c20 con 0x7f19f0161cf0 2024-03-04T08:51:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.338+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19e404c060 con 0x7f19f0161cf0 2024-03-04T08:51:22.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.339+0000 7f19d7fff640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 0x7f19dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.339+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e40ac230 con 0x7f19f0161cf0 2024-03-04T08:51:22.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.339+0000 7f19ef7fe640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 0x7f19dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.339+0000 7f19ef7fe640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 0x7f19dc06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005880 tx=0x7f19e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.343+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f19e4040070 con 0x7f19f0161cf0 2024-03-04T08:51:22.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.536+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19f004f330 con 0x7f19f0161cf0 2024-03-04T08:51:22.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.536+0000 7f19d7fff640 1 -- 172.21.15.19:0/2711028642 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19e402d040 con 0x7f19f0161cf0 2024-03-04T08:51:22.533 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 msgr2=0x7f19dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 0x7f19dc06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005880 tx=0x7f19e0009040 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 msgr2=0x7f19f00b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000c00 tx=0x7f19e40046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 shutdown_connections 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f19f0162970 0x7f19f01f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19f0161cf0 0x7f19f00b72a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f19dc06b4d0 0x7f19dc06d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 --2- 172.21.15.19:0/2711028642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f19f00b4460 0x7f19f01592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 >> 172.21.15.19:0/2711028642 conn(0x7f19f00d3ce0 msgr2=0x7f19f00d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 shutdown_connections 2024-03-04T08:51:22.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.538+0000 7f19f5cfb640 1 -- 172.21.15.19:0/2711028642 wait complete. 2024-03-04T08:51:22.545 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:51:22.545 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:22.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 Processor -- start 2024-03-04T08:51:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 -- start start 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b80cf850 0x7f64b80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b815e380 con 0x7f64b806cf20 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b80cdc10 con 0x7f64b80d00c0 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.667+0000 7f64bd22a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b806ca90 con 0x7f64b80cf850 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b80cf850 0x7f64b80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b80cf850 0x7f64b80cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36282/0 (socket says 172.21.15.19:36282) 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64b759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f64b806cf20 0x7f64b806d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42356/0 (socket says 172.21.15.19:42356) 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 -- 172.21.15.19:0/1630644797 learned_addr learned my addr 172.21.15.19:0/1630644797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 -- 172.21.15.19:0/1630644797 >> v1:172.21.15.204:6789/0 conn(0x7f64b80d00c0 legacy=0x7f64b80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 -- 172.21.15.19:0/1630644797 >> v1:172.21.15.19:6789/0 conn(0x7f64b806cf20 legacy=0x7f64b806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64b659c640 1 -- 172.21.15.19:0/1630644797 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051807106 0 0) 0x7f64b815e380 con 0x7f64b806cf20 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.668+0000 7f64affff640 1 -- 172.21.15.19:0/1630644797 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b806c160 con 0x7f64b80cf850 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64affff640 1 --2- 172.21.15.19:0/1630644797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b80cf850 0x7f64b80cd3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009870 tx=0x7f64a002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c9dbe465e24015 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64b659c640 1 -- 172.21.15.19:0/1630644797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a002f840 con 0x7f64b80cf850 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64b659c640 1 -- 172.21.15.19:0/1630644797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a002f9e0 con 0x7f64b80cf850 2024-03-04T08:51:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64b659c640 1 -- 172.21.15.19:0/1630644797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a002fdb0 con 0x7f64b80cf850 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 -- 172.21.15.19:0/1630644797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b80cf850 msgr2=0x7f64b80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1630644797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b80cf850 0x7f64b80cd3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009870 tx=0x7f64a002ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 -- 172.21.15.19:0/1630644797 shutdown_connections 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1630644797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b80cf850 0x7f64b80cd3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 -- 172.21.15.19:0/1630644797 >> 172.21.15.19:0/1630644797 conn(0x7f64b80b35a0 msgr2=0x7f64b80b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 -- 172.21.15.19:0/1630644797 shutdown_connections 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.669+0000 7f64bd22a640 1 -- 172.21.15.19:0/1630644797 wait complete. 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 Processor -- start 2024-03-04T08:51:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 -- start start 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b80cf850 0x7f64b80c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b80d00c0 0x7f64b80af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80cd900 con 0x7f64b806cf20 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b806c720 con 0x7f64b80d00c0 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64bd22a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b1030 con 0x7f64b80cf850 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36284/0 (socket says 172.21.15.19:36284) 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64b6d9d640 1 -- 172.21.15.19:0/1956746327 learned_addr learned my addr 172.21.15.19:0/1956746327 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.671+0000 7f64b759e640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b80d00c0 0x7f64b80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64affff640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b80cf850 0x7f64b80c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 -- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b80cf850 msgr2=0x7f64b80c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b80cf850 0x7f64b80c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 -- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b80d00c0 msgr2=0x7f64b80af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b80d00c0 0x7f64b80af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 -- 172.21.15.19:0/1956746327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80c73f0 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64b6d9d640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c400 tx=0x7f64a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8017070 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a80052d0 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8003830 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80c76d0 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.672+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80c7c90 con 0x7f64b806cf20 2024-03-04T08:51:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.673+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b804f330 con 0x7f64b806cf20 2024-03-04T08:51:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.674+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64a801a070 con 0x7f64b806cf20 2024-03-04T08:51:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.674+0000 7f64af7fe640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.674+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64a80894b0 con 0x7f64b806cf20 2024-03-04T08:51:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.674+0000 7f64affff640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.675+0000 7f64affff640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 0x7f649806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f64a0036000 tx=0x7f64a0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.678+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f64a8057ce0 con 0x7f64b806cf20 2024-03-04T08:51:22.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.859+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64b815d840 con 0x7f64b806cf20 2024-03-04T08:51:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.860+0000 7f64af7fe640 1 -- 172.21.15.19:0/1956746327 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f64a805bd80 con 0x7f64b806cf20 2024-03-04T08:51:22.857 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:22.857 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 msgr2=0x7f649806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 0x7f649806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f64a0036000 tx=0x7f64a0008030 comp rx=0 tx=0).stop 2024-03-04T08:51:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 msgr2=0x7f64b80c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c400 tx=0x7f64a800c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 shutdown_connections 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b80d00c0 0x7f64b80af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b80cf850 0x7f64b80c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 --2- 172.21.15.19:0/1956746327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b806cf20 0x7f64b80c9ee0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 >> 172.21.15.19:0/1956746327 conn(0x7f64b80b35a0 msgr2=0x7f64b80d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 shutdown_connections 2024-03-04T08:51:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.863+0000 7f64bd22a640 1 -- 172.21.15.19:0/1956746327 wait complete. 2024-03-04T08:51:22.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:22.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.978+0000 7f1292d13640 1 Processor -- start 2024-03-04T08:51:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.978+0000 7f1292d13640 1 -- start start 2024-03-04T08:51:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1292d13640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 0x7f128c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1292d13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f128c06cab0 0x7f128c0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1292d13640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c06d030 con 0x7f128c15def0 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1292d13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0cf1c0 con 0x7f128c06cab0 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1292d13640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0cc760 con 0x7f128c0cea50 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f128c06cab0 0x7f128c0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1290aaf640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f128c15def0 0x7f128c0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:52776/0 (socket says 172.21.15.19:52776) 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f128c06cab0 0x7f128c0ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36288/0 (socket says 172.21.15.19:36288) 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f1290aaf640 1 -- 172.21.15.19:0/474698681 learned_addr learned my addr 172.21.15.19:0/474698681 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f128bfff640 1 --2- 172.21.15.19:0/474698681 >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 0x7f128c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 -- 172.21.15.19:0/474698681 >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 msgr2=0x7f128c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 --2- 172.21.15.19:0/474698681 >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 0x7f128c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 -- 172.21.15.19:0/474698681 >> v1:172.21.15.204:6789/0 conn(0x7f128c15def0 legacy=0x7f128c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f12912b0640 1 -- 172.21.15.19:0/474698681 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c06d310 con 0x7f128c06cab0 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f128b7fe640 1 -- 172.21.15.19:0/474698681 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755041761 0 0) 0x7f128c06d030 con 0x7f128c15def0 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.979+0000 7f128bfff640 1 --2- 172.21.15.19:0/474698681 >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 0x7f128c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.980+0000 7f12912b0640 1 --2- 172.21.15.19:0/474698681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c06cab0 0x7f128c0ccbf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f128c0b3660 tx=0x7f128402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adc63970aab6bda server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.980+0000 7f128b7fe640 1 -- 172.21.15.19:0/474698681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284039070 con 0x7f128c06cab0 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.980+0000 7f128b7fe640 1 -- 172.21.15.19:0/474698681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128402cc80 con 0x7f128c06cab0 2024-03-04T08:51:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.980+0000 7f128b7fe640 1 -- 172.21.15.19:0/474698681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284034660 con 0x7f128c06cab0 2024-03-04T08:51:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 -- 172.21.15.19:0/474698681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c06cab0 msgr2=0x7f128c0ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 --2- 172.21.15.19:0/474698681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c06cab0 0x7f128c0ccbf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f128c0b3660 tx=0x7f128402bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 -- 172.21.15.19:0/474698681 shutdown_connections 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 --2- 172.21.15.19:0/474698681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c06cab0 0x7f128c0ccbf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 --2- 172.21.15.19:0/474698681 >> v2:172.21.15.204:3300/0 conn(0x7f128c0cea50 0x7f128c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 -- 172.21.15.19:0/474698681 >> 172.21.15.19:0/474698681 conn(0x7f128c0b3690 msgr2=0x7f128c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 -- 172.21.15.19:0/474698681 shutdown_connections 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.981+0000 7f1292d13640 1 -- 172.21.15.19:0/474698681 wait complete. 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.982+0000 7f1292d13640 1 Processor -- start 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.982+0000 7f1292d13640 1 -- start start 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128c06cab0 0x7f128c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f128c15def0 0x7f128c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15e2d0 con 0x7f128c0cea50 2024-03-04T08:51:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cc3f0 con 0x7f128c06cab0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1292d13640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15e450 con 0x7f128c15def0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36296/0 (socket says 172.21.15.19:36296) 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 -- 172.21.15.19:0/2103874945 learned_addr learned my addr 172.21.15.19:0/2103874945 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f1290aaf640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128c06cab0 0x7f128c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f12912b0640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f128c15def0 0x7f128c0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 -- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f128c15def0 msgr2=0x7f128c0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f128c15def0 0x7f128c0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 -- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128c06cab0 msgr2=0x7f128c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128c06cab0 0x7f128c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 -- 172.21.15.19:0/2103874945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c15d120 con 0x7f128c0cea50 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.983+0000 7f128bfff640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f127800ec10 tx=0x7f127800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.984+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278017070 con 0x7f128c0cea50 2024-03-04T08:51:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.984+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127800cc30 con 0x7f128c0cea50 2024-03-04T08:51:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.984+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c0b4920 con 0x7f128c0cea50 2024-03-04T08:51:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.984+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278013470 con 0x7f128c0cea50 2024-03-04T08:51:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.984+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c0b4ee0 con 0x7f128c0cea50 2024-03-04T08:51:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.985+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c09fcf0 con 0x7f128c0cea50 2024-03-04T08:51:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.985+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f127801a070 con 0x7f128c0cea50 2024-03-04T08:51:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.985+0000 7f12897fa640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 0x7f127006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.986+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f127808a150 con 0x7f128c0cea50 2024-03-04T08:51:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.986+0000 7f1290aaf640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 0x7f127006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.986+0000 7f1290aaf640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 0x7f127006d9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1280007fd0 tx=0x7f1280007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:22.990+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f128c15d120 con 0x7f128c0cea50 2024-03-04T08:51:23.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.171+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f128c068ff0 con 0x7f128c0cea50 2024-03-04T08:51:23.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.171+0000 7f12897fa640 1 -- 172.21.15.19:0/2103874945 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12780588e0 con 0x7f128c0cea50 2024-03-04T08:51:23.172 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:23.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 msgr2=0x7f127006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 0x7f127006d9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1280007fd0 tx=0x7f1280007de0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 msgr2=0x7f128c0cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f127800ec10 tx=0x7f127800c520 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 shutdown_connections 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f128c15def0 0x7f128c0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f128c0cea50 0x7f128c0cad20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f127006b500 0x7f127006d9c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 --2- 172.21.15.19:0/2103874945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f128c06cab0 0x7f128c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 >> 172.21.15.19:0/2103874945 conn(0x7f128c0b3690 msgr2=0x7f128c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 shutdown_connections 2024-03-04T08:51:23.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.173+0000 7f1292d13640 1 -- 172.21.15.19:0/2103874945 wait complete. 2024-03-04T08:51:23.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:23.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.289+0000 7fef864a4640 1 Processor -- start 2024-03-04T08:51:23.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.289+0000 7fef864a4640 1 -- start start 2024-03-04T08:51:23.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef864a4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef801614d0 0x7fef800d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef864a4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fef800d1910 0x7fef800d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef864a4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef801618b0 con 0x7fef800d22e0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef864a4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800cf400 con 0x7fef801614d0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef864a4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800d2710 con 0x7fef800d1910 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef7ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef801614d0 0x7fef800d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef7ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef801614d0 0x7fef800d4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36300/0 (socket says 172.21.15.19:36300) 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef7ffff640 1 -- 172.21.15.19:0/2404894045 learned_addr learned my addr 172.21.15.19:0/2404894045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.290+0000 7fef7f7fe640 1 --2- 172.21.15.19:0/2404894045 >> v2:172.21.15.204:3300/0 conn(0x7fef800d1910 0x7fef800d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7ffff640 1 -- 172.21.15.19:0/2404894045 >> v2:172.21.15.204:3300/0 conn(0x7fef800d1910 msgr2=0x7fef800d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7ffff640 1 --2- 172.21.15.19:0/2404894045 >> v2:172.21.15.204:3300/0 conn(0x7fef800d1910 0x7fef800d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7ffff640 1 -- 172.21.15.19:0/2404894045 >> v1:172.21.15.204:6789/0 conn(0x7fef800d22e0 legacy=0x7fef800d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7ffff640 1 -- 172.21.15.19:0/2404894045 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800cf6a0 con 0x7fef801614d0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7ffff640 1 --2- 172.21.15.19:0/2404894045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800d4860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fef800ce550 tx=0x7fef7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04a7a12f2017274 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7effd640 1 -- 172.21.15.19:0/2404894045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70034070 con 0x7fef801614d0 2024-03-04T08:51:23.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7effd640 1 -- 172.21.15.19:0/2404894045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70030860 con 0x7fef801614d0 2024-03-04T08:51:23.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.291+0000 7fef7effd640 1 -- 172.21.15.19:0/2404894045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70030c30 con 0x7fef801614d0 2024-03-04T08:51:23.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 -- 172.21.15.19:0/2404894045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 msgr2=0x7fef800d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 --2- 172.21.15.19:0/2404894045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800d4860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fef800ce550 tx=0x7fef7002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 -- 172.21.15.19:0/2404894045 shutdown_connections 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 --2- 172.21.15.19:0/2404894045 >> v2:172.21.15.204:3300/0 conn(0x7fef800d1910 0x7fef800d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 --2- 172.21.15.19:0/2404894045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800d4860 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 -- 172.21.15.19:0/2404894045 >> 172.21.15.19:0/2404894045 conn(0x7fef800d3d40 msgr2=0x7fef800d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 -- 172.21.15.19:0/2404894045 shutdown_connections 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.292+0000 7fef864a4640 1 -- 172.21.15.19:0/2404894045 wait complete. 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.293+0000 7fef864a4640 1 Processor -- start 2024-03-04T08:51:23.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.293+0000 7fef864a4640 1 -- start start 2024-03-04T08:51:23.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef800d1910 0x7fef80151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef800d22e0 0x7fef800b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b0910 con 0x7fef801614d0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800cfc60 con 0x7fef800d1910 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef864a4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b1e40 con 0x7fef800d22e0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36306/0 (socket says 172.21.15.19:36306) 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 -- 172.21.15.19:0/1357463946 learned_addr learned my addr 172.21.15.19:0/1357463946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef7f7fe640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef800d22e0 0x7fef800b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef7ffff640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef800d1910 0x7fef80151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 -- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef800d22e0 msgr2=0x7fef800b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef800d22e0 0x7fef800b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 -- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef800d1910 msgr2=0x7fef80151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef800d1910 0x7fef80151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.294+0000 7fef84a41640 1 -- 172.21.15.19:0/1357463946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800cb9a0 con 0x7fef801614d0 2024-03-04T08:51:23.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef84a41640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c760 tx=0x7fef7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78003b90 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78003d30 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7800aa90 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800cbc80 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.295+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800cc240 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.296+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80068ff0 con 0x7fef801614d0 2024-03-04T08:51:23.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.296+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef7800ac30 con 0x7fef801614d0 2024-03-04T08:51:23.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.297+0000 7fef7cff9640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 0x7fef6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.297+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef7808a010 con 0x7fef801614d0 2024-03-04T08:51:23.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.297+0000 7fef7ffff640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 0x7fef6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.297+0000 7fef7ffff640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 0x7fef6c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef70036000 tx=0x7fef7003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.301+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fef78058840 con 0x7fef801614d0 2024-03-04T08:51:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.482+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef800b54a0 con 0x7fef801614d0 2024-03-04T08:51:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.483+0000 7fef7cff9640 1 -- 172.21.15.19:0/1357463946 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef7805c8e0 con 0x7fef801614d0 2024-03-04T08:51:23.479 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 msgr2=0x7fef6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 0x7fef6c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef70036000 tx=0x7fef7003b040 comp rx=0 tx=0).stop 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 msgr2=0x7fef800b9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c760 tx=0x7fef7800cc20 comp rx=0 tx=0).stop 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 shutdown_connections 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef801614d0 0x7fef800b9040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fef800d22e0 0x7fef800b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fef6c06b4d0 0x7fef6c06d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 --2- 172.21.15.19:0/1357463946 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fef800d1910 0x7fef80151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 >> 172.21.15.19:0/1357463946 conn(0x7fef800d3d40 msgr2=0x7fef800d2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 shutdown_connections 2024-03-04T08:51:23.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.485+0000 7fef864a4640 1 -- 172.21.15.19:0/1357463946 wait complete. 2024-03-04T08:51:23.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.599+0000 7f3ba0dd7640 1 Processor -- start 2024-03-04T08:51:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.599+0000 7f3ba0dd7640 1 -- start start 2024-03-04T08:51:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3b9c15bb40 0x7f3b9c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b9c15f7d0 0x7f3b9c06d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c06d5c0 0x7f3b9c0cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c06c910 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c15ff90 con 0x7f3b9c15bb40 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3ba0dd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c160270 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b9c15f7d0 0x7f3b9c06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b9c15f7d0 0x7f3b9c06d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36314/0 (socket says 172.21.15.19:36314) 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 -- 172.21.15.19:0/270246474 learned_addr learned my addr 172.21.15.19:0/270246474 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b9a59c640 1 --2- 172.21.15.19:0/270246474 >> v2:172.21.15.204:3300/0 conn(0x7f3b9c15bb40 0x7f3b9c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b9ad9d640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c06d5c0 0x7f3b9c0cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 -- 172.21.15.19:0/270246474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c06d5c0 msgr2=0x7f3b9c0cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c06d5c0 0x7f3b9c0cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 -- 172.21.15.19:0/270246474 >> v2:172.21.15.204:3300/0 conn(0x7f3b9c15bb40 msgr2=0x7f3b9c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/270246474 >> v2:172.21.15.204:3300/0 conn(0x7f3b9c15bb40 0x7f3b9c0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.600+0000 7f3b99d9b640 1 -- 172.21.15.19:0/270246474 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c160550 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.601+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c15f7d0 0x7f3b9c06d080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0b4f60 tx=0x7f3b8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70470592cc90f4b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.601+0000 7f3b9959a640 1 -- 172.21.15.19:0/270246474 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84035020 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.601+0000 7f3b9959a640 1 -- 172.21.15.19:0/270246474 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84031870 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.601+0000 7f3b9959a640 1 -- 172.21.15.19:0/270246474 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84031c40 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/270246474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c15f7d0 msgr2=0x7f3b9c06d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c15f7d0 0x7f3b9c06d080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0b4f60 tx=0x7f3b8402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/270246474 shutdown_connections 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c06d5c0 0x7f3b9c0cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/270246474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c15f7d0 0x7f3b9c06d080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/270246474 >> v2:172.21.15.204:3300/0 conn(0x7f3b9c15bb40 0x7f3b9c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/270246474 >> 172.21.15.19:0/270246474 conn(0x7f3b9c06b190 msgr2=0x7f3b9c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/270246474 shutdown_connections 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.602+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/270246474 wait complete. 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.603+0000 7f3ba0dd7640 1 Processor -- start 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.603+0000 7f3ba0dd7640 1 -- start start 2024-03-04T08:51:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b9c15bb40 0x7f3b9c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c15f7d0 0x7f3b9c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c15bf20 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c15fc30 con 0x7f3b9c15bb40 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3ba0dd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c15c0a0 con 0x7f3b9c15f7d0 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3b9a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3b9a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36316/0 (socket says 172.21.15.19:36316) 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3b9a59c640 1 -- 172.21.15.19:0/1031580632 learned_addr learned my addr 172.21.15.19:0/1031580632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b9c15bb40 0x7f3b9c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.604+0000 7f3b9ad9d640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c15f7d0 0x7f3b9c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 -- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c15f7d0 msgr2=0x7f3b9c1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c15f7d0 0x7f3b9c1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 -- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b9c15bb40 msgr2=0x7f3b9c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b9c15bb40 0x7f3b9c147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 -- 172.21.15.19:0/1031580632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0b11f0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b9a59c640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400e9b0 tx=0x7f3b9400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94017070 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9400c9a0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c0b14d0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400cd90 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.605+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c147f80 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.606+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0732b0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.606+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b9401a070 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.607+0000 7f3b92ffd640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 0x7f3b7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.607+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b9408a3f0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.607+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 0x7f3b7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.608+0000 7f3b99d9b640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 0x7f3b7c06d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b84036000 tx=0x7f3b84008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.611+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3b94058cb0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.795+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b9c068ff0 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.795+0000 7f3b92ffd640 1 -- 172.21.15.19:0/1031580632 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b9405cd50 con 0x7f3b9c06d5c0 2024-03-04T08:51:23.791 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 msgr2=0x7f3b7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 0x7f3b7c06d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b84036000 tx=0x7f3b84008030 comp rx=0 tx=0).stop 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 msgr2=0x7f3b9c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400e9b0 tx=0x7f3b9400ee70 comp rx=0 tx=0).stop 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 shutdown_connections 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3b9c15f7d0 0x7f3b9c1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3b7c06b500 0x7f3b7c06d9c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3b9c15bb40 0x7f3b9c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 --2- 172.21.15.19:0/1031580632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b9c06d5c0 0x7f3b9c0b0c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 >> 172.21.15.19:0/1031580632 conn(0x7f3b9c06b190 msgr2=0x7f3b9c15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 shutdown_connections 2024-03-04T08:51:23.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.797+0000 7f3ba0dd7640 1 -- 172.21.15.19:0/1031580632 wait complete. 2024-03-04T08:51:23.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.910+0000 7f2a0b981640 1 Processor -- start 2024-03-04T08:51:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.910+0000 7f2a0b981640 1 -- start start 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0b981640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a040b4460 0x7f2a040d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0b981640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04161cf0 0x7f2a04162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0b981640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040d22c0 con 0x7f2a04162970 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0b981640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a04161b00 con 0x7f2a040b4460 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0b981640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040cecc0 con 0x7f2a04161cf0 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a0971d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a040b4460 0x7f2a040d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a08f1c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a04162970 0x7f2a040b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42370/0 (socket says 172.21.15.19:42370) 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a08f1c640 1 -- 172.21.15.19:0/3470629422 learned_addr learned my addr 172.21.15.19:0/3470629422 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.911+0000 7f2a09f1e640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04161cf0 0x7f2a04162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a0971d640 1 -- 172.21.15.19:0/3470629422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04161cf0 msgr2=0x7f2a04162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a0971d640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04161cf0 0x7f2a04162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a0971d640 1 -- 172.21.15.19:0/3470629422 >> v1:172.21.15.19:6789/0 conn(0x7f2a04162970 legacy=0x7f2a040b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a0971d640 1 -- 172.21.15.19:0/3470629422 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040d25a0 con 0x7f2a040b4460 2024-03-04T08:51:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a03fff640 1 -- 172.21.15.19:0/3470629422 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033429596 0 0) 0x7f2a040d22c0 con 0x7f2a04162970 2024-03-04T08:51:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a0971d640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a040b4460 0x7f2a040d4800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097a0 tx=0x7f29fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538ef089cc698233 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a03fff640 1 -- 172.21.15.19:0/3470629422 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc035020 con 0x7f2a040b4460 2024-03-04T08:51:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a03fff640 1 -- 172.21.15.19:0/3470629422 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc031830 con 0x7f2a040b4460 2024-03-04T08:51:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.912+0000 7f2a03fff640 1 -- 172.21.15.19:0/3470629422 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc031c00 con 0x7f2a040b4460 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 -- 172.21.15.19:0/3470629422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a040b4460 msgr2=0x7f2a040d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a040b4460 0x7f2a040d4800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097a0 tx=0x7f29fc02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 -- 172.21.15.19:0/3470629422 shutdown_connections 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04161cf0 0x7f2a04162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 --2- 172.21.15.19:0/3470629422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a040b4460 0x7f2a040d4800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 -- 172.21.15.19:0/3470629422 >> 172.21.15.19:0/3470629422 conn(0x7f2a040d3ce0 msgr2=0x7f2a040d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 -- 172.21.15.19:0/3470629422 shutdown_connections 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.913+0000 7f2a0b981640 1 -- 172.21.15.19:0/3470629422 wait complete. 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.914+0000 7f2a0b981640 1 Processor -- start 2024-03-04T08:51:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.914+0000 7f2a0b981640 1 -- start start 2024-03-04T08:51:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a040b4460 0x7f2a041562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04162970 0x7f2a040b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040ce950 con 0x7f2a04161cf0 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040d2b60 con 0x7f2a040b4460 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0b981640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040b4840 con 0x7f2a04162970 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36326/0 (socket says 172.21.15.19:36326) 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 -- 172.21.15.19:0/2927140429 learned_addr learned my addr 172.21.15.19:0/2927140429 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a0971d640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a040b4460 0x7f2a041562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a09f1e640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04162970 0x7f2a040b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 -- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04162970 msgr2=0x7f2a040b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04162970 0x7f2a040b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 -- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a040b4460 msgr2=0x7f2a041562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a040b4460 0x7f2a041562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 -- 172.21.15.19:0/2927140429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040c9940 con 0x7f2a04161cf0 2024-03-04T08:51:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.915+0000 7f2a08f1c640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c4b0 tx=0x7f29f800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.916+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8018070 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.916+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8007500 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.916+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8004a20 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.916+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a040c7a20 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.916+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a040c9510 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.917+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a040c7810 con 0x7f2a04161cf0 2024-03-04T08:51:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.917+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29f801b070 con 0x7f2a04161cf0 2024-03-04T08:51:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.918+0000 7f2a01ffb640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.918+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29f80894c0 con 0x7f2a04161cf0 2024-03-04T08:51:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.918+0000 7f2a0971d640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.918+0000 7f2a0971d640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 0x7f29f006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29fc036000 tx=0x7f29fc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:23.922+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f29f8057da0 con 0x7f2a04161cf0 2024-03-04T08:51:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.117+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a0404f330 con 0x7f2a04161cf0 2024-03-04T08:51:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.117+0000 7f2a01ffb640 1 -- 172.21.15.19:0/2927140429 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f29f805be40 con 0x7f2a04161cf0 2024-03-04T08:51:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 msgr2=0x7f29f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 0x7f29f006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29fc036000 tx=0x7f29fc03c040 comp rx=0 tx=0).stop 2024-03-04T08:51:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 msgr2=0x7f2a040c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c4b0 tx=0x7f29f800c970 comp rx=0 tx=0).stop 2024-03-04T08:51:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 shutdown_connections 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a04162970 0x7f2a040b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a04161cf0 0x7f2a040c8fd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 --2- 172.21.15.19:0/2927140429 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a040b4460 0x7f2a041562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 >> 172.21.15.19:0/2927140429 conn(0x7f2a040d3ce0 msgr2=0x7f2a04160140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 shutdown_connections 2024-03-04T08:51:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.119+0000 7f2a0b981640 1 -- 172.21.15.19:0/2927140429 wait complete. 2024-03-04T08:51:24.126 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi204.front.sepia.ceph.com... 2024-03-04T08:51:24.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:24.127 DEBUG:teuthology.orchestra.run.smithi204:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-03-04T08:51:24.156 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:24.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:51:24.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:24.156 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-04T08:51:24.211 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-04T08:51:24.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:24.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 Processor -- start 2024-03-04T08:51:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 -- start start 2024-03-04T08:51:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f037c0cd120 0x7f037c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0cd620 con 0x7f037c15c140 2024-03-04T08:51:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0cd900 con 0x7f037c0d0720 2024-03-04T08:51:24.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.316+0000 7f0381135640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c15c520 con 0x7f037c0cd120 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f037c15c140 0x7f037c0d0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42372/0 (socket says 172.21.15.19:42372) 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037ad9d640 1 -- 172.21.15.19:0/216761080 learned_addr learned my addr 172.21.15.19:0/216761080 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037b59e640 1 --2- 172.21.15.19:0/216761080 >> v2:172.21.15.204:3300/0 conn(0x7f037c0cd120 0x7f037c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f0379d9b640 1 -- 172.21.15.19:0/216761080 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220068782 0 0) 0x7f037c0cd620 con 0x7f037c15c140 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f0379d9b640 1 -- 172.21.15.19:0/216761080 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003520 con 0x7f037c15c140 2024-03-04T08:51:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037b59e640 1 -- 172.21.15.19:0/216761080 >> v1:172.21.15.204:6789/0 conn(0x7f037c0d0720 legacy=0x7f037c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037b59e640 1 -- 172.21.15.19:0/216761080 >> v1:172.21.15.19:6789/0 conn(0x7f037c15c140 legacy=0x7f037c0d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.317+0000 7f037b59e640 1 -- 172.21.15.19:0/216761080 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0b1410 con 0x7f037c0cd120 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f037b59e640 1 --2- 172.21.15.19:0/216761080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c0b2600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0374009d90 tx=0x7f037402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f5a2e36b5e589 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0379d9b640 1 -- 172.21.15.19:0/216761080 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374039070 con 0x7f037c0cd120 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0379d9b640 1 -- 172.21.15.19:0/216761080 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037402cd80 con 0x7f037c0cd120 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0379d9b640 1 -- 172.21.15.19:0/216761080 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374034640 con 0x7f037c0cd120 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 -- 172.21.15.19:0/216761080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 msgr2=0x7f037c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 --2- 172.21.15.19:0/216761080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c0b2600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0374009d90 tx=0x7f037402bfd0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 -- 172.21.15.19:0/216761080 shutdown_connections 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 --2- 172.21.15.19:0/216761080 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c0b2600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 -- 172.21.15.19:0/216761080 >> 172.21.15.19:0/216761080 conn(0x7f037c0b35a0 msgr2=0x7f037c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 -- 172.21.15.19:0/216761080 shutdown_connections 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.318+0000 7f0381135640 1 -- 172.21.15.19:0/216761080 wait complete. 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.320+0000 7f0381135640 1 Processor -- start 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.320+0000 7f0381135640 1 -- start start 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c15c140 0x7f037c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cf240 con 0x7f037c0d0720 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0b19d0 con 0x7f037c0cd120 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cf3c0 con 0x7f037c15c140 2024-03-04T08:51:24.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36332/0 (socket says 172.21.15.19:36332) 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 -- 172.21.15.19:0/2489172864 learned_addr learned my addr 172.21.15.19:0/2489172864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037ad9d640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037b59e640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c15c140 0x7f037c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 -- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c15c140 msgr2=0x7f037c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c15c140 0x7f037c06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 -- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 msgr2=0x7f037c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 -- 172.21.15.19:0/2489172864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0701e0 con 0x7f037c0d0720 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f037a59c640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f037000c430 tx=0x7f037000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700052d0 con 0x7f037c0d0720 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370005490 con 0x7f037c0d0720 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370007260 con 0x7f037c0d0720 2024-03-04T08:51:24.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c15cb60 con 0x7f037c0d0720 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.321+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0b4970 con 0x7f037c0d0720 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.323+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c04f330 con 0x7f037c0d0720 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.323+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0370007400 con 0x7f037c0d0720 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.323+0000 7f03637fe640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 0x7f036806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.323+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03700895b0 con 0x7f037c0d0720 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.323+0000 7f037ad9d640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 0x7f036806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.324+0000 7f037ad9d640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 0x7f036806d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f036c0011e0 tx=0x7f036c007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.327+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f037c15cb60 con 0x7f037c0d0720 2024-03-04T08:51:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.546+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037c15ada0 con 0x7f037c0d0720 2024-03-04T08:51:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.546+0000 7f03637fe640 1 -- 172.21.15.19:0/2489172864 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7f037c0701e0 con 0x7f037c0d0720 2024-03-04T08:51:24.543 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:24.544 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 msgr2=0x7f036806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 0x7f036806d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f036c0011e0 tx=0x7f036c007d30 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 msgr2=0x7f037c0c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f037000c430 tx=0x7f037000c8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 shutdown_connections 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f037c15c140 0x7f037c06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f037c0d0720 0x7f037c0c7bc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f036806b4d0 0x7f036806d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 --2- 172.21.15.19:0/2489172864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f037c0cd120 0x7f037c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 >> 172.21.15.19:0/2489172864 conn(0x7f037c0b35a0 msgr2=0x7f037c15b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 shutdown_connections 2024-03-04T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.548+0000 7f0381135640 1 -- 172.21.15.19:0/2489172864 wait complete. 2024-03-04T08:51:24.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.661+0000 7f175391e640 1 Processor -- start 2024-03-04T08:51:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.661+0000 7f175391e640 1 -- start start 2024-03-04T08:51:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f175391e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f174c0d00c0 0x7f174c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f175391e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c0d09e0 con 0x7f174c06cf20 2024-03-04T08:51:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f175391e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c15e380 con 0x7f174c0cf850 2024-03-04T08:51:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f175391e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c06ca90 con 0x7f174c0d00c0 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f17516ba640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f174c0d00c0 0x7f174c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f1751ebb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f174c06cf20 0x7f174c06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42378/0 (socket says 172.21.15.19:42378) 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f1751ebb640 1 -- 172.21.15.19:0/3013290035 learned_addr learned my addr 172.21.15.19:0/3013290035 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f17516ba640 1 -- 172.21.15.19:0/3013290035 >> v1:172.21.15.204:6789/0 conn(0x7f174c0cf850 legacy=0x7f174c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f17516ba640 1 -- 172.21.15.19:0/3013290035 >> v1:172.21.15.19:6789/0 conn(0x7f174c06cf20 legacy=0x7f174c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f17516ba640 1 -- 172.21.15.19:0/3013290035 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0cdc10 con 0x7f174c0d00c0 2024-03-04T08:51:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.662+0000 7f1743fff640 1 -- 172.21.15.19:0/3013290035 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224793604 0 0) 0x7f174c0d09e0 con 0x7f174c06cf20 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f17516ba640 1 --2- 172.21.15.19:0/3013290035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c0d00c0 0x7f174c0d04a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17480097a0 tx=0x7f174802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd37788a14dc1ed server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f1743fff640 1 -- 172.21.15.19:0/3013290035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748034070 con 0x7f174c0d00c0 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f1743fff640 1 -- 172.21.15.19:0/3013290035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748030610 con 0x7f174c0d00c0 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f1743fff640 1 -- 172.21.15.19:0/3013290035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480309e0 con 0x7f174c0d00c0 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f175391e640 1 -- 172.21.15.19:0/3013290035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c0d00c0 msgr2=0x7f174c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f175391e640 1 --2- 172.21.15.19:0/3013290035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c0d00c0 0x7f174c0d04a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f17480097a0 tx=0x7f174802b960 comp rx=0 tx=0).stop 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f175391e640 1 -- 172.21.15.19:0/3013290035 shutdown_connections 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f175391e640 1 --2- 172.21.15.19:0/3013290035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c0d00c0 0x7f174c0d04a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.663+0000 7f175391e640 1 -- 172.21.15.19:0/3013290035 >> 172.21.15.19:0/3013290035 conn(0x7f174c0b35a0 msgr2=0x7f174c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.664+0000 7f175391e640 1 -- 172.21.15.19:0/3013290035 shutdown_connections 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.664+0000 7f175391e640 1 -- 172.21.15.19:0/3013290035 wait complete. 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 Processor -- start 2024-03-04T08:51:24.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 -- start start 2024-03-04T08:51:24.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f174c0cf850 0x7f174c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f174c0d00c0 0x7f174c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c06c720 con 0x7f174c06cf20 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c06c440 con 0x7f174c0d00c0 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.665+0000 7f175391e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0b1030 con 0x7f174c0cf850 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36344/0 (socket says 172.21.15.19:36344) 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 -- 172.21.15.19:0/1017951704 learned_addr learned my addr 172.21.15.19:0/1017951704 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f1751ebb640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f174c0d00c0 0x7f174c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f1750eb9640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f174c0cf850 0x7f174c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 -- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f174c0cf850 msgr2=0x7f174c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f174c0cf850 0x7f174c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 -- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f174c0d00c0 msgr2=0x7f174c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f174c0d00c0 0x7f174c0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 -- 172.21.15.19:0/1017951704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c1585b0 con 0x7f174c06cf20 2024-03-04T08:51:24.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f17516ba640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f174802bf70 tx=0x7f17480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748034040 con 0x7f174c06cf20 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748039a10 con 0x7f174c06cf20 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0c71b0 con 0x7f174c06cf20 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748039e00 con 0x7f174c06cf20 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.666+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c0c7730 con 0x7f174c06cf20 2024-03-04T08:51:24.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.667+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c04f330 con 0x7f174c06cf20 2024-03-04T08:51:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.668+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1748037070 con 0x7f174c06cf20 2024-03-04T08:51:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.668+0000 7f1741ffb640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 0x7f173006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.668+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17480ac250 con 0x7f174c06cf20 2024-03-04T08:51:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.668+0000 7f1750eb9640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 0x7f173006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.669+0000 7f1750eb9640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 0x7f173006d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f174c0b0d00 tx=0x7f173c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.672+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f174c1585b0 con 0x7f174c06cf20 2024-03-04T08:51:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.857+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174c0747a0 con 0x7f174c06cf20 2024-03-04T08:51:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.858+0000 7f1741ffb640 1 -- 172.21.15.19:0/1017951704 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f174807b160 con 0x7f174c06cf20 2024-03-04T08:51:24.855 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:24.855 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:50:39.349901+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 msgr2=0x7f173006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 0x7f173006d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f174c0b0d00 tx=0x7f173c009040 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 msgr2=0x7f174c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f174802bf70 tx=0x7f17480046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 shutdown_connections 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f173006b4d0 0x7f173006d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f174c0d00c0 0x7f174c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f174c0cf850 0x7f174c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 --2- 172.21.15.19:0/1017951704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f174c06cf20 0x7f174c0b6e00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 >> 172.21.15.19:0/1017951704 conn(0x7f174c0b35a0 msgr2=0x7f174c06fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 shutdown_connections 2024-03-04T08:51:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.860+0000 7f175391e640 1 -- 172.21.15.19:0/1017951704 wait complete. 2024-03-04T08:51:24.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:50:35.926239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:50:36.672492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:24.868 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:24.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.976+0000 7f951ad8c640 1 Processor -- start 2024-03-04T08:51:24.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.976+0000 7f951ad8c640 1 -- start start 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f951ad8c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95141614d0 0x7f95140d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f951ad8c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95140d2480 0x7f95140b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f951ad8c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95141618b0 con 0x7f95140d1910 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f951ad8c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95140cf400 con 0x7f95140d2480 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f951ad8c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140cf6a0 con 0x7f95141614d0 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95140d2480 0x7f95140b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95140d2480 0x7f95140b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36348/0 (socket says 172.21.15.19:36348) 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9513fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95140d1910 0x7f95140d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42380/0 (socket says 172.21.15.19:42380) 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 -- 172.21.15.19:0/1621655333 learned_addr learned my addr 172.21.15.19:0/1621655333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9518b28640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95141614d0 0x7f95140d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 -- 172.21.15.19:0/1621655333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95141614d0 msgr2=0x7f95140d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:24.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95141614d0 0x7f95140d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 -- 172.21.15.19:0/1621655333 >> v1:172.21.15.19:6789/0 conn(0x7f95140d1910 legacy=0x7f95140d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.977+0000 7f9519329640 1 -- 172.21.15.19:0/1621655333 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140cf980 con 0x7f95140d2480 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f9519329640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95140b0e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f950c009e50 tx=0x7f950c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504514c68d9aedd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f95137fe640 1 -- 172.21.15.19:0/1621655333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c02cb00 con 0x7f95140d2480 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f95137fe640 1 -- 172.21.15.19:0/1621655333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c02cca0 con 0x7f95140d2480 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f95137fe640 1 -- 172.21.15.19:0/1621655333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c034610 con 0x7f95140d2480 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 -- 172.21.15.19:0/1621655333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 msgr2=0x7f95140b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95140b0e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f950c009e50 tx=0x7f950c02bf60 comp rx=0 tx=0).stop 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 -- 172.21.15.19:0/1621655333 shutdown_connections 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95140b0e30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 --2- 172.21.15.19:0/1621655333 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95141614d0 0x7f95140d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 -- 172.21.15.19:0/1621655333 >> 172.21.15.19:0/1621655333 conn(0x7f95140d3d40 msgr2=0x7f95140d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 -- 172.21.15.19:0/1621655333 shutdown_connections 2024-03-04T08:51:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.978+0000 7f951ad8c640 1 -- 172.21.15.19:0/1621655333 wait complete. 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.980+0000 7f951ad8c640 1 Processor -- start 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.980+0000 7f951ad8c640 1 -- start start 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.980+0000 7f951ad8c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95140d1910 0x7f951415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.980+0000 7f951ad8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95141614d0 0x7f95141f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140b1370 con 0x7f95140d2480 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140b0910 con 0x7f95141614d0 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140b14f0 con 0x7f95140d1910 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9518b28640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95140d1910 0x7f951415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36358/0 (socket says 172.21.15.19:36358) 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 -- 172.21.15.19:0/100242544 learned_addr learned my addr 172.21.15.19:0/100242544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9519329640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95141614d0 0x7f95141f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 -- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95140d1910 msgr2=0x7f951415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95140d1910 0x7f951415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 -- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95141614d0 msgr2=0x7f95141f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95141614d0 0x7f95141f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 -- 172.21.15.19:0/100242544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140b8220 con 0x7f95140d2480 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f9513fff640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f950000c400 tx=0x7f950000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95000074e0 con 0x7f95140d2480 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500007680 con 0x7f95140d2480 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95140b7460 con 0x7f95140d2480 2024-03-04T08:51:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500004a00 con 0x7f95140d2480 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.981+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95140b7a20 con 0x7f95140d2480 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.982+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95140b0ec0 con 0x7f95140d2480 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.983+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f950001a020 con 0x7f95140d2480 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.983+0000 7f95117fa640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 0x7f94f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.983+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95000898f0 con 0x7f95140d2480 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.983+0000 7f9518b28640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 0x7f94f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.984+0000 7f9518b28640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 0x7f94f806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95140c77e0 tx=0x7f9508009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:24.987+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9500058120 con 0x7f95140d2480 2024-03-04T08:51:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.168+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f951415f890 con 0x7f95140d2480 2024-03-04T08:51:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.169+0000 7f95117fa640 1 -- 172.21.15.19:0/100242544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f950005c1c0 con 0x7f95140d2480 2024-03-04T08:51:25.165 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.170+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 msgr2=0x7f94f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.170+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 0x7f94f806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95140c77e0 tx=0x7f9508009190 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.170+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 msgr2=0x7f95141f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.170+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f950000c400 tx=0x7f950000c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 shutdown_connections 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f94f806b4d0 0x7f94f806d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95141614d0 0x7f95141f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95140d2480 0x7f95141f7860 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 --2- 172.21.15.19:0/100242544 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95140d1910 0x7f951415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 >> 172.21.15.19:0/100242544 conn(0x7f95140d3d40 msgr2=0x7f95140cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 shutdown_connections 2024-03-04T08:51:25.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.171+0000 7f951ad8c640 1 -- 172.21.15.19:0/100242544 wait complete. 2024-03-04T08:51:25.178 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 Processor -- start 2024-03-04T08:51:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 -- start start 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d001586e0 0x7f8d000aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00158ac0 con 0x7f8d000aef80 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0015b2a0 con 0x7f8d000d01a0 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.286+0000 7f8d04aa4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0015b540 con 0x7f8d001586e0 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cfe59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d001586e0 0x7f8d000aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cf7fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8d000aef80 0x7f8d000cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42394/0 (socket says 172.21.15.19:42394) 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cfe59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d001586e0 0x7f8d000aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36368/0 (socket says 172.21.15.19:36368) 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cf7fff640 1 -- 172.21.15.19:0/1660913445 learned_addr learned my addr 172.21.15.19:0/1660913445 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cfe59c640 1 -- 172.21.15.19:0/1660913445 >> v1:172.21.15.204:6789/0 conn(0x7f8d000d01a0 legacy=0x7f8d000b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cfe59c640 1 -- 172.21.15.19:0/1660913445 >> v1:172.21.15.19:6789/0 conn(0x7f8d000aef80 legacy=0x7f8d000cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.287+0000 7f8cfe59c640 1 -- 172.21.15.19:0/1660913445 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0015b820 con 0x7f8d001586e0 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8cfe59c640 1 --2- 172.21.15.19:0/1660913445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d001586e0 0x7f8d000aea40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d96e81a2699ca6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8cfdd9b640 1 -- 172.21.15.19:0/1660913445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0035020 con 0x7f8d001586e0 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8cfdd9b640 1 -- 172.21.15.19:0/1660913445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0031830 con 0x7f8d001586e0 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8cfdd9b640 1 -- 172.21.15.19:0/1660913445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0031c00 con 0x7f8d001586e0 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 -- 172.21.15.19:0/1660913445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d001586e0 msgr2=0x7f8d000aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/1660913445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d001586e0 0x7f8d000aea40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 -- 172.21.15.19:0/1660913445 shutdown_connections 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/1660913445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d001586e0 0x7f8d000aea40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 -- 172.21.15.19:0/1660913445 >> 172.21.15.19:0/1660913445 conn(0x7f8d0006b190 msgr2=0x7f8d0006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 -- 172.21.15.19:0/1660913445 shutdown_connections 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.288+0000 7f8d04aa4640 1 -- 172.21.15.19:0/1660913445 wait complete. 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 Processor -- start 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 -- start start 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d000aef80 0x7f8d00151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d001586e0 0x7f8d00152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00071350 con 0x7f8d000d01a0 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0015bde0 con 0x7f8d001586e0 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.290+0000 7f8d04aa4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000714d0 con 0x7f8d000aef80 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36378/0 (socket says 172.21.15.19:36378) 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 -- 172.21.15.19:0/550169638 learned_addr learned my addr 172.21.15.19:0/550169638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cfed9d640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d001586e0 0x7f8d00152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cfe59c640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d000aef80 0x7f8d00151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 -- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d000aef80 msgr2=0x7f8d00151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d000aef80 0x7f8d00151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 -- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d001586e0 msgr2=0x7f8d00152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d001586e0 0x7f8d00152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 -- 172.21.15.19:0/550169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00150db0 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf7fff640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c500 tx=0x7f8ce800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8017070 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8005ce0 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0006d450 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80072f0 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.291+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0006d9d0 con 0x7f8d000d01a0 2024-03-04T08:51:25.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.292+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d000732b0 con 0x7f8d000d01a0 2024-03-04T08:51:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.293+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ce801a070 con 0x7f8d000d01a0 2024-03-04T08:51:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.293+0000 7f8cf6ffd640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 0x7f8ce006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.293+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce8089420 con 0x7f8d000d01a0 2024-03-04T08:51:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.293+0000 7f8cfe59c640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 0x7f8ce006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.294+0000 7f8cfe59c640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 0x7f8ce006d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0036000 tx=0x7f8cf003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.297+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8ce8057ce0 con 0x7f8d000d01a0 2024-03-04T08:51:25.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.479+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d00068ff0 con 0x7f8d000d01a0 2024-03-04T08:51:25.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.479+0000 7f8cf6ffd640 1 -- 172.21.15.19:0/550169638 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ce805bd80 con 0x7f8d000d01a0 2024-03-04T08:51:25.477 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 msgr2=0x7f8ce006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 0x7f8ce006d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0036000 tx=0x7f8cf003c040 comp rx=0 tx=0).stop 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 msgr2=0x7f8d0014ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c500 tx=0x7f8ce800c9c0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 shutdown_connections 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8ce006b4d0 0x7f8ce006d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8d001586e0 0x7f8d00152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d000d01a0 0x7f8d0014ca00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 --2- 172.21.15.19:0/550169638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8d000aef80 0x7f8d00151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.481+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 >> 172.21.15.19:0/550169638 conn(0x7f8d0006b190 msgr2=0x7f8d001577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.482+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 shutdown_connections 2024-03-04T08:51:25.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.482+0000 7f8d04aa4640 1 -- 172.21.15.19:0/550169638 wait complete. 2024-03-04T08:51:25.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.598+0000 7fcbd78b8640 1 Processor -- start 2024-03-04T08:51:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.598+0000 7fcbd78b8640 1 -- start start 2024-03-04T08:51:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd78b8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 0x7fcbd00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd78b8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd006d030 con 0x7fcbd006cab0 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd78b8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd006d310 con 0x7fcbd00cea50 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd78b8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00cf1c0 con 0x7fcbd015def0 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd4e53640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcbd006cab0 0x7fcbd00ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42408/0 (socket says 172.21.15.19:42408) 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd4e53640 1 -- 172.21.15.19:0/946151852 learned_addr learned my addr 172.21.15.19:0/946151852 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd5654640 1 --2- 172.21.15.19:0/946151852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 0x7fcbd00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032937062 0 0) 0x7fcbd006d030 con 0x7fcbd006cab0 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbbc003520 con 0x7fcbd006cab0 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208467762 0 0) 0x7fcbd006d310 con 0x7fcbd00cea50 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd006d030 con 0x7fcbd00cea50 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd5654640 1 -- 172.21.15.19:0/946151852 >> v1:172.21.15.204:6789/0 conn(0x7fcbd00cea50 legacy=0x7fcbd00ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd5654640 1 -- 172.21.15.19:0/946151852 >> v1:172.21.15.19:6789/0 conn(0x7fcbd006cab0 legacy=0x7fcbd00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.599+0000 7fcbd5654640 1 -- 172.21.15.19:0/946151852 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00cc110 con 0x7fcbd015def0 2024-03-04T08:51:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.600+0000 7fcbd5654640 1 --2- 172.21.15.19:0/946151852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 0x7fcbd00b41b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097d0 tx=0x7fcbcc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f70fbff5f9cc2eab server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.600+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc034070 con 0x7fcbd015def0 2024-03-04T08:51:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.600+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc030880 con 0x7fcbd015def0 2024-03-04T08:51:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.600+0000 7fcbc7fff640 1 -- 172.21.15.19:0/946151852 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc030c30 con 0x7fcbd015def0 2024-03-04T08:51:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 -- 172.21.15.19:0/946151852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 msgr2=0x7fcbd00b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/946151852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 0x7fcbd00b41b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097d0 tx=0x7fcbcc02b9c0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 -- 172.21.15.19:0/946151852 shutdown_connections 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/946151852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd015def0 0x7fcbd00b41b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 -- 172.21.15.19:0/946151852 >> 172.21.15.19:0/946151852 conn(0x7fcbd00b3690 msgr2=0x7fcbd00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 -- 172.21.15.19:0/946151852 shutdown_connections 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.601+0000 7fcbd78b8640 1 -- 172.21.15.19:0/946151852 wait complete. 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.602+0000 7fcbd78b8640 1 Processor -- start 2024-03-04T08:51:25.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.602+0000 7fcbd78b8640 1 -- start start 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd006cab0 0x7fcbd0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbd015def0 0x7fcbd00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015e2d0 con 0x7fcbd00cea50 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00cc760 con 0x7fcbd015def0 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015e450 con 0x7fcbd006cab0 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36392/0 (socket says 172.21.15.19:36392) 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 -- 172.21.15.19:0/2476087742 learned_addr learned my addr 172.21.15.19:0/2476087742 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd5654640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd006cab0 0x7fcbd0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd5e55640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbd015def0 0x7fcbd00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 -- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd006cab0 msgr2=0x7fcbd0157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd006cab0 0x7fcbd0157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 -- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbd015def0 msgr2=0x7fcbd00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbd015def0 0x7fcbd00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 -- 172.21.15.19:0/2476087742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00cba90 con 0x7fcbd00cea50 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd4e53640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c500 tx=0x7fcbc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0017070 con 0x7fcbd00cea50 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0005d00 con 0x7fcbd00cea50 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0007330 con 0x7fcbd00cea50 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.603+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd01581b0 con 0x7fcbd00cea50 2024-03-04T08:51:25.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.604+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd00b6aa0 con 0x7fcbd00cea50 2024-03-04T08:51:25.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.605+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd009fcf0 con 0x7fcbd00cea50 2024-03-04T08:51:25.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.605+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbc001a070 con 0x7fcbd00cea50 2024-03-04T08:51:25.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.606+0000 7fcbc5ffb640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 0x7fcbb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.606+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcbc00895f0 con 0x7fcbd00cea50 2024-03-04T08:51:25.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.606+0000 7fcbd5654640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 0x7fcbb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.606+0000 7fcbd5654640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 0x7fcbb406d9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc036000 tx=0x7fcbcc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.610+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcbc0057e70 con 0x7fcbd00cea50 2024-03-04T08:51:25.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.790+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbd0068ff0 con 0x7fcbd00cea50 2024-03-04T08:51:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.791+0000 7fcbc5ffb640 1 -- 172.21.15.19:0/2476087742 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbc005bf10 con 0x7fcbd00cea50 2024-03-04T08:51:25.787 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 msgr2=0x7fcbb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 0x7fcbb406d9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc036000 tx=0x7fcbcc008030 comp rx=0 tx=0).stop 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 msgr2=0x7fcbd00ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c500 tx=0x7fcbc000c9c0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 shutdown_connections 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcbb406b500 0x7fcbb406d9c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcbd015def0 0x7fcbd00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbd00cea50 0x7fcbd00ca8e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 --2- 172.21.15.19:0/2476087742 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcbd006cab0 0x7fcbd0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.792+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 >> 172.21.15.19:0/2476087742 conn(0x7fcbd00b3690 msgr2=0x7fcbd006ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.793+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 shutdown_connections 2024-03-04T08:51:25.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.793+0000 7fcbd78b8640 1 -- 172.21.15.19:0/2476087742 wait complete. 2024-03-04T08:51:25.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:25.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.906+0000 7fdf29335640 1 Processor -- start 2024-03-04T08:51:25.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.906+0000 7fdf29335640 1 -- start start 2024-03-04T08:51:25.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf29335640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdf240cfff0 0x7fdf240d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf29335640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf24161980 con 0x7fdf240cc8b0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf29335640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf24161c60 con 0x7fdf2415bb20 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf29335640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf240d2500 con 0x7fdf240cfff0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf227fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdf240cfff0 0x7fdf240d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf237fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdf240cc8b0 0x7fdf240ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42412/0 (socket says 172.21.15.19:42412) 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf237fe640 1 -- 172.21.15.19:0/2731987409 learned_addr learned my addr 172.21.15.19:0/2731987409 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf21ffb640 1 -- 172.21.15.19:0/2731987409 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180491260 0 0) 0x7fdf24161980 con 0x7fdf240cc8b0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf21ffb640 1 -- 172.21.15.19:0/2731987409 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf10003520 con 0x7fdf240cc8b0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf227fc640 1 -- 172.21.15.19:0/2731987409 >> v1:172.21.15.204:6789/0 conn(0x7fdf2415bb20 legacy=0x7fdf240d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf227fc640 1 -- 172.21.15.19:0/2731987409 >> v1:172.21.15.19:6789/0 conn(0x7fdf240cc8b0 legacy=0x7fdf240ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.907+0000 7fdf227fc640 1 -- 172.21.15.19:0/2731987409 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24161f40 con 0x7fdf240cfff0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.908+0000 7fdf227fc640 1 --2- 172.21.15.19:0/2731987409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf240d04a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0097a0 tx=0x7fdf0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85025b042743af22 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.908+0000 7fdf21ffb640 1 -- 172.21.15.19:0/2731987409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c034070 con 0x7fdf240cfff0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.908+0000 7fdf21ffb640 1 -- 172.21.15.19:0/2731987409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c030610 con 0x7fdf240cfff0 2024-03-04T08:51:25.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.908+0000 7fdf21ffb640 1 -- 172.21.15.19:0/2731987409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0309e0 con 0x7fdf240cfff0 2024-03-04T08:51:25.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 -- 172.21.15.19:0/2731987409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 msgr2=0x7fdf240d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 --2- 172.21.15.19:0/2731987409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf240d04a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0097a0 tx=0x7fdf0c02b960 comp rx=0 tx=0).stop 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 -- 172.21.15.19:0/2731987409 shutdown_connections 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 --2- 172.21.15.19:0/2731987409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf240d04a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 -- 172.21.15.19:0/2731987409 >> 172.21.15.19:0/2731987409 conn(0x7fdf2409a9f0 msgr2=0x7fdf2409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 -- 172.21.15.19:0/2731987409 shutdown_connections 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.909+0000 7fdf29335640 1 -- 172.21.15.19:0/2731987409 wait complete. 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.910+0000 7fdf29335640 1 Processor -- start 2024-03-04T08:51:25.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.910+0000 7fdf29335640 1 -- start start 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf240cc8b0 0x7fdf241546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf2415bb20 0x7fdf240c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240d1980 con 0x7fdf240cfff0 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24162500 con 0x7fdf240cc8b0 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf29335640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240d1b00 con 0x7fdf2415bb20 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36416/0 (socket says 172.21.15.19:36416) 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 -- 172.21.15.19:0/736490597 learned_addr learned my addr 172.21.15.19:0/736490597 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf22ffd640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf240cc8b0 0x7fdf241546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf237fe640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf2415bb20 0x7fdf240c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 -- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf2415bb20 msgr2=0x7fdf240c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf2415bb20 0x7fdf240c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 -- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf240cc8b0 msgr2=0x7fdf241546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf240cc8b0 0x7fdf241546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.911+0000 7fdf227fc640 1 -- 172.21.15.19:0/736490597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24155120 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf227fc640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0098c0 tx=0x7fdf0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c034040 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c03aaa0 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0443f0 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf240cb000 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.912+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf240c5690 con 0x7fdf240cfff0 2024-03-04T08:51:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.913+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2404f330 con 0x7fdf240cfff0 2024-03-04T08:51:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.913+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf0c04b060 con 0x7fdf240cfff0 2024-03-04T08:51:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.914+0000 7fdf1b7fe640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 0x7fdf0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.914+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdf0c0abe80 con 0x7fdf240cfff0 2024-03-04T08:51:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.914+0000 7fdf22ffd640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 0x7fdf0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.914+0000 7fdf22ffd640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 0x7fdf0406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b6d90 tx=0x7fdf14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:25.918+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdf0c03f070 con 0x7fdf240cfff0 2024-03-04T08:51:26.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.135+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf240b17c0 con 0x7fdf240cfff0 2024-03-04T08:51:26.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.136+0000 7fdf1b7fe640 1 -- 172.21.15.19:0/736490597 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7fdf0c07a6c0 con 0x7fdf240cfff0 2024-03-04T08:51:26.132 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:26.132 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:51:26.133 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 msgr2=0x7fdf0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 0x7fdf0406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b6d90 tx=0x7fdf14009040 comp rx=0 tx=0).stop 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 msgr2=0x7fdf24154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0098c0 tx=0x7fdf0c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 shutdown_connections 2024-03-04T08:51:26.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdf2415bb20 0x7fdf240c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf240cfff0 0x7fdf24154be0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdf0406b4d0 0x7fdf0406d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 --2- 172.21.15.19:0/736490597 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdf240cc8b0 0x7fdf241546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 >> 172.21.15.19:0/736490597 conn(0x7fdf2409a9f0 msgr2=0x7fdf240ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 shutdown_connections 2024-03-04T08:51:26.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.138+0000 7fdf29335640 1 -- 172.21.15.19:0/736490597 wait complete. 2024-03-04T08:51:26.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.250+0000 7f0ec0f81640 1 Processor -- start 2024-03-04T08:51:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.250+0000 7f0ec0f81640 1 -- start start 2024-03-04T08:51:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ec0f81640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0ebc0cf850 0x7f0ebc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ec0f81640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc15e380 con 0x7f0ebc06cf20 2024-03-04T08:51:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ec0f81640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0cdc10 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ec0f81640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc06ca90 con 0x7f0ebc0cf850 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ebad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0ebc06cf20 0x7f0ebc06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42416/0 (socket says 172.21.15.19:42416) 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0ebad9d640 1 -- 172.21.15.19:0/1355210133 learned_addr learned my addr 172.21.15.19:0/1355210133 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb3fff640 1 --2- 172.21.15.19:0/1355210133 >> v2:172.21.15.204:3300/0 conn(0x7f0ebc0cf850 0x7f0ebc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb9d9b640 1 -- 172.21.15.19:0/1355210133 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097310001 0 0) 0x7f0ebc15e380 con 0x7f0ebc06cf20 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb9d9b640 1 -- 172.21.15.19:0/1355210133 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003520 con 0x7f0ebc06cf20 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb3fff640 1 -- 172.21.15.19:0/1355210133 >> v1:172.21.15.204:6789/0 conn(0x7f0ebc0d00c0 legacy=0x7f0ebc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb3fff640 1 -- 172.21.15.19:0/1355210133 >> v1:172.21.15.19:6789/0 conn(0x7f0ebc06cf20 legacy=0x7f0ebc06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.251+0000 7f0eb3fff640 1 -- 172.21.15.19:0/1355210133 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc06c160 con 0x7f0ebc0cf850 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.252+0000 7f0eb3fff640 1 --2- 172.21.15.19:0/1355210133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc0cf850 0x7f0ebc0cd3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40097a0 tx=0x7f0ea402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f78caeb88c16bae4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.252+0000 7f0eb9d9b640 1 -- 172.21.15.19:0/1355210133 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4034070 con 0x7f0ebc0cf850 2024-03-04T08:51:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.252+0000 7f0eb9d9b640 1 -- 172.21.15.19:0/1355210133 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4030610 con 0x7f0ebc0cf850 2024-03-04T08:51:26.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.252+0000 7f0eb9d9b640 1 -- 172.21.15.19:0/1355210133 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40309c0 con 0x7f0ebc0cf850 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1355210133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc0cf850 msgr2=0x7f0ebc0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1355210133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc0cf850 0x7f0ebc0cd3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40097a0 tx=0x7f0ea402b960 comp rx=0 tx=0).stop 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1355210133 shutdown_connections 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1355210133 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc0cf850 0x7f0ebc0cd3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1355210133 >> 172.21.15.19:0/1355210133 conn(0x7f0ebc0b35a0 msgr2=0x7f0ebc0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1355210133 shutdown_connections 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.253+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1355210133 wait complete. 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.254+0000 7f0ec0f81640 1 Processor -- start 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.254+0000 7f0ec0f81640 1 -- start start 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc06cf20 0x7f0ebc14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ebc0cf850 0x7f0ebc06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0cd900 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc06c720 con 0x7f0ebc06cf20 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ec0f81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b1030 con 0x7f0ebc0cf850 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36426/0 (socket says 172.21.15.19:36426) 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 -- 172.21.15.19:0/1977022562 learned_addr learned my addr 172.21.15.19:0/1977022562 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0eb3fff640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ebc0cf850 0x7f0ebc06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0eba59c640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc06cf20 0x7f0ebc14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 -- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ebc0cf850 msgr2=0x7f0ebc06f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ebc0cf850 0x7f0ebc06f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 -- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc06cf20 msgr2=0x7f0ebc14cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc06cf20 0x7f0ebc14cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 -- 172.21.15.19:0/1977022562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0af990 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0ebad9d640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400cb40 tx=0x7f0eb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.255+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4017070 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.256+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400aca0 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.256+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc0afc70 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.256+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4012620 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.256+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc0b0230 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.256+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc04f330 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.257+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0eb401a070 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.257+0000 7f0eb2ffd640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 0x7f0e9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.257+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0eb4089fd0 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.257+0000 7f0eba59c640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 0x7f0e9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.258+0000 7f0eba59c640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 0x7f0e9c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0016e0 tx=0x7f0eac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.262+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0eb4058810 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.445+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ebc0cf030 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.446+0000 7f0eb2ffd640 1 -- 172.21.15.19:0/1977022562 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16843 (secure 0 0 0) 0x7f0eb405c8b0 con 0x7f0ebc0d00c0 2024-03-04T08:51:26.442 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:26.442 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:25.471767+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 msgr2=0x7f0e9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 0x7f0e9c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0016e0 tx=0x7f0eac009040 comp rx=0 tx=0).stop 2024-03-04T08:51:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 msgr2=0x7f0ebc06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400cb40 tx=0x7f0eb400a060 comp rx=0 tx=0).stop 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 shutdown_connections 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ebc0d00c0 0x7f0ebc06f780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ebc0cf850 0x7f0ebc06f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e9c06b4d0 0x7f0e9c06d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 --2- 172.21.15.19:0/1977022562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ebc06cf20 0x7f0ebc14cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 >> 172.21.15.19:0/1977022562 conn(0x7f0ebc0b35a0 msgr2=0x7f0ebc06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 shutdown_connections 2024-03-04T08:51:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.448+0000 7f0ec0f81640 1 -- 172.21.15.19:0/1977022562 wait complete. 2024-03-04T08:51:26.455 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T08:51:26.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:26.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.563+0000 7fe453f93640 1 Processor -- start 2024-03-04T08:51:26.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.563+0000 7fe453f93640 1 -- start start 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe453f93640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe44c1621c0 0x7fe44c0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe453f93640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe453f93640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c0ceac0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe453f93640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c0cf690 con 0x7fe44c1621c0 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe453f93640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c0ced60 con 0x7fe44c0d4920 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe45152e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe451d2f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe44c1621c0 0x7fe44c0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe45152e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:38146/0 (socket says 172.21.15.19:38146) 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe451d2f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe44c1621c0 0x7fe44c0cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:58564/0 (socket says 172.21.15.19:58564) 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe452530640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fe44c0d2bf0 0x7fe44c15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:52846/0 (socket says 172.21.15.19:52846) 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.564+0000 7fe45152e640 1 -- 172.21.15.19:0/1811567387 learned_addr learned my addr 172.21.15.19:0/1811567387 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:26.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe451d2f640 1 -- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 msgr2=0x7fe44c0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:26.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe451d2f640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe451d2f640 1 -- 172.21.15.19:0/1811567387 >> v1:172.21.15.204:6789/0 conn(0x7fe44c0d2bf0 legacy=0x7fe44c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe451d2f640 1 -- 172.21.15.19:0/1811567387 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0cf040 con 0x7fe44c1621c0 2024-03-04T08:51:26.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe45152e640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:26.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.565+0000 7fe451d2f640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cfb20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d20589598afd3e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe450d2d640 1 -- 172.21.15.19:0/1811567387 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c039070 con 0x7fe44c1621c0 2024-03-04T08:51:26.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe450d2d640 1 -- 172.21.15.19:0/1811567387 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c02cc50 con 0x7fe44c1621c0 2024-03-04T08:51:26.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe450d2d640 1 -- 172.21.15.19:0/1811567387 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c034440 con 0x7fe44c1621c0 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 -- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c1621c0 msgr2=0x7fe44c0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cfb20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c02bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 -- 172.21.15.19:0/1811567387 shutdown_connections 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 --2- 172.21.15.19:0/1811567387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cfb20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 -- 172.21.15.19:0/1811567387 >> 172.21.15.19:0/1811567387 conn(0x7fe44c0d3d10 msgr2=0x7fe44c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 -- 172.21.15.19:0/1811567387 shutdown_connections 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.566+0000 7fe453f93640 1 -- 172.21.15.19:0/1811567387 wait complete. 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.567+0000 7fe453f93640 1 Processor -- start 2024-03-04T08:51:26.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.567+0000 7fe453f93640 1 -- start start 2024-03-04T08:51:26.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 0x7fe44c0a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c162720 con 0x7fe44c1621c0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1625a0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe453f93640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1628a0 con 0x7fe44c0d4920 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe452530640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe452530640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36442/0 (socket says 172.21.15.19:36442) 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe452530640 1 -- 172.21.15.19:0/4005773151 learned_addr learned my addr 172.21.15.19:0/4005773151 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe451d2f640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 0x7fe44c0a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.568+0000 7fe45152e640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 -- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 msgr2=0x7fe44c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 -- 172.21.15.19:0/4005773151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 msgr2=0x7fe44c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 -- 172.21.15.19:0/4005773151 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0caff0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe451d2f640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 0x7fe44c0a1100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe43c033000 tx=0x7fe43c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c039050 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c045070 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c0cb2d0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c03e610 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.569+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c0cb890 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.570+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c04f330 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.570+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe43c03e7b0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.571+0000 7fe44a7fc640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 0x7fe43806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.571+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe43c0acc00 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.571+0000 7fe45152e640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 0x7fe43806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.571+0000 7fe45152e640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 0x7fe43806d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe44c09e930 tx=0x7fe440009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.575+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe43c07b320 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.795+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe44c0d2740 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.795+0000 7fe44a7fc640 1 -- 172.21.15.19:0/4005773151 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7fe43c07f3c0 con 0x7fe44c0d2bf0 2024-03-04T08:51:26.792 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:26.792 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:51:26.792 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 msgr2=0x7fe43806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 0x7fe43806d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe44c09e930 tx=0x7fe440009240 comp rx=0 tx=0).stop 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 msgr2=0x7fe44c0a1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 0x7fe44c0a1100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe43c033000 tx=0x7fe43c004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 shutdown_connections 2024-03-04T08:51:26.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe44c1621c0 0x7fe44c0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe44c0d4920 0x7fe44c0cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe43806b4d0 0x7fe43806d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 --2- 172.21.15.19:0/4005773151 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe44c0d2bf0 0x7fe44c0a1100 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 >> 172.21.15.19:0/4005773151 conn(0x7fe44c0d3d10 msgr2=0x7fe44c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 shutdown_connections 2024-03-04T08:51:26.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.798+0000 7fe453f93640 1 -- 172.21.15.19:0/4005773151 wait complete. 2024-03-04T08:51:26.805 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.910+0000 7f0c86cc9640 1 Processor -- start 2024-03-04T08:51:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.910+0000 7f0c86cc9640 1 -- start start 2024-03-04T08:51:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c86cc9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c800b6550 0x7f0c800cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c86cc9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0c800d06a0 0x7f0c800cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c86cc9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8015c620 con 0x7f0c800d02c0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c86cc9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800b50b0 con 0x7f0c800b6550 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c86cc9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800cd800 con 0x7f0c800d06a0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c7ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c800b6550 0x7f0c800cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c84a65640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c800d02c0 0x7f0c800ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42418/0 (socket says 172.21.15.19:42418) 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c84a65640 1 -- 172.21.15.19:0/4221510793 learned_addr learned my addr 172.21.15.19:0/4221510793 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c85266640 1 --2- 172.21.15.19:0/4221510793 >> v2:172.21.15.204:3300/0 conn(0x7f0c800d06a0 0x7f0c800cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c7ffff640 1 -- 172.21.15.19:0/4221510793 >> v2:172.21.15.204:3300/0 conn(0x7f0c800d06a0 msgr2=0x7f0c800cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c7ffff640 1 --2- 172.21.15.19:0/4221510793 >> v2:172.21.15.204:3300/0 conn(0x7f0c800d06a0 0x7f0c800cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c7ffff640 1 -- 172.21.15.19:0/4221510793 >> v1:172.21.15.19:6789/0 conn(0x7f0c800d02c0 legacy=0x7f0c800ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.912+0000 7f0c7ffff640 1 -- 172.21.15.19:0/4221510793 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800b4a60 con 0x7f0c800b6550 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.911+0000 7f0c7f7fe640 1 -- 172.21.15.19:0/4221510793 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462925960 0 0) 0x7f0c8015c620 con 0x7f0c800d02c0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.912+0000 7f0c7ffff640 1 --2- 172.21.15.19:0/4221510793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800b6550 0x7f0c800cf850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006e480 tx=0x7f0c7002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d729cb80153ac031 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.912+0000 7f0c7f7fe640 1 -- 172.21.15.19:0/4221510793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70039070 con 0x7f0c800b6550 2024-03-04T08:51:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.912+0000 7f0c7f7fe640 1 -- 172.21.15.19:0/4221510793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7002cc80 con 0x7f0c800b6550 2024-03-04T08:51:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.912+0000 7f0c7f7fe640 1 -- 172.21.15.19:0/4221510793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70034660 con 0x7f0c800b6550 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 -- 172.21.15.19:0/4221510793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800b6550 msgr2=0x7f0c800cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/4221510793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800b6550 0x7f0c800cf850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006e480 tx=0x7f0c7002bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 -- 172.21.15.19:0/4221510793 shutdown_connections 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/4221510793 >> v2:172.21.15.204:3300/0 conn(0x7f0c800d06a0 0x7f0c800cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/4221510793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800b6550 0x7f0c800cf850 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 -- 172.21.15.19:0/4221510793 >> 172.21.15.19:0/4221510793 conn(0x7f0c800b35a0 msgr2=0x7f0c800b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 -- 172.21.15.19:0/4221510793 shutdown_connections 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.913+0000 7f0c86cc9640 1 -- 172.21.15.19:0/4221510793 wait complete. 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.914+0000 7f0c86cc9640 1 Processor -- start 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.914+0000 7f0c86cc9640 1 -- start start 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c800b6550 0x7f0c800c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c800d06a0 0x7f0c800ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800ce9c0 con 0x7f0c800d02c0 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800ce840 con 0x7f0c800d06a0 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c86cc9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800ceb40 con 0x7f0c800b6550 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36464/0 (socket says 172.21.15.19:36464) 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 -- 172.21.15.19:0/3351138332 learned_addr learned my addr 172.21.15.19:0/3351138332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c84a65640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c800b6550 0x7f0c800c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c85266640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c800d06a0 0x7f0c800ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 -- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c800b6550 msgr2=0x7f0c800c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c800b6550 0x7f0c800c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 -- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c800d06a0 msgr2=0x7f0c800ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c800d06a0 0x7f0c800ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.915+0000 7f0c7ffff640 1 -- 172.21.15.19:0/3351138332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80145790 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c7ffff640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c70037040 tx=0x7f0c70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70039050 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c70045070 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c80145a70 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7003e850 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.916+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c80146030 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.917+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8004f330 con 0x7f0c800d02c0 2024-03-04T08:51:26.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.917+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0c7003e9f0 con 0x7f0c800d02c0 2024-03-04T08:51:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.918+0000 7f0c7d7fa640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 0x7f0c6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.918+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0c700ad020 con 0x7f0c800d02c0 2024-03-04T08:51:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.918+0000 7f0c84a65640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 0x7f0c6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.918+0000 7f0c84a65640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 0x7f0c6006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000f60 tx=0x7f0c78007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:26.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:26.922+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0c7007b980 con 0x7f0c800d02c0 2024-03-04T08:51:27.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.139+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c80146200 con 0x7f0c800d02c0 2024-03-04T08:51:27.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.140+0000 7f0c7d7fa640 1 -- 172.21.15.19:0/3351138332 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4977 (secure 0 0 0) 0x7f0c7007fa20 con 0x7f0c800d02c0 2024-03-04T08:51:27.136 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:27.136 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1669630992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1669630992},{"type":"v1","addr":"172.21.15.204:6836","nonce":1669630992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/1982332713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":1982332713},{"type":"v1","addr":"172.21.15.19:6834","nonce":1982332713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/2664951545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":2664951545},{"type":"v1","addr":"172.21.15.19:6835","nonce":2664951545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:50:37.708863+0000","modified":"2024-03-04T08:50:39.707881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.204:6837/1359328576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":1359328576},{"type":"v1","addr":"172.21.15.204:6837","nonce":1359328576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-03-04T08:51:27.137 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-03-04T08:51:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 msgr2=0x7f0c6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 0x7f0c6006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000f60 tx=0x7f0c78007d50 comp rx=0 tx=0).stop 2024-03-04T08:51:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 msgr2=0x7f0c800cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c70037040 tx=0x7f0c70004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 shutdown_connections 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0c6006b4d0 0x7f0c6006d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c800d06a0 0x7f0c800ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c800d02c0 0x7f0c800cc8b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 --2- 172.21.15.19:0/3351138332 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c800b6550 0x7f0c800c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 >> 172.21.15.19:0/3351138332 conn(0x7f0c800b35a0 msgr2=0x7f0c800d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 shutdown_connections 2024-03-04T08:51:27.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.142+0000 7f0c86cc9640 1 -- 172.21.15.19:0/3351138332 wait complete. 2024-03-04T08:51:27.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.254+0000 7f54ffdf7640 1 Processor -- start 2024-03-04T08:51:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.254+0000 7f54ffdf7640 1 -- start start 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54ffdf7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f80cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54ffdf7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54f80b6550 0x7f54f80cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54ffdf7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f815c620 con 0x7f54f80d06a0 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54ffdf7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f80b50b0 con 0x7f54f80b6550 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54ffdf7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80cd800 con 0x7f54f80d02c0 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54f80b6550 0x7f54f80cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54f80b6550 0x7f54f80cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36466/0 (socket says 172.21.15.19:36466) 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 -- 172.21.15.19:0/3891385618 learned_addr learned my addr 172.21.15.19:0/3891385618 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fdb93640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f80cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 -- 172.21.15.19:0/3891385618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 msgr2=0x7f54f80cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f80cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 -- 172.21.15.19:0/3891385618 >> v1:172.21.15.204:6789/0 conn(0x7f54f80d06a0 legacy=0x7f54f80ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.255+0000 7f54fe394640 1 -- 172.21.15.19:0/3891385618 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80b4a60 con 0x7f54f80b6550 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.256+0000 7f54fe394640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80cd0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009e50 tx=0x7f54f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319a2b573abf03f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.256+0000 7f54fcb91640 1 -- 172.21.15.19:0/3891385618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f002ca70 con 0x7f54f80b6550 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.256+0000 7f54fcb91640 1 -- 172.21.15.19:0/3891385618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f002cc10 con 0x7f54f80b6550 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.256+0000 7f54fcb91640 1 -- 172.21.15.19:0/3891385618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f00343f0 con 0x7f54f80b6550 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 -- 172.21.15.19:0/3891385618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 msgr2=0x7f54f80cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80cd0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009e50 tx=0x7f54f002bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 -- 172.21.15.19:0/3891385618 shutdown_connections 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80cd0d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/3891385618 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f80cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 -- 172.21.15.19:0/3891385618 >> 172.21.15.19:0/3891385618 conn(0x7f54f80b35a0 msgr2=0x7f54f80b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 -- 172.21.15.19:0/3891385618 shutdown_connections 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.257+0000 7f54ffdf7640 1 -- 172.21.15.19:0/3891385618 wait complete. 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.258+0000 7f54ffdf7640 1 Processor -- start 2024-03-04T08:51:27.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.258+0000 7f54ffdf7640 1 -- start start 2024-03-04T08:51:27.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f81478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 0x7f54f80d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80ce9c0 con 0x7f54f80b6550 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80ce840 con 0x7f54f80d06a0 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54ffdf7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80ceb40 con 0x7f54f80d02c0 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36472/0 (socket says 172.21.15.19:36472) 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 -- 172.21.15.19:0/826289938 learned_addr learned my addr 172.21.15.19:0/826289938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fd392640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f81478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fe394640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 0x7f54f80d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 -- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 msgr2=0x7f54f81478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f81478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 -- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 msgr2=0x7f54f80d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 0x7f54f80d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 -- 172.21.15.19:0/826289938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f81f1870 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fe394640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 0x7f54f80d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.259+0000 7f54fdb93640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9b0 tx=0x7f54f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.260+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4017070 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.260+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f400c9a0 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.260+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f8147e00 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.260+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400cd90 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.260+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f80cac90 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.261+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f804f330 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.261+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54f401a070 con 0x7f54f80b6550 2024-03-04T08:51:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.261+0000 7f54ee7fc640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 0x7f54dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.262+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f54f408a170 con 0x7f54f80b6550 2024-03-04T08:51:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.262+0000 7f54fd392640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 0x7f54dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.262+0000 7f54fd392640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 0x7f54dc06d9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54f8071250 tx=0x7f54e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.266+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f54f4058910 con 0x7f54f80b6550 2024-03-04T08:51:27.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.448+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54f80cf3d0 con 0x7f54f80b6550 2024-03-04T08:51:27.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.449+0000 7f54ee7fc640 1 -- 172.21.15.19:0/826289938 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16843 (secure 0 0 0) 0x7f54f405c9b0 con 0x7f54f80b6550 2024-03-04T08:51:27.445 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:27.445 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:26.475972+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:50:35.926239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T08:50:36.672492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:27.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 msgr2=0x7f54dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 0x7f54dc06d9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54f8071250 tx=0x7f54e8009040 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 msgr2=0x7f54f80c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9b0 tx=0x7f54f400ee70 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 shutdown_connections 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f54dc06b500 0x7f54dc06d9c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f54f80d06a0 0x7f54f80d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f54f80d02c0 0x7f54f81478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 --2- 172.21.15.19:0/826289938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54f80b6550 0x7f54f80c7fb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 >> 172.21.15.19:0/826289938 conn(0x7f54f80b35a0 msgr2=0x7f54f80d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 shutdown_connections 2024-03-04T08:51:27.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.451+0000 7f54ffdf7640 1 -- 172.21.15.19:0/826289938 wait complete. 2024-03-04T08:51:27.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T08:51:27.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.568+0000 7f860631e640 1 Processor -- start 2024-03-04T08:51:27.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.568+0000 7f860631e640 1 -- start start 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f860631e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86000d04e0 0x7f86000d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f860631e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f86000d1fe0 0x7f86000af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f860631e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000d2430 con 0x7f860015bed0 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f860631e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000b2d80 con 0x7f86000d04e0 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f860631e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000ae9c0 con 0x7f86000d1fe0 2024-03-04T08:51:27.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86000d04e0 0x7f86000d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86000d04e0 0x7f86000d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45774/0 (socket says 172.21.15.19:45774) 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 -- 172.21.15.19:0/2602038046 learned_addr learned my addr 172.21.15.19:0/2602038046 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f86048bb640 1 --2- 172.21.15.19:0/2602038046 >> v2:172.21.15.204:3300/0 conn(0x7f86000d1fe0 0x7f86000af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 -- 172.21.15.19:0/2602038046 >> v2:172.21.15.204:3300/0 conn(0x7f86000d1fe0 msgr2=0x7f86000af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 --2- 172.21.15.19:0/2602038046 >> v2:172.21.15.204:3300/0 conn(0x7f86000d1fe0 0x7f86000af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 -- 172.21.15.19:0/2602038046 >> v1:172.21.15.204:6789/0 conn(0x7f860015bed0 legacy=0x7f86000b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.569+0000 7f85ff7fe640 1 -- 172.21.15.19:0/2602038046 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000aeca0 con 0x7f86000d04e0 2024-03-04T08:51:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f85ff7fe640 1 --2- 172.21.15.19:0/2602038046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d04e0 0x7f86000d1aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86000715a0 tx=0x7f85f002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea6c8e155053c9e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f85feffd640 1 -- 172.21.15.19:0/2602038046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f002e070 con 0x7f86000d04e0 2024-03-04T08:51:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f85feffd640 1 -- 172.21.15.19:0/2602038046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0037070 con 0x7f86000d04e0 2024-03-04T08:51:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f85feffd640 1 -- 172.21.15.19:0/2602038046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0031a00 con 0x7f86000d04e0 2024-03-04T08:51:27.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f860631e640 1 -- 172.21.15.19:0/2602038046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d04e0 msgr2=0x7f86000d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f860631e640 1 --2- 172.21.15.19:0/2602038046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d04e0 0x7f86000d1aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86000715a0 tx=0x7f85f002b880 comp rx=0 tx=0).stop 2024-03-04T08:51:27.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f860631e640 1 -- 172.21.15.19:0/2602038046 shutdown_connections 2024-03-04T08:51:27.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.570+0000 7f860631e640 1 --2- 172.21.15.19:0/2602038046 >> v2:172.21.15.204:3300/0 conn(0x7f86000d1fe0 0x7f86000af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.571+0000 7f860631e640 1 --2- 172.21.15.19:0/2602038046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d04e0 0x7f86000d1aa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.571+0000 7f860631e640 1 -- 172.21.15.19:0/2602038046 >> 172.21.15.19:0/2602038046 conn(0x7f860009a9f0 msgr2=0x7f860009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.571+0000 7f860631e640 1 -- 172.21.15.19:0/2602038046 shutdown_connections 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.571+0000 7f860631e640 1 -- 172.21.15.19:0/2602038046 wait complete. 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.572+0000 7f860631e640 1 Processor -- start 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.572+0000 7f860631e640 1 -- start start 2024-03-04T08:51:27.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86000d04e0 0x7f86000cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f860015bed0 0x7f860006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860015c2b0 con 0x7f86000d1fe0 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000af260 con 0x7f86000d04e0 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c9bf0 con 0x7f860015bed0 2024-03-04T08:51:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45784/0 (socket says 172.21.15.19:45784) 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 -- 172.21.15.19:0/3961567727 learned_addr learned my addr 172.21.15.19:0/3961567727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85fffff640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86000d04e0 0x7f86000cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f86048bb640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f860015bed0 0x7f860006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 -- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f860015bed0 msgr2=0x7f860006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f860015bed0 0x7f860006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 -- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86000d04e0 msgr2=0x7f86000cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86000d04e0 0x7f86000cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 -- 172.21.15.19:0/3961567727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000c92c0 con 0x7f86000d1fe0 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85ff7fe640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85f002b8c0 tx=0x7f85f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0032670 con 0x7f86000d1fe0 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0032850 con 0x7f86000d1fe0 2024-03-04T08:51:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000c95a0 con 0x7f86000d1fe0 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0032c40 con 0x7f86000d1fe0 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.573+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860006d310 con 0x7f86000d1fe0 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.574+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860004f330 con 0x7f86000d1fe0 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.575+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85f00453f0 con 0x7f86000d1fe0 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.575+0000 7f85fcff9640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 0x7f85ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.575+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f85f00ac340 con 0x7f86000d1fe0 2024-03-04T08:51:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.575+0000 7f85fffff640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 0x7f85ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.576+0000 7f85fffff640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 0x7f85ec06d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001780 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.580+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f85f0040070 con 0x7f86000d1fe0 2024-03-04T08:51:27.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.799+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f86000d28b0 con 0x7f86000d1fe0 2024-03-04T08:51:27.795 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-03-04T08:51:27.799+0000 7f9856575640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T08:51:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.800+0000 7f85fcff9640 1 -- 172.21.15.19:0/3961567727 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f85f007ab80 con 0x7f86000d1fe0 2024-03-04T08:51:27.797 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.803+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 msgr2=0x7f85ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.803+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 0x7f85ec06d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001780 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 msgr2=0x7f86000cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85f002b8c0 tx=0x7f85f00046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 shutdown_connections 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f860015bed0 0x7f860006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86000d1fe0 0x7f86000cc870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85ec06b4d0 0x7f85ec06d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 --2- 172.21.15.19:0/3961567727 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f86000d04e0 0x7f86000cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 >> 172.21.15.19:0/3961567727 conn(0x7f860009a9f0 msgr2=0x7f86000af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 shutdown_connections 2024-03-04T08:51:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.804+0000 7f860631e640 1 -- 172.21.15.19:0/3961567727 wait complete. 2024-03-04T08:51:27.801 INFO:tasks.ceph.mds.b.smithi204.stderr: -3033> 2024-03-04T08:50:42.447+0000 7fdd9d682640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:51:27.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T08:51:27.829 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-04T08:51:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.918+0000 7f4faa9d7640 1 Processor -- start 2024-03-04T08:51:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.918+0000 7f4faa9d7640 1 -- start start 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.919+0000 7f4faa9d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 0x7f4fa40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.919+0000 7f4faa9d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4fa40d0af0 0x7f4fa40ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.919+0000 7f4faa9d7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa40cd1e0 con 0x7f4fa415c050 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.919+0000 7f4faa9d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40cd4b0 con 0x7f4fa40d0af0 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.919+0000 7f4faa9d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40cd790 con 0x7f4fa406fd10 2024-03-04T08:51:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa8f74640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4fa40d0af0 0x7f4fa40ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa37fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 0x7f4fa40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa3fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f4fa415c050 0x7f4fa406f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51476/0 (socket says 172.21.15.19:51476) 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa3fff640 1 -- 172.21.15.19:0/1354641378 learned_addr learned my addr 172.21.15.19:0/1354641378 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa2ffd640 1 -- 172.21.15.19:0/1354641378 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220674016 0 0) 0x7f4fa40cd1e0 con 0x7f4fa415c050 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa2ffd640 1 -- 172.21.15.19:0/1354641378 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f90003520 con 0x7f4fa415c050 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa8f74640 1 -- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 msgr2=0x7f4fa40cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa8f74640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 0x7f4fa40cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa8f74640 1 -- 172.21.15.19:0/1354641378 >> v1:172.21.15.204:6789/0 conn(0x7f4fa415c050 legacy=0x7f4fa406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa8f74640 1 -- 172.21.15.19:0/1354641378 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40cda70 con 0x7f4fa40d0af0 2024-03-04T08:51:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.920+0000 7f4fa37fe640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 0x7f4fa40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4fa8f74640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa40d0af0 0x7f4fa40ccca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009d90 tx=0x7f4f9c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c214556001942551 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4fa2ffd640 1 -- 172.21.15.19:0/1354641378 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c039070 con 0x7f4fa40d0af0 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4fa2ffd640 1 -- 172.21.15.19:0/1354641378 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c02cbc0 con 0x7f4fa40d0af0 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4fa2ffd640 1 -- 172.21.15.19:0/1354641378 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034440 con 0x7f4fa40d0af0 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa40d0af0 msgr2=0x7f4fa40ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa40d0af0 0x7f4fa40ccca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009d90 tx=0x7f4f9c02be10 comp rx=0 tx=0).stop 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1354641378 shutdown_connections 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa40d0af0 0x7f4fa40ccca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1354641378 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa406fd10 0x7f4fa40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.921+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1354641378 >> 172.21.15.19:0/1354641378 conn(0x7f4fa40b3800 msgr2=0x7f4fa40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.922+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1354641378 shutdown_connections 2024-03-04T08:51:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.922+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1354641378 wait complete. 2024-03-04T08:51:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.923+0000 7f4faa9d7640 1 Processor -- start 2024-03-04T08:51:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.923+0000 7f4faa9d7640 1 -- start start 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.923+0000 7f4faa9d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.923+0000 7f4faa9d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa40d0af0 0x7f4fa414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.923+0000 7f4faa9d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 0x7f4fa414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4faa9d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4165c30 con 0x7f4fa406fd10 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4faa9d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4165ab0 con 0x7f4fa415c050 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4faa9d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4165db0 con 0x7f4fa40d0af0 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45792/0 (socket says 172.21.15.19:45792) 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 -- 172.21.15.19:0/1395360807 learned_addr learned my addr 172.21.15.19:0/1395360807 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa8f74640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 0x7f4fa414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa37fe640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa40d0af0 0x7f4fa414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 -- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa40d0af0 msgr2=0x7f4fa414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa40d0af0 0x7f4fa414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 -- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 msgr2=0x7f4fa414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 0x7f4fa414ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 -- 172.21.15.19:0/1395360807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40b0270 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa8f74640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 0x7f4fa414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa3fff640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c3c0 tx=0x7f4f9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94017070 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94005ce0 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa40b0550 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940072f0 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.924+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa40b0b10 con 0x7f4fa406fd10 2024-03-04T08:51:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.926+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa409fe60 con 0x7f4fa406fd10 2024-03-04T08:51:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.926+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f9401a070 con 0x7f4fa406fd10 2024-03-04T08:51:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.926+0000 7f4fa0ff9640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 0x7f4f8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.926+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f4f94089670 con 0x7f4fa406fd10 2024-03-04T08:51:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.927+0000 7f4fa37fe640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 0x7f4f8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.927+0000 7f4fa37fe640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 0x7f4f8406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4159410 tx=0x7f4f8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:27.931+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f94058420 con 0x7f4fa406fd10 2024-03-04T08:51:28.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.151+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4fa4068ff0 con 0x7f4fa406fd10 2024-03-04T08:51:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.802+0000 7f4fa0ff9640 1 -- 172.21.15.19:0/1395360807 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f94057d20 con 0x7f4fa406fd10 2024-03-04T08:51:28.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 msgr2=0x7f4f8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 0x7f4f8406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4159410 tx=0x7f4f8c008040 comp rx=0 tx=0).stop 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 msgr2=0x7f4fa4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c3c0 tx=0x7f4f9400c880 comp rx=0 tx=0).stop 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 shutdown_connections 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4f8406b4d0 0x7f4f8406d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4fa415c050 0x7f4fa414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4fa40d0af0 0x7f4fa414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 --2- 172.21.15.19:0/1395360807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fa406fd10 0x7f4fa4152970 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 >> 172.21.15.19:0/1395360807 conn(0x7f4fa40b3800 msgr2=0x7f4fa415b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:28.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 shutdown_connections 2024-03-04T08:51:28.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.805+0000 7f4faa9d7640 1 -- 172.21.15.19:0/1395360807 wait complete. 2024-03-04T08:51:28.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T08:51:28.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.930+0000 7fbb13066640 1 Processor -- start 2024-03-04T08:51:28.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.930+0000 7fbb13066640 1 -- start start 2024-03-04T08:51:28.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb13066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb13066640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c15f7c0 con 0x7fbb0c0cfc30 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb13066640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0ccc60 con 0x7fbb0c15e180 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb13066640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0ccf40 con 0x7fbb0c15f290 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45806/0 (socket says 172.21.15.19:45806) 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 -- 172.21.15.19:0/719330931 learned_addr learned my addr 172.21.15.19:0/719330931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 -- 172.21.15.19:0/719330931 >> v1:172.21.15.204:6789/0 conn(0x7fbb0c15e180 legacy=0x7fbb0c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 -- 172.21.15.19:0/719330931 >> v1:172.21.15.19:6789/0 conn(0x7fbb0c0cfc30 legacy=0x7fbb0c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.931+0000 7fbb0bfff640 1 -- 172.21.15.19:0/719330931 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0cd220 con 0x7fbb0c15f290 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.932+0000 7fbb0bfff640 1 --2- 172.21.15.19:0/719330931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009870 tx=0x7fbaf802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30cba1a24ebcdf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.932+0000 7fbb0b7fe640 1 -- 172.21.15.19:0/719330931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf802e070 con 0x7fbb0c15f290 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.932+0000 7fbb0b7fe640 1 -- 172.21.15.19:0/719330931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8037070 con 0x7fbb0c15f290 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.932+0000 7fbb0b7fe640 1 -- 172.21.15.19:0/719330931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8031a00 con 0x7fbb0c15f290 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 -- 172.21.15.19:0/719330931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 msgr2=0x7fbb0c0cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 --2- 172.21.15.19:0/719330931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009870 tx=0x7fbaf802b880 comp rx=0 tx=0).stop 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 -- 172.21.15.19:0/719330931 shutdown_connections 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 --2- 172.21.15.19:0/719330931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0cf6f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 -- 172.21.15.19:0/719330931 >> 172.21.15.19:0/719330931 conn(0x7fbb0c0d1b20 msgr2=0x7fbb0c0d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 -- 172.21.15.19:0/719330931 shutdown_connections 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.933+0000 7fbb13066640 1 -- 172.21.15.19:0/719330931 wait complete. 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.934+0000 7fbb13066640 1 Processor -- start 2024-03-04T08:51:28.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.934+0000 7fbb13066640 1 -- start start 2024-03-04T08:51:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb0c0cfc30 0x7fbb0c161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb0c15e180 0x7fbb0c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c15e560 con 0x7fbb0c15f290 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b2ee0 con 0x7fbb0c15e180 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb13066640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c15e6e0 con 0x7fbb0c0cfc30 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45812/0 (socket says 172.21.15.19:45812) 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 -- 172.21.15.19:0/798643953 learned_addr learned my addr 172.21.15.19:0/798643953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:28.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 -- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb0c0cfc30 msgr2=0x7fbb0c161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb0c0cfc30 0x7fbb0c161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 -- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb0c15e180 msgr2=0x7fbb0c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb0c15e180 0x7fbb0c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 -- 172.21.15.19:0/798643953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c160c70 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.935+0000 7fbb11603640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c6b0 tx=0x7fbb0400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.936+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04003b70 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.936+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04003d30 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.936+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c160f50 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.936+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04005310 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.936+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c161510 con 0x7fbb0c15f290 2024-03-04T08:51:28.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.937+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c04f330 con 0x7fbb0c15f290 2024-03-04T08:51:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.937+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb040054b0 con 0x7fbb0c15f290 2024-03-04T08:51:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.937+0000 7fbb097fa640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 0x7fbaf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.938+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fbb0408a170 con 0x7fbb0c15f290 2024-03-04T08:51:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.938+0000 7fbb10e02640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 0x7fbaf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:28.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.938+0000 7fbb10e02640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 0x7fbaf006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb00006fd0 tx=0x7fbb00006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:28.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:28.942+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb04058f20 con 0x7fbb0c15f290 2024-03-04T08:51:29.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.122+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb0c072d80 con 0x7fbb0c15f290 2024-03-04T08:51:29.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.809+0000 7fbb097fa640 1 -- 172.21.15.19:0/798643953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb04058820 con 0x7fbb0c15f290 2024-03-04T08:51:29.806 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-03-04T08:51:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 msgr2=0x7fbaf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 0x7fbaf006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb00006fd0 tx=0x7fbb00006bc0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 msgr2=0x7fbb0c0b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c6b0 tx=0x7fbb0400cb70 comp rx=0 tx=0).stop 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 shutdown_connections 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0c15f290 0x7fbb0c0b4c90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaf006b4d0 0x7fbaf006d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb0c15e180 0x7fbb0c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 --2- 172.21.15.19:0/798643953 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb0c0cfc30 0x7fbb0c161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.811+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 >> 172.21.15.19:0/798643953 conn(0x7fbb0c0d1b20 msgr2=0x7fbb0c0cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.812+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 shutdown_connections 2024-03-04T08:51:29.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.812+0000 7fbb13066640 1 -- 172.21.15.19:0/798643953 wait complete. 2024-03-04T08:51:29.825 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T08:51:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 Processor -- start 2024-03-04T08:51:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 -- start start 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7440b4e10 0x7fe744168c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440cfb30 con 0x7fe7440d1d90 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440b3320 con 0x7fe74415dff0 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe748be2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440b3600 con 0x7fe7440b4e10 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.939+0000 7fe742d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7440b4e10 0x7fe744168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe73bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7440d1d90 0x7fe7440d2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48360/0 (socket says 172.21.15.19:48360) 2024-03-04T08:51:29.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe73bfff640 1 -- 172.21.15.19:0/927942540 learned_addr learned my addr 172.21.15.19:0/927942540 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:29.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe742d9d640 1 -- 172.21.15.19:0/927942540 >> v1:172.21.15.204:6789/0 conn(0x7fe74415dff0 legacy=0x7fe7440cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:29.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe742d9d640 1 -- 172.21.15.19:0/927942540 >> v1:172.21.15.19:6789/0 conn(0x7fe7440d1d90 legacy=0x7fe7440d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe742d9d640 1 -- 172.21.15.19:0/927942540 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440b38e0 con 0x7fe7440b4e10 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.940+0000 7fe742d9d640 1 --2- 172.21.15.19:0/927942540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440b4e10 0x7fe744168c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60402dd8aa2e402 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe741d9b640 1 -- 172.21.15.19:0/927942540 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c039070 con 0x7fe7440b4e10 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe741d9b640 1 -- 172.21.15.19:0/927942540 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c02cd00 con 0x7fe7440b4e10 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe741d9b640 1 -- 172.21.15.19:0/927942540 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c034660 con 0x7fe7440b4e10 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 -- 172.21.15.19:0/927942540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440b4e10 msgr2=0x7fe744168c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 --2- 172.21.15.19:0/927942540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440b4e10 0x7fe744168c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c02bf50 comp rx=0 tx=0).stop 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 -- 172.21.15.19:0/927942540 shutdown_connections 2024-03-04T08:51:29.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 --2- 172.21.15.19:0/927942540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440b4e10 0x7fe744168c70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 -- 172.21.15.19:0/927942540 >> 172.21.15.19:0/927942540 conn(0x7fe7440d3d50 msgr2=0x7fe7440d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:29.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 -- 172.21.15.19:0/927942540 shutdown_connections 2024-03-04T08:51:29.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.941+0000 7fe748be2640 1 -- 172.21.15.19:0/927942540 wait complete. 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 Processor -- start 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 -- start start 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 0x7fe74415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe74415dff0 0x7fe744160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440d2ab0 con 0x7fe7440d1d90 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440d2930 con 0x7fe74415dff0 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe748be2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440d2c30 con 0x7fe7440b4e10 2024-03-04T08:51:29.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45836/0 (socket says 172.21.15.19:45836) 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.943+0000 7fe73bfff640 1 -- 172.21.15.19:0/2966846541 learned_addr learned my addr 172.21.15.19:0/2966846541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe74259c640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 0x7fe74415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe742d9d640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe74415dff0 0x7fe744160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 -- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 msgr2=0x7fe74415f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 0x7fe74415f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 -- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe74415dff0 msgr2=0x7fe744160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe74415dff0 0x7fe744160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 -- 172.21.15.19:0/2966846541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440cb070 con 0x7fe7440d1d90 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe74259c640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 0x7fe74415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73bfff640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c400 tx=0x7fe72c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c017070 con 0x7fe7440d1d90 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c005ce0 con 0x7fe7440d1d90 2024-03-04T08:51:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7440cb350 con 0x7fe7440d1d90 2024-03-04T08:51:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0072f0 con 0x7fe7440d1d90 2024-03-04T08:51:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.944+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7440cb910 con 0x7fe7440d1d90 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.945+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74404f330 con 0x7fe7440d1d90 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.946+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe72c01a070 con 0x7fe7440d1d90 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.946+0000 7fe73affd640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 0x7fe72406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.946+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fe72c0894d0 con 0x7fe7440d1d90 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.946+0000 7fe74259c640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 0x7fe72406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.947+0000 7fe74259c640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 0x7fe72406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe73400a810 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:29.950+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe72c0584c0 con 0x7fe7440d1d90 2024-03-04T08:51:30.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.134+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7440b9bb0 con 0x7fe7440d1d90 2024-03-04T08:51:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.810+0000 7fe73affd640 1 -- 172.21.15.19:0/2966846541 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe72c057dc0 con 0x7fe7440d1d90 2024-03-04T08:51:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 msgr2=0x7fe72406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 0x7fe72406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe73400a810 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 msgr2=0x7fe74415fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c400 tx=0x7fe72c00c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 shutdown_connections 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe72406b4d0 0x7fe72406d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe74415dff0 0x7fe744160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7440d1d90 0x7fe74415fd50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 --2- 172.21.15.19:0/2966846541 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe7440b4e10 0x7fe74415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 >> 172.21.15.19:0/2966846541 conn(0x7fe7440d3d50 msgr2=0x7fe7440d4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 shutdown_connections 2024-03-04T08:51:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:30.813+0000 7fe748be2640 1 -- 172.21.15.19:0/2966846541 wait complete. 2024-03-04T08:51:30.830 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-04T08:51:30.830 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-04T08:51:30.830 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-04T08:51:30.830 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:30.831 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-04T08:51:30.831 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-04T08:51:30.831 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-04T08:51:30.831 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:30.831 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-04T08:51:30.832 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-04T08:51:30.832 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-04T08:51:30.832 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:30.832 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-04T08:51:30.833 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-04T08:51:30.833 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-04T08:51:30.833 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:30.841 INFO:tasks.ceph.mds.a:Stopped 2024-03-04T08:51:30.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-04T08:51:30.843 INFO:tasks.ceph.mds.c:Stopped 2024-03-04T08:51:30.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-04T08:51:30.846 INFO:tasks.ceph.mds.b:Stopped 2024-03-04T08:51:30.846 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-04T08:51:30.848 INFO:tasks.ceph.mds.d:Stopped 2024-03-04T08:51:30.848 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-04T08:51:30.884 INFO:tasks.ceph.mds.a:Started 2024-03-04T08:51:30.884 DEBUG:teuthology.parallel:result is None 2024-03-04T08:51:30.885 INFO:tasks.ceph.mds.c:Started 2024-03-04T08:51:30.885 DEBUG:teuthology.parallel:result is None 2024-03-04T08:51:30.888 INFO:tasks.ceph.mds.b:Started 2024-03-04T08:51:30.888 DEBUG:teuthology.parallel:result is None 2024-03-04T08:51:30.889 INFO:tasks.ceph.mds.d:Started 2024-03-04T08:51:30.889 DEBUG:teuthology.parallel:result is None 2024-03-04T08:51:30.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-04T08:51:30.965 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-04T08:51:30.965 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-04T08:51:30.971 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-04T08:51:30.971 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-04T08:51:31.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.003+0000 7f9c8a97a640 1 Processor -- start 2024-03-04T08:51:31.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.003+0000 7f9c8a97a640 1 -- start start 2024-03-04T08:51:31.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c8a97a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9c840b4460 0x7f9c840d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c8a97a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c84162970 0x7f9c840b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c8a97a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c840d22c0 con 0x7f9c84161cf0 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c8a97a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c84161b00 con 0x7f9c84162970 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c8a97a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c840cecc0 con 0x7f9c840b4460 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c84162970 0x7f9c840b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c84162970 0x7f9c840b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45876/0 (socket says 172.21.15.19:45876) 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 -- 172.21.15.19:0/3556113108 learned_addr learned my addr 172.21.15.19:0/3556113108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:31.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 -- 172.21.15.19:0/3556113108 >> v2:172.21.15.204:3300/0 conn(0x7f9c840b4460 msgr2=0x7f9c840d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3556113108 >> v2:172.21.15.204:3300/0 conn(0x7f9c840b4460 0x7f9c840d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 -- 172.21.15.19:0/3556113108 >> v1:172.21.15.204:6789/0 conn(0x7f9c84161cf0 legacy=0x7f9c840cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.004+0000 7f9c837fe640 1 -- 172.21.15.19:0/3556113108 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840d25a0 con 0x7f9c84162970 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.005+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3556113108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c84162970 0x7f9c840b3580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c8408ddd0 tx=0x7f9c7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791b0573d59c790 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.005+0000 7f9c82ffd640 1 -- 172.21.15.19:0/3556113108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74035020 con 0x7f9c84162970 2024-03-04T08:51:31.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.005+0000 7f9c82ffd640 1 -- 172.21.15.19:0/3556113108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74031870 con 0x7f9c84162970 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.005+0000 7f9c82ffd640 1 -- 172.21.15.19:0/3556113108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74031c40 con 0x7f9c84162970 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3556113108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c84162970 msgr2=0x7f9c840b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3556113108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c84162970 0x7f9c840b3580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c8408ddd0 tx=0x7f9c7402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3556113108 shutdown_connections 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3556113108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c84162970 0x7f9c840b3580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3556113108 >> v2:172.21.15.204:3300/0 conn(0x7f9c840b4460 0x7f9c840d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3556113108 >> 172.21.15.19:0/3556113108 conn(0x7f9c840d3ce0 msgr2=0x7f9c840d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3556113108 shutdown_connections 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.006+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3556113108 wait complete. 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.007+0000 7f9c8a97a640 1 Processor -- start 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.007+0000 7f9c8a97a640 1 -- start start 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c84161cf0 0x7f9c840b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c84162970 0x7f9c840b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840ce950 con 0x7f9c840b4460 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840d2b60 con 0x7f9c84161cf0 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c8a97a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c840b3ac0 con 0x7f9c84162970 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45882/0 (socket says 172.21.15.19:45882) 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 -- 172.21.15.19:0/3147148079 learned_addr learned my addr 172.21.15.19:0/3147148079 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:31.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c84161cf0 0x7f9c840b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c88f17640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c84162970 0x7f9c840b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 -- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c84162970 msgr2=0x7f9c840b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c84162970 0x7f9c840b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 -- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c84161cf0 msgr2=0x7f9c840b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c84161cf0 0x7f9c840b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.008+0000 7f9c83fff640 1 -- 172.21.15.19:0/3147148079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840c8fb0 con 0x7f9c840b4460 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800b4a0 tx=0x7f9c7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78014070 con 0x7f9c840b4460 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c78010610 con 0x7f9c840b4460 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78010a00 con 0x7f9c840b4460 2024-03-04T08:51:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c840c9290 con 0x7f9c840b4460 2024-03-04T08:51:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.009+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84159830 con 0x7f9c840b4460 2024-03-04T08:51:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.010+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8404f330 con 0x7f9c840b4460 2024-03-04T08:51:31.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.010+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c78017070 con 0x7f9c840b4460 2024-03-04T08:51:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.011+0000 7f9c80ff9640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.011+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c78089890 con 0x7f9c840b4460 2024-03-04T08:51:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.011+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.011+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 0x7f9c7006d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c74036000 tx=0x7f9c7403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.015+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9c780583c0 con 0x7f9c840b4460 2024-03-04T08:51:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.214+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c8406b180 con 0x7f9c840b4460 2024-03-04T08:51:31.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.827+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3147148079 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c7805c460 con 0x7f9c840b4460 2024-03-04T08:51:31.823 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 msgr2=0x7f9c7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 0x7f9c7006d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c74036000 tx=0x7f9c7403c040 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 msgr2=0x7f9c841592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800b4a0 tx=0x7f9c7800b960 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 shutdown_connections 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9c84162970 0x7f9c840b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9c7006b4d0 0x7f9c7006d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9c84161cf0 0x7f9c840b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 --2- 172.21.15.19:0/3147148079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c840b4460 0x7f9c841592f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 >> 172.21.15.19:0/3147148079 conn(0x7f9c840d3ce0 msgr2=0x7f9c8406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 shutdown_connections 2024-03-04T08:51:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.830+0000 7f9c8a97a640 1 -- 172.21.15.19:0/3147148079 wait complete. 2024-03-04T08:51:31.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-04T08:51:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.953+0000 7f6707e47640 1 Processor -- start 2024-03-04T08:51:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.953+0000 7f6707e47640 1 -- start start 2024-03-04T08:51:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.953+0000 7f6707e47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 0x7f670015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6707e47640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67000cd450 con 0x7f6700066d90 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6707e47640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67000cd730 con 0x7f67000b4f70 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6707e47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670015e9f0 con 0x7f670006c6d0 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67063e4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6700066d90 0x7f67000ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48372/0 (socket says 172.21.15.19:48372) 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67063e4640 1 -- 172.21.15.19:0/1491212045 learned_addr learned my addr 172.21.15.19:0/1491212045 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67053e2640 1 --2- 172.21.15.19:0/1491212045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 0x7f670015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38068204 0 0) 0x7f67000cd450 con 0x7f6700066d90 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e8003520 con 0x7f6700066d90 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541743643 0 0) 0x7f67000cd730 con 0x7f67000b4f70 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67000cd450 con 0x7f67000b4f70 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67053e2640 1 -- 172.21.15.19:0/1491212045 >> v1:172.21.15.204:6789/0 conn(0x7f67000b4f70 legacy=0x7f67000b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67053e2640 1 -- 172.21.15.19:0/1491212045 >> v1:172.21.15.19:6789/0 conn(0x7f6700066d90 legacy=0x7f67000ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833417403 0 0) 0x7f66e8003520 con 0x7f6700066d90 2024-03-04T08:51:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.954+0000 7f67053e2640 1 -- 172.21.15.19:0/1491212045 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670015e680 con 0x7f670006c6d0 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.955+0000 7f67053e2640 1 --2- 172.21.15.19:0/1491212045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 0x7f670015ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f66f40097d0 tx=0x7f66f402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b03cf9de290b62 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.955+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4037070 con 0x7f670006c6d0 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.955+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4030510 con 0x7f670006c6d0 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.955+0000 7f6704be1640 1 -- 172.21.15.19:0/1491212045 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00019f0 con 0x7f670006c6d0 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 -- 172.21.15.19:0/1491212045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 msgr2=0x7f670015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 --2- 172.21.15.19:0/1491212045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 0x7f670015ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f66f40097d0 tx=0x7f66f402b800 comp rx=0 tx=0).stop 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 -- 172.21.15.19:0/1491212045 shutdown_connections 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 --2- 172.21.15.19:0/1491212045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f670006c6d0 0x7f670015ee80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 -- 172.21.15.19:0/1491212045 >> 172.21.15.19:0/1491212045 conn(0x7f67000724d0 msgr2=0x7f67000728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 -- 172.21.15.19:0/1491212045 shutdown_connections 2024-03-04T08:51:31.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.956+0000 7f6707e47640 1 -- 172.21.15.19:0/1491212045 wait complete. 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.957+0000 7f6707e47640 1 Processor -- start 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.957+0000 7f6707e47640 1 -- start start 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6700066d90 0x7f67000cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 0x7f67001f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700161ad0 con 0x7f67000b4f70 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000cda10 con 0x7f67000cf810 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f6707e47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700161c50 con 0x7f6700066d90 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45890/0 (socket says 172.21.15.19:45890) 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 -- 172.21.15.19:0/2030043736 learned_addr learned my addr 172.21.15.19:0/2030043736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 -- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6700066d90 msgr2=0x7f67000cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6700066d90 0x7f67000cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 -- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 msgr2=0x7f67001f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67063e4640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 0x7f67001f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 0x7f67001f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67053e2640 1 -- 172.21.15.19:0/2030043736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67001f4a50 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.958+0000 7f67063e4640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 0x7f67001f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f67053e2640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66f402b840 tx=0x7f66f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4040020 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4038040 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4037070 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67001f3cb0 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.959+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67001f4250 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.960+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670004f330 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.960+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66f4043020 con 0x7f67000b4f70 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.961+0000 7f66fe7fc640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 0x7f66ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.961+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66f40ab320 con 0x7f67000b4f70 2024-03-04T08:51:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.961+0000 7f6705be3640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 0x7f66ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.962+0000 7f6705be3640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 0x7f66ec06d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f66f80010e0 tx=0x7f66f8007950 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:31.965+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f66f404a030 con 0x7f67000b4f70 2024-03-04T08:51:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.216+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6700150f80 con 0x7f67000b4f70 2024-03-04T08:51:32.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.217+0000 7f66fe7fc640 1 -- 172.21.15.19:0/2030043736 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f66f407a4f0 con 0x7f67000b4f70 2024-03-04T08:51:32.213 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlEcsCNRAAUzvzvhMN8gnJosuFxLUHqw==", 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VluQXtBRAA/wYzOXPS2Bqlh3VAhyOUpg==", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-03-04T08:51:32.215 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+Vlhoe6ABAAPzUP1YdMlMQU37qwqLT+ZA==", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlBRJSDRAAiwMfg88SW040cRjdKJXhRw==", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:51:32.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAui+VlznMiORAAT96nxm14OosHC+bHoPIiZA==", 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.217 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAxi+VlbqD6NxAA4wfoo2B1x13CFMDPmsd8Ug==", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA0i+Vlter/NhAAXGwCH0THZXPTM1FEfDfeOg==", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.218 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA3i+VlOmJ/NRAANQB/YtVOIXxHaetd8eAdFA==", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-03-04T08:51:32.219 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA+i+Vl9O8cABAAFSW2Lc4RkhNVvsVjK9BwiA==", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBAi+VltIXWOhAAST+2+h/CZPskEGl4eXF7PQ==", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.220 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBDi+VlBaMsORAAhhbWAiewRqh4N8TXwIjEKw==", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBGi+VlktANNxAAtgoiE83zRaXvMj7mxC628g==", 2024-03-04T08:51:32.221 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A==", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:51:32.222 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+Vl1OrLGhAAZjajTghTwwRQZNoho6abMQ==", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-03-04T08:51:32.223 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlPhBaFxAAaXF8WPorbi12hfYUPT8lrg==", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VllNueIBAArPKtzKxHFoo5VMzuo8+H9Q==", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:51:32.224 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlSFPgFhAAqqyBWyvE91NmqyoC5qK7ng==", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mds", 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+VlwLxQMhAAk0JTFf4x0afAwz3NNP8yFQ==", 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mds" 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mgr", 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+VlgsVQMhAAS1JYEOWz3fo2I2HS4rvOpw==", 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.226 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-osd", 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+VlOMxQMhAAVuf1mmOabi3CLRHgXfC5Zw==", 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-osd" 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd", 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+VlqdJQMhAACRClgU9P2P5msagHPzkSFQ==", 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.227 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+VlNdlQMhAAfj6z7et0OBDyD9krjCtOpA==", 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rgw", 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBMi+Vl/t9QMhAAEt4NNdEY9B22KHHffBWCsA==", 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.228 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VldzSdMRAA+XTSL+TEsO9GpImB5ikozw==", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlVdUzLBAA+L2IVB+rX+am60b8e5H4cQ==", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:51:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:32.230 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-04T08:51:32.230 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:51:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 msgr2=0x7f66ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 0x7f66ec06d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f66f80010e0 tx=0x7f66f8007950 comp rx=0 tx=0).stop 2024-03-04T08:51:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 msgr2=0x7f67000cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66f402b840 tx=0x7f66f40046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 shutdown_connections 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66ec06b4d0 0x7f66ec06d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67000cf810 0x7f67001f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67000b4f70 0x7f67000cbff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 --2- 172.21.15.19:0/2030043736 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6700066d90 0x7f67000cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 >> 172.21.15.19:0/2030043736 conn(0x7f67000724d0 msgr2=0x7f670015a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 shutdown_connections 2024-03-04T08:51:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.219+0000 7f6707e47640 1 -- 172.21.15.19:0/2030043736 wait complete. 2024-03-04T08:51:32.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-04T08:51:32.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.339+0000 7fc06c437640 1 Processor -- start 2024-03-04T08:51:32.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.339+0000 7fc06c437640 1 -- start start 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc06c437640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc0640d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc06c437640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06415e3f0 con 0x7fc0640b3240 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc06c437640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b1c10 con 0x7fc06415e010 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc06c437640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b1f40 con 0x7fc0640d1ad0 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0699d2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc0640b3240 0x7fc0640b23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48388/0 (socket says 172.21.15.19:48388) 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0699d2640 1 -- 172.21.15.19:0/3455016289 learned_addr learned my addr 172.21.15.19:0/3455016289 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045219547 0 0) 0x7fc06415e3f0 con 0x7fc0640b3240 2024-03-04T08:51:32.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050003520 con 0x7fc0640b3240 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc0640d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870127123 0 0) 0x7fc0640b1c10 con 0x7fc06415e010 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc06415e3f0 con 0x7fc06415e010 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2744880868 0 0) 0x7fc050003520 con 0x7fc0640b3240 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 msgr2=0x7fc0640d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc0640d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 >> v1:172.21.15.204:6789/0 conn(0x7fc06415e010 legacy=0x7fc0640cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06406d1b0 con 0x7fc0640b3240 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fc054001670 con 0x7fc0640b3240 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 >> v1:172.21.15.19:6789/0 conn(0x7fc0640b3240 legacy=0x7fc0640b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc050003b70 0x7fc050003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc050004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b1f40 con 0x7fc050004d40 2024-03-04T08:51:32.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05000bb50 con 0x7fc050003b70 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.340+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05000bd50 con 0x7fc0640d1ad0 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a1d3640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc050003b70 0x7fc050003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc0699d2640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc050004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 -- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 msgr2=0x7fc050004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0640d1ad0 0x7fc050004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 -- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc050003b70 msgr2=0x7fc050003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc050003b70 0x7fc050003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.341+0000 7fc06a9d4640 1 -- 172.21.15.19:0/3455016289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050003520 con 0x7fc050004d40 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0500051c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fc0 tx=0x7fc050005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286561d68e5fb83d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c009c10 con 0x7fc050004d40 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c040070 con 0x7fc050004d40 2024-03-04T08:51:32.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc0691d1640 1 -- 172.21.15.19:0/3455016289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c03b890 con 0x7fc050004d40 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 -- 172.21.15.19:0/3455016289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 msgr2=0x7fc0500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 --2- 172.21.15.19:0/3455016289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0500051c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009fc0 tx=0x7fc050005830 comp rx=0 tx=0).stop 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06a9d4640 1 -- 172.21.15.19:0/3455016289 reap_dead start 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 -- 172.21.15.19:0/3455016289 shutdown_connections 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 -- 172.21.15.19:0/3455016289 >> 172.21.15.19:0/3455016289 conn(0x7fc06409a9f0 msgr2=0x7fc06409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:32.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 -- 172.21.15.19:0/3455016289 shutdown_connections 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.342+0000 7fc06c437640 1 -- 172.21.15.19:0/3455016289 wait complete. 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 Processor -- start 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 -- start start 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0641e32f0 0x7fc0641f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 0x7fc0641f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06406ced0 con 0x7fc050004d40 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06406cbf0 con 0x7fc0640b6e90 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06c437640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640d1f80 con 0x7fc0641e32f0 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06a1d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06a1d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45902/0 (socket says 172.21.15.19:45902) 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.344+0000 7fc06a1d3640 1 -- 172.21.15.19:0/416806088 learned_addr learned my addr 172.21.15.19:0/416806088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 0x7fc0641f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc0699d2640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0641e32f0 0x7fc0641f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 -- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0641e32f0 msgr2=0x7fc0641f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0641e32f0 0x7fc0641f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 -- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 msgr2=0x7fc0641f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 0x7fc0641f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 -- 172.21.15.19:0/416806088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0641f27d0 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a9d4640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 0x7fc0641f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06a1d3640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc06000f810 tx=0x7fc06000fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600052e0 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060018070 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0641e3780 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000d910 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.345+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640b6690 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.346+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640b61a0 con 0x7fc050004d40 2024-03-04T08:51:32.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.346+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc06000dab0 con 0x7fc050004d40 2024-03-04T08:51:32.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.347+0000 7fc05affd640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 0x7fc04806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.347+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc060089e70 con 0x7fc050004d40 2024-03-04T08:51:32.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.347+0000 7fc0699d2640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 0x7fc04806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.348+0000 7fc0699d2640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 0x7fc04806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b7590 tx=0x7fc054009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.351+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc0641f27d0 con 0x7fc050004d40 2024-03-04T08:51:32.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.601+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc06404f330 con 0x7fc050004d40 2024-03-04T08:51:32.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.603+0000 7fc05affd640 1 -- 172.21.15.19:0/416806088 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc0600590d0 con 0x7fc050004d40 2024-03-04T08:51:32.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 msgr2=0x7fc04806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 0x7fc04806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b7590 tx=0x7fc054009040 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 msgr2=0x7fc0641f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc06000f810 tx=0x7fc06000fcd0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 shutdown_connections 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc04806b4d0 0x7fc04806d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc0640b6e90 0x7fc0641f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc0641e32f0 0x7fc0641f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 --2- 172.21.15.19:0/416806088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc050004d40 0x7fc0641f2290 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 >> 172.21.15.19:0/416806088 conn(0x7fc06409a9f0 msgr2=0x7fc064070480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 shutdown_connections 2024-03-04T08:51:32.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.605+0000 7fc06c437640 1 -- 172.21.15.19:0/416806088 wait complete. 2024-03-04T08:51:32.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-04T08:51:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 Processor -- start 2024-03-04T08:51:32.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 -- start start 2024-03-04T08:51:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec158880 0x7f30ec06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30ec15b380 0x7f30ec0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 0x7f30ec070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec06d030 con 0x7f30ec15b380 2024-03-04T08:51:32.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec06d310 con 0x7f30ec06cb90 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.718+0000 7f30f461c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec06d5f0 con 0x7f30ec158880 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30ec15b380 0x7f30ec0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30ec15b380 0x7f30ec0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45914/0 (socket says 172.21.15.19:45914) 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3792870698 learned_addr learned my addr 172.21.15.19:0/3792870698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f2bb9640 1 --2- 172.21.15.19:0/3792870698 >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 0x7f30ec070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3792870698 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec158880 msgr2=0x7f30ec06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3792870698 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec158880 0x7f30ec06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3792870698 >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 msgr2=0x7f30ec070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3792870698 >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 0x7f30ec070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3792870698 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec06d8d0 con 0x7f30ec15b380 2024-03-04T08:51:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.719+0000 7f30f2bb9640 1 --2- 172.21.15.19:0/3792870698 >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 0x7f30ec070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3792870698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec15b380 0x7f30ec0708d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30ec071b80 tx=0x7f30dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65b29bedcba9d0c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f13b6640 1 -- 172.21.15.19:0/3792870698 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc035020 con 0x7f30ec15b380 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f13b6640 1 -- 172.21.15.19:0/3792870698 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc031870 con 0x7f30ec15b380 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f13b6640 1 -- 172.21.15.19:0/3792870698 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc031c40 con 0x7f30ec15b380 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 -- 172.21.15.19:0/3792870698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec15b380 msgr2=0x7f30ec0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 --2- 172.21.15.19:0/3792870698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec15b380 0x7f30ec0708d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30ec071b80 tx=0x7f30dc02b910 comp rx=0 tx=0).stop 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 -- 172.21.15.19:0/3792870698 shutdown_connections 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 --2- 172.21.15.19:0/3792870698 >> v2:172.21.15.204:3300/0 conn(0x7f30ec06cb90 0x7f30ec070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 --2- 172.21.15.19:0/3792870698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec15b380 0x7f30ec0708d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 --2- 172.21.15.19:0/3792870698 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec158880 0x7f30ec06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 -- 172.21.15.19:0/3792870698 >> 172.21.15.19:0/3792870698 conn(0x7f30ec0b1c80 msgr2=0x7f30ec0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.720+0000 7f30f461c640 1 -- 172.21.15.19:0/3792870698 shutdown_connections 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.721+0000 7f30f461c640 1 -- 172.21.15.19:0/3792870698 wait complete. 2024-03-04T08:51:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 Processor -- start 2024-03-04T08:51:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 -- start start 2024-03-04T08:51:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec06cb90 0x7f30ec143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30ec15b380 0x7f30ec1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15e980 con 0x7f30ec158880 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15e800 con 0x7f30ec15b380 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f461c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15eb00 con 0x7f30ec06cb90 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f1bb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f1bb7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45926/0 (socket says 172.21.15.19:45926) 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.722+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3209912581 learned_addr learned my addr 172.21.15.19:0/3209912581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f23b8640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec06cb90 0x7f30ec143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f2bb9640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30ec15b380 0x7f30ec1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec06cb90 msgr2=0x7f30ec143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec06cb90 0x7f30ec143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30ec15b380 msgr2=0x7f30ec1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30ec15b380 0x7f30ec1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 -- 172.21.15.19:0/3209912581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec14e1b0 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f1bb7640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f30dc000c00 tx=0x7f30dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc040070 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc030d00 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc035040 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec1532e0 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.723+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec0b2b50 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.724+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec06a090 con 0x7f30ec158880 2024-03-04T08:51:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.725+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30dc04b060 con 0x7f30ec158880 2024-03-04T08:51:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.725+0000 7f30e2ffd640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 0x7f30d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.725+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30dc0abc40 con 0x7f30ec158880 2024-03-04T08:51:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.725+0000 7f30f23b8640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 0x7f30d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.726+0000 7f30f23b8640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 0x7f30d006d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009990 tx=0x7f30e8009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.729+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f30ec06a090 con 0x7f30ec158880 2024-03-04T08:51:32.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.981+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f30ec0b4900 con 0x7f30ec158880 2024-03-04T08:51:32.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.985+0000 7f30e2ffd640 1 -- 172.21.15.19:0/3209912581 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f30ec0b4900 con 0x7f30ec158880 2024-03-04T08:51:32.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 msgr2=0x7f30d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 0x7f30d006d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009990 tx=0x7f30e8009110 comp rx=0 tx=0).stop 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 msgr2=0x7f30ec14dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f30dc000c00 tx=0x7f30dc0046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 shutdown_connections 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f30d006b500 0x7f30d006d9c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f30ec15b380 0x7f30ec1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30ec158880 0x7f30ec14dc70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 --2- 172.21.15.19:0/3209912581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f30ec06cb90 0x7f30ec143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:32.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 >> 172.21.15.19:0/3209912581 conn(0x7f30ec0b1c80 msgr2=0x7f30ec0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:32.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 shutdown_connections 2024-03-04T08:51:32.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:32.987+0000 7f30f461c640 1 -- 172.21.15.19:0/3209912581 wait complete. 2024-03-04T08:51:32.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-04T08:51:33.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 Processor -- start 2024-03-04T08:51:33.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 -- start start 2024-03-04T08:51:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a8015e010 0x7f1a800cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a800b3240 0x7f1a800b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015e3f0 con 0x7f1a800b2910 2024-03-04T08:51:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800b1f40 con 0x7f1a800b3240 2024-03-04T08:51:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.101+0000 7f1a87119640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800b1c10 con 0x7f1a8015e010 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a800b3240 0x7f1a800b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a800b3240 0x7f1a800b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45934/0 (socket says 172.21.15.19:45934) 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 -- 172.21.15.19:0/4240555570 learned_addr learned my addr 172.21.15.19:0/4240555570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 -- 172.21.15.19:0/4240555570 >> v2:172.21.15.204:3300/0 conn(0x7f1a8015e010 msgr2=0x7f1a800cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 --2- 172.21.15.19:0/4240555570 >> v2:172.21.15.204:3300/0 conn(0x7f1a8015e010 0x7f1a800cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 -- 172.21.15.19:0/4240555570 >> v1:172.21.15.204:6789/0 conn(0x7f1a800b2910 legacy=0x7f1a800d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.102+0000 7f1a77fff640 1 -- 172.21.15.19:0/4240555570 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8006d1b0 con 0x7f1a800b3240 2024-03-04T08:51:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a77fff640 1 --2- 172.21.15.19:0/4240555570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a800b3240 0x7f1a800b23d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a800715c0 tx=0x7f1a7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5053a348058b98 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a777fe640 1 -- 172.21.15.19:0/4240555570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70035020 con 0x7f1a800b3240 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a777fe640 1 -- 172.21.15.19:0/4240555570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70031870 con 0x7f1a800b3240 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a777fe640 1 -- 172.21.15.19:0/4240555570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031c40 con 0x7f1a800b3240 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 -- 172.21.15.19:0/4240555570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a800b3240 msgr2=0x7f1a800b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 --2- 172.21.15.19:0/4240555570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a800b3240 0x7f1a800b23d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a800715c0 tx=0x7f1a7002b910 comp rx=0 tx=0).stop 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 -- 172.21.15.19:0/4240555570 shutdown_connections 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 --2- 172.21.15.19:0/4240555570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a800b3240 0x7f1a800b23d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 --2- 172.21.15.19:0/4240555570 >> v2:172.21.15.204:3300/0 conn(0x7f1a8015e010 0x7f1a800cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 -- 172.21.15.19:0/4240555570 >> 172.21.15.19:0/4240555570 conn(0x7f1a8009a9f0 msgr2=0x7f1a8009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 -- 172.21.15.19:0/4240555570 shutdown_connections 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.103+0000 7f1a87119640 1 -- 172.21.15.19:0/4240555570 wait complete. 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.104+0000 7f1a87119640 1 Processor -- start 2024-03-04T08:51:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 -- start start 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a8015e010 0x7f1a80156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 0x7f1a801f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cf310 con 0x7f1a80152480 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8006ced0 con 0x7f1a8015e010 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a87119640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800d21e0 con 0x7f1a800b6610 2024-03-04T08:51:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.105+0000 7f1a77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45940/0 (socket says 172.21.15.19:45940) 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 -- 172.21.15.19:0/1430455229 learned_addr learned my addr 172.21.15.19:0/1430455229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a84eb5640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a8015e010 0x7f1a80156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a856b6640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 0x7f1a801f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 -- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 msgr2=0x7f1a801f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 0x7f1a801f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 -- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a8015e010 msgr2=0x7f1a80156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a8015e010 0x7f1a80156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 -- 172.21.15.19:0/1430455229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a801f8370 con 0x7f1a80152480 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a856b6640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 0x7f1a801f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a77fff640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7003ad60 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700443f0 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a800c5810 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700447e0 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.106+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800c5dd0 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.107+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8004f330 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.108+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a7004b060 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.108+0000 7f1a757fa640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 0x7f1a6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.108+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a700abfe0 con 0x7f1a80152480 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.108+0000 7f1a84eb5640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 0x7f1a6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.109+0000 7f1a84eb5640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 0x7f1a6c06d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a80070530 tx=0x7f1a7c009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.112+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1a7003f070 con 0x7f1a80152480 2024-03-04T08:51:33.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.363+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1a800b69f0 con 0x7f1a80152480 2024-03-04T08:51:33.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.367+0000 7f1a757fa640 1 -- 172.21.15.19:0/1430455229 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1a7002f320 con 0x7f1a80152480 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 msgr2=0x7f1a6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 0x7f1a6c06d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a80070530 tx=0x7f1a7c009110 comp rx=0 tx=0).stop 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 msgr2=0x7f1a800b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a700046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 shutdown_connections 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a800b6610 0x7f1a801f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a80152480 0x7f1a800b60d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a6c06b4d0 0x7f1a6c06d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 --2- 172.21.15.19:0/1430455229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a8015e010 0x7f1a80156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 >> 172.21.15.19:0/1430455229 conn(0x7f1a8009a9f0 msgr2=0x7f1a8015d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:33.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 shutdown_connections 2024-03-04T08:51:33.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.369+0000 7f1a87119640 1 -- 172.21.15.19:0/1430455229 wait complete. 2024-03-04T08:51:33.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-04T08:51:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.482+0000 7fdb6aac2640 1 Processor -- start 2024-03-04T08:51:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.482+0000 7fdb6aac2640 1 -- start start 2024-03-04T08:51:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6aac2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb6406e000 0x7fdb6415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6aac2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 0x7fdb64150b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6aac2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6406e770 con 0x7fdb640cc920 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6aac2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6415e660 con 0x7fdb6406e000 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6aac2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6406e490 con 0x7fdb640b4a50 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb63fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb6406e000 0x7fdb6415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6885e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb640cc920 0x7fdb64072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48404/0 (socket says 172.21.15.19:48404) 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6885e640 1 -- 172.21.15.19:0/1247636190 learned_addr learned my addr 172.21.15.19:0/1247636190 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6905f640 1 --2- 172.21.15.19:0/1247636190 >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 0x7fdb64150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb63fff640 1 -- 172.21.15.19:0/1247636190 >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 msgr2=0x7fdb64150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb63fff640 1 --2- 172.21.15.19:0/1247636190 >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 0x7fdb64150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb63fff640 1 -- 172.21.15.19:0/1247636190 >> v1:172.21.15.19:6789/0 conn(0x7fdb640cc920 legacy=0x7fdb64072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb63fff640 1 -- 172.21.15.19:0/1247636190 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6415e010 con 0x7fdb6406e000 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.483+0000 7fdb6905f640 1 --2- 172.21.15.19:0/1247636190 >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 0x7fdb64150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb63fff640 1 --2- 172.21.15.19:0/1247636190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb6406e000 0x7fdb6415eaf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb640cd660 tx=0x7fdb5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7828eec12e03cbef server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb637fe640 1 -- 172.21.15.19:0/1247636190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50035020 con 0x7fdb6406e000 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb637fe640 1 -- 172.21.15.19:0/1247636190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50031830 con 0x7fdb6406e000 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb637fe640 1 -- 172.21.15.19:0/1247636190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50031c00 con 0x7fdb6406e000 2024-03-04T08:51:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1247636190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb6406e000 msgr2=0x7fdb6415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.484+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1247636190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb6406e000 0x7fdb6415eaf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb640cd660 tx=0x7fdb5002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1247636190 shutdown_connections 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1247636190 >> v2:172.21.15.204:3300/0 conn(0x7fdb640b4a50 0x7fdb64150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1247636190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb6406e000 0x7fdb6415eaf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1247636190 >> 172.21.15.19:0/1247636190 conn(0x7fdb640b1c80 msgr2=0x7fdb640cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1247636190 shutdown_connections 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.485+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1247636190 wait complete. 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.486+0000 7fdb6aac2640 1 Processor -- start 2024-03-04T08:51:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.486+0000 7fdb6aac2640 1 -- start start 2024-03-04T08:51:33.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.486+0000 7fdb6aac2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb640b4a50 0x7fdb64158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.486+0000 7fdb6aac2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.486+0000 7fdb6aac2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb641420d0 0x7fdb6406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6aac2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640cce80 con 0x7fdb640cc920 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6aac2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640ccd00 con 0x7fdb640b4a50 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6aac2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64070940 con 0x7fdb641420d0 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45950/0 (socket says 172.21.15.19:45950) 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 -- 172.21.15.19:0/1607733351 learned_addr learned my addr 172.21.15.19:0/1607733351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6885e640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb640b4a50 0x7fdb64158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 -- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb641420d0 msgr2=0x7fdb6406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb641420d0 0x7fdb6406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 -- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb640b4a50 msgr2=0x7fdb64158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb640b4a50 0x7fdb64158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 -- 172.21.15.19:0/1607733351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64159590 con 0x7fdb640cc920 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb63fff640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdb5002bee0 tx=0x7fdb500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50041070 con 0x7fdb640cc920 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5003aa30 con 0x7fdb640cc920 2024-03-04T08:51:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb64159870 con 0x7fdb640cc920 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50035040 con 0x7fdb640cc920 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.487+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64159e30 con 0x7fdb640cc920 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.488+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6404f330 con 0x7fdb640cc920 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.489+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb50038020 con 0x7fdb640cc920 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.489+0000 7fdb617fa640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 0x7fdb4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.489+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb500ab670 con 0x7fdb640cc920 2024-03-04T08:51:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.489+0000 7fdb6885e640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 0x7fdb4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.490+0000 7fdb6885e640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 0x7fdb4806d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000f60 tx=0x7fdb58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.493+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdb5007a840 con 0x7fdb640cc920 2024-03-04T08:51:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.743+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdb640b40d0 con 0x7fdb640cc920 2024-03-04T08:51:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.746+0000 7fdb617fa640 1 -- 172.21.15.19:0/1607733351 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdb500800a0 con 0x7fdb640cc920 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.747+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 msgr2=0x7fdb4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.747+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 0x7fdb4806d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000f60 tx=0x7fdb58009040 comp rx=0 tx=0).stop 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.747+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 msgr2=0x7fdb64142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.747+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdb5002bee0 tx=0x7fdb500046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 shutdown_connections 2024-03-04T08:51:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdb641420d0 0x7fdb6406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb640cc920 0x7fdb64142890 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdb4806b4d0 0x7fdb4806d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 --2- 172.21.15.19:0/1607733351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdb640b4a50 0x7fdb64158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 >> 172.21.15.19:0/1607733351 conn(0x7fdb640b1c80 msgr2=0x7fdb6414bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 shutdown_connections 2024-03-04T08:51:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.748+0000 7fdb6aac2640 1 -- 172.21.15.19:0/1607733351 wait complete. 2024-03-04T08:51:33.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.862+0000 7f3f65ac3640 1 Processor -- start 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.862+0000 7f3f65ac3640 1 -- start start 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f65ac3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f6006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f65ac3640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3f6015b380 0x7f3f600708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f65ac3640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6006d030 con 0x7f3f6006cb90 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f65ac3640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6006d310 con 0x7f3f6015b380 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f65ac3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6006d5f0 con 0x7f3f60158880 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f6006cb90 0x7f3f6015e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48410/0 (socket says 172.21.15.19:48410) 2024-03-04T08:51:33.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5ffff640 1 -- 172.21.15.19:0/1351231297 learned_addr learned my addr 172.21.15.19:0/1351231297 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> v2:172.21.15.204:3300/0 conn(0x7f3f6015b380 0x7f3f600708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f6006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277509110 0 0) 0x7f3f6006d030 con 0x7f3f6006cb90 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f4c003520 con 0x7f3f6006cb90 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1289338583 0 0) 0x7f3f4c003520 con 0x7f3f6006cb90 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 msgr2=0x7f3f6006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f6006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 >> v2:172.21.15.204:3300/0 conn(0x7f3f6015b380 msgr2=0x7f3f600708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 --2- 172.21.15.19:0/1351231297 >> v2:172.21.15.204:3300/0 conn(0x7f3f6015b380 0x7f3f600708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6006d8d0 con 0x7f3f6006cb90 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f3f580019f0 con 0x7f3f6006cb90 2024-03-04T08:51:33.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f6006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 >> v1:172.21.15.19:6789/0 conn(0x7f3f6006cb90 legacy=0x7f3f6015e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f4c0039b0 0x7f3f4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6006d310 con 0x7f3f4c004800 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6006d5f0 con 0x7f3f4c0039b0 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c00b9c0 con 0x7f3f60158880 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.863+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> v2:172.21.15.204:3300/0 conn(0x7f3f6015b380 0x7f3f600708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f4c0039b0 0x7f3f4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f5ffff640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 -- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 msgr2=0x7f3f4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f60158880 0x7f3f4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 -- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f4c0039b0 msgr2=0x7f3f4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:33.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f4c0039b0 0x7f3f4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f57fff640 1 -- 172.21.15.19:0/1351231297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c003520 con 0x7f3f4c004800 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.864+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f4c0039b0 0x7f3f4c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f57fff640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f4c004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800bf10 tx=0x7f3f4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ea5e6a86127e96 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800bae0 con 0x7f3f4c004800 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48004220 con 0x7f3f4c004800 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f5effd640 1 -- 172.21.15.19:0/1351231297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4802f760 con 0x7f3f4c004800 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 -- 172.21.15.19:0/1351231297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 msgr2=0x7f3f4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/1351231297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f4c004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800bf10 tx=0x7f3f4c005830 comp rx=0 tx=0).stop 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f5ffff640 1 -- 172.21.15.19:0/1351231297 reap_dead start 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 -- 172.21.15.19:0/1351231297 shutdown_connections 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 -- 172.21.15.19:0/1351231297 >> 172.21.15.19:0/1351231297 conn(0x7f3f600b1c80 msgr2=0x7f3f600cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 -- 172.21.15.19:0/1351231297 shutdown_connections 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.865+0000 7f3f65ac3640 1 -- 172.21.15.19:0/1351231297 wait complete. 2024-03-04T08:51:33.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 Processor -- start 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 -- start start 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 0x7f3f600aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 0x7f3f600b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600ce950 con 0x7f3f4c004800 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600ce7d0 con 0x7f3f600af0c0 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f65ac3640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6006c650 con 0x7f3f601492f0 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f5f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45966/0 (socket says 172.21.15.19:45966) 2024-03-04T08:51:33.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f5f7fe640 1 -- 172.21.15.19:0/2139034820 learned_addr learned my addr 172.21.15.19:0/2139034820 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f57fff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 0x7f3f600aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.867+0000 7f3f5ffff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 0x7f3f600b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 -- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 msgr2=0x7f3f600aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 0x7f3f600aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 -- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 msgr2=0x7f3f600b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 0x7f3f600b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 -- 172.21.15.19:0/2139034820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6014b0c0 con 0x7f3f4c004800 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5ffff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 0x7f3f600b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f57fff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 0x7f3f600aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5f7fe640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f50011d00 tx=0x7f3f5000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50004020 con 0x7f3f4c004800 2024-03-04T08:51:33.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f500041c0 con 0x7f3f4c004800 2024-03-04T08:51:33.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6014b3a0 con 0x7f3f4c004800 2024-03-04T08:51:33.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50003610 con 0x7f3f4c004800 2024-03-04T08:51:33.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.868+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6014b960 con 0x7f3f4c004800 2024-03-04T08:51:33.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.869+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6004f330 con 0x7f3f4c004800 2024-03-04T08:51:33.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.869+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f50012040 con 0x7f3f4c004800 2024-03-04T08:51:33.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.870+0000 7f3f5cff9640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 0x7f3f4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:33.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.870+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f5008a390 con 0x7f3f4c004800 2024-03-04T08:51:33.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.870+0000 7f3f57fff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 0x7f3f4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:33.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.871+0000 7f3f57fff640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 0x7f3f4006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f48038000 tx=0x7f3f48033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:33.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:33.874+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3f50019030 con 0x7f3f4c004800 2024-03-04T08:51:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.128+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3f600af660 con 0x7f3f4c004800 2024-03-04T08:51:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.130+0000 7f3f5cff9640 1 -- 172.21.15.19:0/2139034820 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3f50059560 con 0x7f3f4c004800 2024-03-04T08:51:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 msgr2=0x7f3f4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 0x7f3f4006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f48038000 tx=0x7f3f48033000 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 msgr2=0x7f3f600a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f50011d00 tx=0x7f3f5000f610 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 shutdown_connections 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3f4006b4d0 0x7f3f4006d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3f600af0c0 0x7f3f600b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3f601492f0 0x7f3f600aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 --2- 172.21.15.19:0/2139034820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c004800 0x7f3f600a9450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 >> 172.21.15.19:0/2139034820 conn(0x7f3f600b1c80 msgr2=0x7f3f600afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 shutdown_connections 2024-03-04T08:51:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.132+0000 7f3f65ac3640 1 -- 172.21.15.19:0/2139034820 wait complete. 2024-03-04T08:51:34.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-04T08:51:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.245+0000 7fbdfb688640 1 Processor -- start 2024-03-04T08:51:34.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.245+0000 7fbdfb688640 1 -- start start 2024-03-04T08:51:34.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdfb688640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdf40b3240 0x7fbdf40b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdfb688640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbdf40b2910 0x7fbdf40d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdfb688640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf415e3f0 con 0x7fbdf415e010 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdfb688640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf40b1f40 con 0x7fbdf40b3240 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdfb688640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf40b1c10 con 0x7fbdf40b2910 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdf40b3240 0x7fbdf40b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdf40b3240 0x7fbdf40b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45976/0 (socket says 172.21.15.19:45976) 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2975405437 learned_addr learned my addr 172.21.15.19:0/2975405437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2975405437 >> v2:172.21.15.204:3300/0 conn(0x7fbdf40b2910 msgr2=0x7fbdf40d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 --2- 172.21.15.19:0/2975405437 >> v2:172.21.15.204:3300/0 conn(0x7fbdf40b2910 0x7fbdf40d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2975405437 >> v1:172.21.15.204:6789/0 conn(0x7fbdf415e010 legacy=0x7fbdf40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.246+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2975405437 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf406d1b0 con 0x7fbdf40b3240 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.247+0000 7fbdf8c23640 1 --2- 172.21.15.19:0/2975405437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b3240 0x7fbdf40b23d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbdf406e8c0 tx=0x7fbde802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b250107a844f9f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.247+0000 7fbdf3fff640 1 -- 172.21.15.19:0/2975405437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde802e070 con 0x7fbdf40b3240 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.247+0000 7fbdf3fff640 1 -- 172.21.15.19:0/2975405437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8037070 con 0x7fbdf40b3240 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.247+0000 7fbdf3fff640 1 -- 172.21.15.19:0/2975405437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031a00 con 0x7fbdf40b3240 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 -- 172.21.15.19:0/2975405437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b3240 msgr2=0x7fbdf40b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2975405437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b3240 0x7fbdf40b23d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbdf406e8c0 tx=0x7fbde802b880 comp rx=0 tx=0).stop 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 -- 172.21.15.19:0/2975405437 shutdown_connections 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2975405437 >> v2:172.21.15.204:3300/0 conn(0x7fbdf40b2910 0x7fbdf40d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2975405437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b3240 0x7fbdf40b23d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 -- 172.21.15.19:0/2975405437 >> 172.21.15.19:0/2975405437 conn(0x7fbdf409a9f0 msgr2=0x7fbdf409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 -- 172.21.15.19:0/2975405437 shutdown_connections 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.248+0000 7fbdfb688640 1 -- 172.21.15.19:0/2975405437 wait complete. 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.249+0000 7fbdfb688640 1 Processor -- start 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.249+0000 7fbdfb688640 1 -- start start 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 0x7fbdf40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf40b5ac0 0x7fbdf409e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40d2010 con 0x7fbdf40b5660 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf406ced0 con 0x7fbdf415e010 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdfb688640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf40d2190 con 0x7fbdf40b5ac0 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45992/0 (socket says 172.21.15.19:45992) 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2492135735 learned_addr learned my addr 172.21.15.19:0/2492135735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf9424640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 0x7fbdf40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf9c25640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf40b5ac0 0x7fbdf409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf40b5ac0 msgr2=0x7fbdf409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf40b5ac0 0x7fbdf409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 msgr2=0x7fbdf40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 0x7fbdf40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 -- 172.21.15.19:0/2492135735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40cde00 con 0x7fbdf40b5660 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf9424640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 0x7fbdf40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.250+0000 7fbdf8c23640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.251+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8032880 con 0x7fbdf40b5660 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.251+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8032a20 con 0x7fbdf40b5660 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.251+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf40b6090 con 0x7fbdf40b5660 2024-03-04T08:51:34.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.251+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8032e10 con 0x7fbdf40b5660 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.251+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf41513a0 con 0x7fbdf40b5660 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.252+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf404f330 con 0x7fbdf40b5660 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.252+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbde80453f0 con 0x7fbdf40b5660 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.253+0000 7fbdf1ffb640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 0x7fbde006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.253+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbde80ac170 con 0x7fbdf40b5660 2024-03-04T08:51:34.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.253+0000 7fbdf9424640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 0x7fbde006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.253+0000 7fbdf9424640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 0x7fbde006d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006fd0 tx=0x7fbdec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.257+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbde8040070 con 0x7fbdf40b5660 2024-03-04T08:51:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.506+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fbdf415d060 con 0x7fbdf40b5660 2024-03-04T08:51:34.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.508+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/2492135735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbde807ae00 con 0x7fbdf40b5660 2024-03-04T08:51:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 msgr2=0x7fbde006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 0x7fbde006d9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006fd0 tx=0x7fbdec008040 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 msgr2=0x7fbdf409e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde80046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 shutdown_connections 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdf40b5ac0 0x7fbdf409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf40b5660 0x7fbdf409e140 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbde006b500 0x7fbde006d9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 --2- 172.21.15.19:0/2492135735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdf415e010 0x7fbdf40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 >> 172.21.15.19:0/2492135735 conn(0x7fbdf409a9f0 msgr2=0x7fbdf40ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 shutdown_connections 2024-03-04T08:51:34.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.510+0000 7fbdfb688640 1 -- 172.21.15.19:0/2492135735 wait complete. 2024-03-04T08:51:34.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.622+0000 7f39360df640 1 Processor -- start 2024-03-04T08:51:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.622+0000 7f39360df640 1 -- start start 2024-03-04T08:51:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39300d02c0 0x7f39300cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 0x7f39300cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39300ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39300b50b0 con 0x7f39300d02c0 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393015c620 con 0x7f39300d06a0 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f39360df640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cd800 con 0x7f39300ce130 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39300d02c0 0x7f39300cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39300d02c0 0x7f39300cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46008/0 (socket says 172.21.15.19:46008) 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 -- 172.21.15.19:0/372937761 learned_addr learned my addr 172.21.15.19:0/372937761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392effd640 1 --2- 172.21.15.19:0/372937761 >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 0x7f39300cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392ffff640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39300ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 -- 172.21.15.19:0/372937761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 msgr2=0x7f39300ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39300ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 -- 172.21.15.19:0/372937761 >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 msgr2=0x7f39300cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 --2- 172.21.15.19:0/372937761 >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 0x7f39300cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392f7fe640 1 -- 172.21.15.19:0/372937761 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300b4a60 con 0x7f39300d02c0 2024-03-04T08:51:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.623+0000 7f392effd640 1 --2- 172.21.15.19:0/372937761 >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 0x7f39300cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f392f7fe640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d02c0 0x7f39300cf850 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3930068b00 tx=0x7f392402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba90576fca9e49c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f392e7fc640 1 -- 172.21.15.19:0/372937761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924035020 con 0x7f39300d02c0 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f392e7fc640 1 -- 172.21.15.19:0/372937761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3924031870 con 0x7f39300d02c0 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f392e7fc640 1 -- 172.21.15.19:0/372937761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924031c40 con 0x7f39300d02c0 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f39360df640 1 -- 172.21.15.19:0/372937761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d02c0 msgr2=0x7f39300cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.624+0000 7f39360df640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d02c0 0x7f39300cf850 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3930068b00 tx=0x7f392402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 -- 172.21.15.19:0/372937761 shutdown_connections 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39300ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 --2- 172.21.15.19:0/372937761 >> v2:172.21.15.204:3300/0 conn(0x7f39300d06a0 0x7f39300cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 --2- 172.21.15.19:0/372937761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d02c0 0x7f39300cf850 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 -- 172.21.15.19:0/372937761 >> 172.21.15.19:0/372937761 conn(0x7f39300b35a0 msgr2=0x7f39300b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 -- 172.21.15.19:0/372937761 shutdown_connections 2024-03-04T08:51:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.625+0000 7f39360df640 1 -- 172.21.15.19:0/372937761 wait complete. 2024-03-04T08:51:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.626+0000 7f39360df640 1 Processor -- start 2024-03-04T08:51:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.626+0000 7f39360df640 1 -- start start 2024-03-04T08:51:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39301f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39300d02c0 0x7f39300c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cec00 con 0x7f39300d06a0 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cea80 con 0x7f39300d02c0 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300ced80 con 0x7f39300ce130 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46014/0 (socket says 172.21.15.19:46014) 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 -- 172.21.15.19:0/2799232010 learned_addr learned my addr 172.21.15.19:0/2799232010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392f7fe640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39301f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392effd640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39300d02c0 0x7f39300c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 -- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 msgr2=0x7f39301f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39301f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 -- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39300d02c0 msgr2=0x7f39300c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39300d02c0 0x7f39300c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 -- 172.21.15.19:0/2799232010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300c61f0 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f392ffff640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3928007e60 tx=0x7f392800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928014620 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928019070 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39300c64d0 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928014a20 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.627+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39300c6a90 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.628+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393004f330 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.629+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3928014bc0 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.629+0000 7f3917fff640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 0x7f391c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.629+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f392808a6e0 con 0x7f39300d06a0 2024-03-04T08:51:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.629+0000 7f392f7fe640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 0x7f391c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.630+0000 7f392f7fe640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 0x7f391c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3924036000 tx=0x7f392403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.633+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3928059940 con 0x7f39300d06a0 2024-03-04T08:51:34.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.816+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39300cf3d0 con 0x7f39300d06a0 2024-03-04T08:51:34.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.817+0000 7f3917fff640 1 -- 172.21.15.19:0/2799232010 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12879 (secure 0 0 0) 0x7f3928059240 con 0x7f39300d06a0 2024-03-04T08:51:34.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:34.814 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:31.835547+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 msgr2=0x7f391c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 0x7f391c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3924036000 tx=0x7f392403c040 comp rx=0 tx=0).stop 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 msgr2=0x7f39300cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3928007e60 tx=0x7f392800e4b0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 shutdown_connections 2024-03-04T08:51:34.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39300d06a0 0x7f39300cc5d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f391c06b4d0 0x7f391c06d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f39300d02c0 0x7f39300c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 --2- 172.21.15.19:0/2799232010 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f39300ce130 0x7f39301f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 >> 172.21.15.19:0/2799232010 conn(0x7f39300b35a0 msgr2=0x7f39300b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 shutdown_connections 2024-03-04T08:51:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.820+0000 7f39360df640 1 -- 172.21.15.19:0/2799232010 wait complete. 2024-03-04T08:51:34.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:34.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:34.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.935+0000 7feef4afa640 1 Processor -- start 2024-03-04T08:51:34.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.935+0000 7feef4afa640 1 -- start start 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feef4afa640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7feef015ecd0 0x7feef00cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feef4afa640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00cfa50 con 0x7feef00d10c0 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feef4afa640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00b45c0 con 0x7feef00d14a0 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feef4afa640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef015c050 con 0x7feef015ecd0 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feeee59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feef00d10c0 0x7feef00d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48412/0 (socket says 172.21.15.19:48412) 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.936+0000 7feeee59c640 1 -- 172.21.15.19:0/809959030 learned_addr learned my addr 172.21.15.19:0/809959030 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeeed9d640 1 --2- 172.21.15.19:0/809959030 >> v2:172.21.15.204:3300/0 conn(0x7feef015ecd0 0x7feef00cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067340355 0 0) 0x7feef00cfa50 con 0x7feef00d10c0 2024-03-04T08:51:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed8003520 con 0x7feef00d10c0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269278167 0 0) 0x7feed8003520 con 0x7feef00d10c0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 >> v2:172.21.15.204:3300/0 conn(0x7feef015ecd0 msgr2=0x7feef00cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 --2- 172.21.15.19:0/809959030 >> v2:172.21.15.204:3300/0 conn(0x7feef015ecd0 0x7feef00cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 >> v1:172.21.15.204:6789/0 conn(0x7feef00d14a0 legacy=0x7feef015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef015f160 con 0x7feef00d10c0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7feee8001670 con 0x7feef00d10c0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 >> v1:172.21.15.19:6789/0 conn(0x7feef00d10c0 legacy=0x7feef00d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 0x7feed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80043b0 0x7feed8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed8005080 0x7feed800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed800bfb0 con 0x7feed80039b0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed800c160 con 0x7feed8005080 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed800c360 con 0x7feed80043b0 2024-03-04T08:51:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 0x7feed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeeed9d640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed8005080 0x7feed800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeedd9b640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80043b0 0x7feed8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 -- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80043b0 msgr2=0x7feed8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80043b0 0x7feed8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 -- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed8005080 msgr2=0x7feed800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed8005080 0x7feed800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeee59c640 1 -- 172.21.15.19:0/809959030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8003520 con 0x7feed80039b0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeeed9d640 1 -- 172.21.15.19:0/809959030 reap_dead start 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.937+0000 7feeedd9b640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feed80043b0 0x7feed8004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.938+0000 7feeee59c640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 0x7feed8003d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feee800c290 tx=0x7feed8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836a2a3ed05083e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.938+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8007d50 con 0x7feed80039b0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.938+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8030070 con 0x7feed80039b0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.938+0000 7feeed59a640 1 -- 172.21.15.19:0/809959030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8005d70 con 0x7feed80039b0 2024-03-04T08:51:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 -- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 msgr2=0x7feed8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 0x7feed8003d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feee800c290 tx=0x7feed8005830 comp rx=0 tx=0).stop 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 -- 172.21.15.19:0/809959030 shutdown_connections 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 --2- 172.21.15.19:0/809959030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feed80039b0 0x7feed8003d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 -- 172.21.15.19:0/809959030 >> 172.21.15.19:0/809959030 conn(0x7feef00b3800 msgr2=0x7feef00b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 -- 172.21.15.19:0/809959030 shutdown_connections 2024-03-04T08:51:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.939+0000 7feef4afa640 1 -- 172.21.15.19:0/809959030 wait complete. 2024-03-04T08:51:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.940+0000 7feef4afa640 1 Processor -- start 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.940+0000 7feef4afa640 1 -- start start 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 0x7feef00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feef00cc180 0x7feef00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00cfcf0 con 0x7feef015f680 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00d0060 con 0x7feed80039b0 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feef4afa640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef00d04f0 con 0x7feef00cc180 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46044/0 (socket says 172.21.15.19:46044) 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 -- 172.21.15.19:0/2731327260 learned_addr learned my addr 172.21.15.19:0/2731327260 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 -- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feef00cc180 msgr2=0x7feef00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feef00cc180 0x7feef00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 -- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 msgr2=0x7feef00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeee59c640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 0x7feef00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 0x7feef00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 -- 172.21.15.19:0/2731327260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00ccd60 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeee59c640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 0x7feef00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.941+0000 7feeeed9d640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feef0071b60 tx=0x7feee000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.942+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000fde0 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.942+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0015430 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.942+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef00cd040 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.942+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0015820 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.942+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef00cd600 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.943+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef009fe60 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.943+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feee00159c0 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.943+0000 7feedeffd640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 0x7feed006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.944+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feee008ad50 con 0x7feef015f680 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.944+0000 7feeee59c640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 0x7feed006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.944+0000 7feeee59c640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 0x7feed006d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feee8034000 tx=0x7feee8039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:34.948+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7feee008e030 con 0x7feef015f680 2024-03-04T08:51:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.127+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feef0068ff0 con 0x7feef015f680 2024-03-04T08:51:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.128+0000 7feedeffd640 1 -- 172.21.15.19:0/2731327260 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7feee0019030 con 0x7feef015f680 2024-03-04T08:51:35.124 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 msgr2=0x7feed006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 0x7feed006d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feee8034000 tx=0x7feee8039040 comp rx=0 tx=0).stop 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 msgr2=0x7feef015fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feef0071b60 tx=0x7feee000f580 comp rx=0 tx=0).stop 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 shutdown_connections 2024-03-04T08:51:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feef015f680 0x7feef015fb10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7feef00cc180 0x7feef00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7feed006b500 0x7feed006d9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 --2- 172.21.15.19:0/2731327260 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7feed80039b0 0x7feef00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 >> 172.21.15.19:0/2731327260 conn(0x7feef00b3800 msgr2=0x7feef00cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 shutdown_connections 2024-03-04T08:51:35.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.130+0000 7feef4afa640 1 -- 172.21.15.19:0/2731327260 wait complete. 2024-03-04T08:51:35.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T08:51:35.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.242+0000 7f1ab290d640 1 Processor -- start 2024-03-04T08:51:35.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.242+0000 7f1ab290d640 1 -- start start 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab290d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac15c140 0x7f1aac0d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab290d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1aac0cd120 0x7f1aac0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab290d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0cd620 con 0x7f1aac0cf850 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab290d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac15c520 con 0x7f1aac0cd120 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab290d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0cd900 con 0x7f1aac15c140 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1aac0cd120 0x7f1aac0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1aac0cd120 0x7f1aac0d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46046/0 (socket says 172.21.15.19:46046) 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1ab0eaa640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1aac0cf850 0x7f1aac0ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48422/0 (socket says 172.21.15.19:48422) 2024-03-04T08:51:35.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 -- 172.21.15.19:0/983087609 learned_addr learned my addr 172.21.15.19:0/983087609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aabfff640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac15c140 0x7f1aac0d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 -- 172.21.15.19:0/983087609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac15c140 msgr2=0x7f1aac0d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac15c140 0x7f1aac0d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 -- 172.21.15.19:0/983087609 >> v1:172.21.15.19:6789/0 conn(0x7f1aac0cf850 legacy=0x7f1aac0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aaaffd640 1 -- 172.21.15.19:0/983087609 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379450425 0 0) 0x7f1aac0cd620 con 0x7f1aac0cf850 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.243+0000 7f1aab7fe640 1 -- 172.21.15.19:0/983087609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0b1410 con 0x7f1aac0cd120 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1aab7fe640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac0cd120 0x7f1aac0d0550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009870 tx=0x7f1a9c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6299b6e7293417c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1aaaffd640 1 -- 172.21.15.19:0/983087609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c02f840 con 0x7f1aac0cd120 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1aaaffd640 1 -- 172.21.15.19:0/983087609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c02f9e0 con 0x7f1aac0cd120 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1aaaffd640 1 -- 172.21.15.19:0/983087609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c02fdb0 con 0x7f1aac0cd120 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1ab290d640 1 -- 172.21.15.19:0/983087609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac0cd120 msgr2=0x7f1aac0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.244+0000 7f1ab290d640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac0cd120 0x7f1aac0d0550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009870 tx=0x7f1a9c02ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 -- 172.21.15.19:0/983087609 shutdown_connections 2024-03-04T08:51:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac0cd120 0x7f1aac0d0550 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 --2- 172.21.15.19:0/983087609 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac15c140 0x7f1aac0d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 -- 172.21.15.19:0/983087609 >> 172.21.15.19:0/983087609 conn(0x7f1aac0b35a0 msgr2=0x7f1aac0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 -- 172.21.15.19:0/983087609 shutdown_connections 2024-03-04T08:51:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.245+0000 7f1ab290d640 1 -- 172.21.15.19:0/983087609 wait complete. 2024-03-04T08:51:35.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.246+0000 7f1ab290d640 1 Processor -- start 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.246+0000 7f1ab290d640 1 -- start start 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 0x7f1aac0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac0cf850 0x7f1aac0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0cf240 con 0x7f1aac15c140 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b19d0 con 0x7f1aac0cd120 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0cf3c0 con 0x7f1aac0cf850 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46050/0 (socket says 172.21.15.19:46050) 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 -- 172.21.15.19:0/451637326 learned_addr learned my addr 172.21.15.19:0/451637326 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:35.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aabfff640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 0x7f1aac0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aab7fe640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac0cf850 0x7f1aac0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 -- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac0cf850 msgr2=0x7f1aac0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac0cf850 0x7f1aac0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 -- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 msgr2=0x7f1aac0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 0x7f1aac0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 -- 172.21.15.19:0/451637326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0c8b40 con 0x7f1aac15c140 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aabfff640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 0x7f1aac0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab0eaa640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7a0 tx=0x7f1aa400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4018070 con 0x7f1aac15c140 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400a640 con 0x7f1aac15c140 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac0c8e60 con 0x7f1aac15c140 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.247+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400aab0 con 0x7f1aac15c140 2024-03-04T08:51:35.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.248+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac0c96a0 con 0x7f1aac15c140 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.249+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac06f4c0 con 0x7f1aac15c140 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.249+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1aa401b070 con 0x7f1aac15c140 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.249+0000 7f1aa8ff9640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 0x7f1a8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.249+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1aa40894d0 con 0x7f1aac15c140 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.250+0000 7f1aabfff640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 0x7f1a8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.250+0000 7f1aabfff640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 0x7f1a8c06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400a9d0 tx=0x7f1a94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.254+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1aac06f4c0 con 0x7f1aac15c140 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.438+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1aac04f330 con 0x7f1aac15c140 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.439+0000 7f1aa8ff9640 1 -- 172.21.15.19:0/451637326 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1aac0c8e60 con 0x7f1aac15c140 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:35.435 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-03-04T08:51:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 msgr2=0x7f1a8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 0x7f1a8c06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400a9d0 tx=0x7f1a94008040 comp rx=0 tx=0).stop 2024-03-04T08:51:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 msgr2=0x7f1aac1eb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c7a0 tx=0x7f1aa400cc60 comp rx=0 tx=0).stop 2024-03-04T08:51:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 shutdown_connections 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aac15c140 0x7f1aac1eb8d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1aac0cf850 0x7f1aac0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a8c06b4d0 0x7f1a8c06d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 --2- 172.21.15.19:0/451637326 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1aac0cd120 0x7f1aac0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 >> 172.21.15.19:0/451637326 conn(0x7f1aac0b35a0 msgr2=0x7f1aac0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 shutdown_connections 2024-03-04T08:51:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.441+0000 7f1ab290d640 1 -- 172.21.15.19:0/451637326 wait complete. 2024-03-04T08:51:35.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T08:51:35.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T08:51:35.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.556+0000 7fbd64d56640 1 Processor -- start 2024-03-04T08:51:35.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.556+0000 7fbd64d56640 1 -- start start 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd64d56640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd6015e180 0x7fbd600cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd64d56640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd64d56640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6015f7c0 con 0x7fbd6015f290 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd64d56640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600d0290 con 0x7fbd6015e180 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd64d56640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600ccc60 con 0x7fbd600cfe00 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd5e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd6015e180 0x7fbd600cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd57fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbd6015f290 0x7fbd600cf6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48432/0 (socket says 172.21.15.19:48432) 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.557+0000 7fbd57fff640 1 -- 172.21.15.19:0/1295817082 learned_addr learned my addr 172.21.15.19:0/1295817082 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5e59c640 1 -- 172.21.15.19:0/1295817082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 msgr2=0x7fbd600ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5e59c640 1 -- 172.21.15.19:0/1295817082 >> v1:172.21.15.19:6789/0 conn(0x7fbd6015f290 legacy=0x7fbd600cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5e59c640 1 -- 172.21.15.19:0/1295817082 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600ccf40 con 0x7fbd6015e180 2024-03-04T08:51:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.558+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015e180 0x7fbd600cd740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8703f99a0fe24a8d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd5dd9b640 1 -- 172.21.15.19:0/1295817082 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50037070 con 0x7fbd6015e180 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd5dd9b640 1 -- 172.21.15.19:0/1295817082 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50030710 con 0x7fbd6015e180 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd5dd9b640 1 -- 172.21.15.19:0/1295817082 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5002be60 con 0x7fbd6015e180 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 -- 172.21.15.19:0/1295817082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015e180 msgr2=0x7fbd600cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015e180 0x7fbd600cd740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002b660 comp rx=0 tx=0).stop 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 -- 172.21.15.19:0/1295817082 shutdown_connections 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 --2- 172.21.15.19:0/1295817082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015e180 0x7fbd600cd740 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 -- 172.21.15.19:0/1295817082 >> 172.21.15.19:0/1295817082 conn(0x7fbd600d1b20 msgr2=0x7fbd600d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 -- 172.21.15.19:0/1295817082 shutdown_connections 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.559+0000 7fbd64d56640 1 -- 172.21.15.19:0/1295817082 wait complete. 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.560+0000 7fbd64d56640 1 Processor -- start 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 -- start start 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 0x7fbd600b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600cc910 con 0x7fbd6015f290 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600cdc80 con 0x7fbd6015e180 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd64d56640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b2ee0 con 0x7fbd600cfe00 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd5ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd5ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46066/0 (socket says 172.21.15.19:46066) 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3089754913 learned_addr learned my addr 172.21.15.19:0/3089754913 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.561+0000 7fbd57fff640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 0x7fbd600b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 msgr2=0x7fbd600c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 msgr2=0x7fbd600b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 0x7fbd600b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 -- 172.21.15.19:0/3089754913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd601495d0 con 0x7fbd6015f290 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd57fff640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 0x7fbd600b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd5ed9d640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd58007e60 tx=0x7fbd5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58014420 con 0x7fbd6015f290 2024-03-04T08:51:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd58019070 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600b6ec0 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58014820 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.562+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600b7480 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.563+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6004f330 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.563+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd580149c0 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.564+0000 7fbd56ffd640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.564+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd5808a710 con 0x7fbd6015f290 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.564+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.565+0000 7fbd5e59c640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 0x7fbd4006d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd50008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.568+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd580598e0 con 0x7fbd6015f290 2024-03-04T08:51:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.752+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd600b76c0 con 0x7fbd6015f290 2024-03-04T08:51:35.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.839+0000 7fbd56ffd640 1 -- 172.21.15.19:0/3089754913 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd580591e0 con 0x7fbd6015f290 2024-03-04T08:51:35.835 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 msgr2=0x7fbd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 0x7fbd4006d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd50008030 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 msgr2=0x7fbd60148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd58007e60 tx=0x7fbd5800e4b0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 shutdown_connections 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd6015f290 0x7fbd60148b50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd6015e180 0x7fbd600b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 --2- 172.21.15.19:0/3089754913 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd600cfe00 0x7fbd600c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 >> 172.21.15.19:0/3089754913 conn(0x7fbd600d1b20 msgr2=0x7fbd6015c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.841+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 shutdown_connections 2024-03-04T08:51:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.842+0000 7fbd64d56640 1 -- 172.21.15.19:0/3089754913 wait complete. 2024-03-04T08:51:35.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T08:51:35.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.963+0000 7f83601e9640 1 Processor -- start 2024-03-04T08:51:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.963+0000 7f83601e9640 1 -- start start 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f83601e9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f83601e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f83601e9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835806d030 con 0x7f835806cab0 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f83601e9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cf1c0 con 0x7f835815def0 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f83601e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580cc760 con 0x7f83580cea50 2024-03-04T08:51:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835e786640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835df85640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835e786640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:47122/0 (socket says 172.21.15.19:47122) 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835df85640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:37362/0 (socket says 172.21.15.19:37362) 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835e786640 1 -- 172.21.15.19:0/1118580258 learned_addr learned my addr 172.21.15.19:0/1118580258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.964+0000 7f835d784640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f835806cab0 0x7f83580ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51562/0 (socket says 172.21.15.19:51562) 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835cf83640 1 -- 172.21.15.19:0/1118580258 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025883624 0 0) 0x7f835806d030 con 0x7f835806cab0 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835cf83640 1 -- 172.21.15.19:0/1118580258 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8340003520 con 0x7f835806cab0 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835e786640 1 -- 172.21.15.19:0/1118580258 >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 msgr2=0x7f83580b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835e786640 1 --2- 172.21.15.19:0/1118580258 >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835e786640 1 -- 172.21.15.19:0/1118580258 >> v1:172.21.15.204:6789/0 conn(0x7f835806cab0 legacy=0x7f83580ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835e786640 1 -- 172.21.15.19:0/1118580258 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835806d310 con 0x7f83580cea50 2024-03-04T08:51:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.965+0000 7f835df85640 1 --2- 172.21.15.19:0/1118580258 >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f835e786640 1 --2- 172.21.15.19:0/1118580258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8350009870 tx=0x7f835002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fbd3b13e1efa82c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f835cf83640 1 -- 172.21.15.19:0/1118580258 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835002f840 con 0x7f83580cea50 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f835cf83640 1 -- 172.21.15.19:0/1118580258 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835002f9e0 con 0x7f83580cea50 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f835cf83640 1 -- 172.21.15.19:0/1118580258 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835002fd90 con 0x7f83580cea50 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 -- 172.21.15.19:0/1118580258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 msgr2=0x7f83580ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 --2- 172.21.15.19:0/1118580258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8350009870 tx=0x7f835002ba20 comp rx=0 tx=0).stop 2024-03-04T08:51:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 -- 172.21.15.19:0/1118580258 shutdown_connections 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 --2- 172.21.15.19:0/1118580258 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83580cea50 0x7f83580ccbf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 --2- 172.21.15.19:0/1118580258 >> v2:172.21.15.204:3300/0 conn(0x7f835815def0 0x7f83580b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.966+0000 7f83601e9640 1 -- 172.21.15.19:0/1118580258 >> 172.21.15.19:0/1118580258 conn(0x7f83580b3690 msgr2=0x7f83580b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.967+0000 7f83601e9640 1 -- 172.21.15.19:0/1118580258 shutdown_connections 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.967+0000 7f83601e9640 1 -- 172.21.15.19:0/1118580258 wait complete. 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 Processor -- start 2024-03-04T08:51:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 -- start start 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83580cea50 0x7f83581f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f835815def0 0x7f83580c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835815e2d0 con 0x7f835806cab0 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580cc3f0 con 0x7f83580cea50 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.968+0000 7f83601e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835815e450 con 0x7f835815def0 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46076/0 (socket says 172.21.15.19:46076) 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 -- 172.21.15.19:0/911014548 learned_addr learned my addr 172.21.15.19:0/911014548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835d784640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83580cea50 0x7f83581f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835e786640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f835815def0 0x7f83580c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 -- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f835815def0 msgr2=0x7f83580c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f835815def0 0x7f83580c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 -- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83580cea50 msgr2=0x7f83581f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83580cea50 0x7f83581f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 -- 172.21.15.19:0/911014548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83581f7070 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f835df85640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f834800efc0 tx=0x7f834800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348018020 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348014680 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580ca020 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348014a50 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.969+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580b4b00 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.970+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835809fcf0 con 0x7f835806cab0 2024-03-04T08:51:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.971+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8348005d10 con 0x7f835806cab0 2024-03-04T08:51:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.971+0000 7f83567fc640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 0x7f834406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.971+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f834808acb0 con 0x7f835806cab0 2024-03-04T08:51:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.971+0000 7f835d784640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 0x7f834406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.972+0000 7f835d784640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 0x7f834406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83580b3450 tx=0x7f834c007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:35.976+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8348022030 con 0x7f835806cab0 2024-03-04T08:51:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.158+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f835815e670 con 0x7f835806cab0 2024-03-04T08:51:36.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.841+0000 7f83567fc640 1 -- 172.21.15.19:0/911014548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8348010040 con 0x7f835806cab0 2024-03-04T08:51:36.838 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-03-04T08:51:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.844+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 msgr2=0x7f834406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.844+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 0x7f834406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83580b3450 tx=0x7f834c007cf0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.844+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 msgr2=0x7f83581f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.844+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f834800efc0 tx=0x7f834800c490 comp rx=0 tx=0).stop 2024-03-04T08:51:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 shutdown_connections 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f835815def0 0x7f83580c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f834406b4d0 0x7f834406d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83580cea50 0x7f83581f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 --2- 172.21.15.19:0/911014548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f835806cab0 0x7f83581f6b30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 >> 172.21.15.19:0/911014548 conn(0x7f83580b3690 msgr2=0x7f835806f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 shutdown_connections 2024-03-04T08:51:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.845+0000 7f83601e9640 1 -- 172.21.15.19:0/911014548 wait complete. 2024-03-04T08:51:36.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T08:51:36.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.979+0000 7f7c9fdd7640 1 Processor -- start 2024-03-04T08:51:36.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.979+0000 7f7c9fdd7640 1 -- start start 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9fdd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 0x7f7c9806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9fdd7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c980b5ee0 0x7f7c9806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9fdd7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9806d5b0 con 0x7f7c9806c290 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9fdd7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9806ebf0 con 0x7f7c980b5ee0 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9fdd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980b6430 con 0x7f7c9806cc90 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c980b5ee0 0x7f7c9806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c980b5ee0 0x7f7c9806f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46080/0 (socket says 172.21.15.19:46080) 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9e374640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c9806c290 0x7f7c9806fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48444/0 (socket says 172.21.15.19:48444) 2024-03-04T08:51:36.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 -- 172.21.15.19:0/1711524508 learned_addr learned my addr 172.21.15.19:0/1711524508 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 -- 172.21.15.19:0/1711524508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 msgr2=0x7f7c9806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9db73640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 0x7f7c9806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9cb71640 1 -- 172.21.15.19:0/1711524508 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177108794 0 0) 0x7f7c9806d5b0 con 0x7f7c9806c290 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 0x7f7c9806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 -- 172.21.15.19:0/1711524508 >> v1:172.21.15.19:6789/0 conn(0x7f7c9806c290 legacy=0x7f7c9806fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9d372640 1 -- 172.21.15.19:0/1711524508 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980b6710 con 0x7f7c980b5ee0 2024-03-04T08:51:36.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.980+0000 7f7c9db73640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 0x7f7c9806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.981+0000 7f7c9d372640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c980b5ee0 0x7f7c9806f640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009870 tx=0x7f7c8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78ee955d0b99066 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.981+0000 7f7c9cb71640 1 -- 172.21.15.19:0/1711524508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c035020 con 0x7f7c980b5ee0 2024-03-04T08:51:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.981+0000 7f7c9cb71640 1 -- 172.21.15.19:0/1711524508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c031640 con 0x7f7c980b5ee0 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.981+0000 7f7c9cb71640 1 -- 172.21.15.19:0/1711524508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02d040 con 0x7f7c980b5ee0 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/1711524508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c980b5ee0 msgr2=0x7f7c9806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c980b5ee0 0x7f7c9806f640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009870 tx=0x7f7c8c02b8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/1711524508 shutdown_connections 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c980b5ee0 0x7f7c9806f640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/1711524508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c9806cc90 0x7f7c9806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/1711524508 >> 172.21.15.19:0/1711524508 conn(0x7f7c980b6ea0 msgr2=0x7f7c980b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/1711524508 shutdown_connections 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.982+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/1711524508 wait complete. 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.983+0000 7f7c9fdd7640 1 Processor -- start 2024-03-04T08:51:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.983+0000 7f7c9fdd7640 1 -- start start 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 0x7f7c98155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 0x7f7c980b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9806c850 con 0x7f7c9806c290 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9806f120 con 0x7f7c9806cc90 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9fdd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9806c9d0 con 0x7f7c980b5ee0 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46086/0 (socket says 172.21.15.19:46086) 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 -- 172.21.15.19:0/2148293641 learned_addr learned my addr 172.21.15.19:0/2148293641 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9e374640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 0x7f7c980b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9d372640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 0x7f7c98155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 -- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 msgr2=0x7f7c980b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 0x7f7c980b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 -- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 msgr2=0x7f7c98155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 0x7f7c98155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 -- 172.21.15.19:0/2148293641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c981f4510 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9e374640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 0x7f7c980b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9d372640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 0x7f7c98155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.984+0000 7f7c9db73640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c7f0 tx=0x7f7c9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.985+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90015070 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.985+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90007a30 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.985+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c98154fd0 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.985+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90007e00 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.985+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c981463f0 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.986+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9804f330 con 0x7f7c9806c290 2024-03-04T08:51:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.986+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c90018070 con 0x7f7c9806c290 2024-03-04T08:51:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.986+0000 7f7c967fc640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 0x7f7c8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.987+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7c9008a110 con 0x7f7c9806c290 2024-03-04T08:51:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.987+0000 7f7c9d372640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 0x7f7c8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.987+0000 7f7c9d372640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 0x7f7c8406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c036000 tx=0x7f7c8c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:36.991+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7c90058ff0 con 0x7f7c9806c290 2024-03-04T08:51:37.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.210+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c98154da0 con 0x7f7c9806c290 2024-03-04T08:51:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.862+0000 7f7c967fc640 1 -- 172.21.15.19:0/2148293641 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c900588f0 con 0x7f7c9806c290 2024-03-04T08:51:37.859 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 4 and data pool 5 2024-03-04T08:51:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.875+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 msgr2=0x7f7c8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.875+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 0x7f7c8406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c036000 tx=0x7f7c8c008030 comp rx=0 tx=0).stop 2024-03-04T08:51:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.875+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 msgr2=0x7f7c98145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.875+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c7f0 tx=0x7f7c9000cbf0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 shutdown_connections 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c980b5ee0 0x7f7c980b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c8406b4d0 0x7f7c8406d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c9806cc90 0x7f7c98155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 --2- 172.21.15.19:0/2148293641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9806c290 0x7f7c98145eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 >> 172.21.15.19:0/2148293641 conn(0x7f7c980b6ea0 msgr2=0x7f7c9806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 shutdown_connections 2024-03-04T08:51:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.878+0000 7f7c9fdd7640 1 -- 172.21.15.19:0/2148293641 wait complete. 2024-03-04T08:51:37.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:37.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.999+0000 7fcba9d5c640 1 Processor -- start 2024-03-04T08:51:37.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:37.999+0000 7fcba9d5c640 1 -- start start 2024-03-04T08:51:37.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba406b220 0x7fcba415e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 0x7fcba4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba4161b70 con 0x7fcba406b220 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba415ea30 con 0x7fcba40ce920 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba9d5c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba415ed10 con 0x7fcba4071ec0 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba406b220 0x7fcba415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcba406b220 0x7fcba415e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40974/0 (socket says 172.21.15.19:40974) 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 -- 172.21.15.19:0/1137931581 learned_addr learned my addr 172.21.15.19:0/1137931581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 -- 172.21.15.19:0/1137931581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 msgr2=0x7fcba4162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 --2- 172.21.15.19:0/1137931581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 -- 172.21.15.19:0/1137931581 >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 msgr2=0x7fcba4071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba2ffd640 1 --2- 172.21.15.19:0/1137931581 >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 0x7fcba4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 --2- 172.21.15.19:0/1137931581 >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 0x7fcba4071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:37.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba37fe640 1 -- 172.21.15.19:0/1137931581 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba415eff0 con 0x7fcba406b220 2024-03-04T08:51:37.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.000+0000 7fcba2ffd640 1 --2- 172.21.15.19:0/1137931581 >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 0x7fcba4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.001+0000 7fcba37fe640 1 --2- 172.21.15.19:0/1137931581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba415e450 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcba406cf40 tx=0x7fcb9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958847e7f632e5fd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.001+0000 7fcba27fc640 1 -- 172.21.15.19:0/1137931581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9402e070 con 0x7fcba406b220 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.001+0000 7fcba27fc640 1 -- 172.21.15.19:0/1137931581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94037070 con 0x7fcba406b220 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.001+0000 7fcba27fc640 1 -- 172.21.15.19:0/1137931581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94031a00 con 0x7fcba406b220 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 -- 172.21.15.19:0/1137931581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 msgr2=0x7fcba415e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/1137931581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba415e450 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcba406cf40 tx=0x7fcb9402b880 comp rx=0 tx=0).stop 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 -- 172.21.15.19:0/1137931581 shutdown_connections 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/1137931581 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/1137931581 >> v2:172.21.15.204:3300/0 conn(0x7fcba40ce920 0x7fcba4071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/1137931581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba415e450 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 -- 172.21.15.19:0/1137931581 >> 172.21.15.19:0/1137931581 conn(0x7fcba406c0c0 msgr2=0x7fcba406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 -- 172.21.15.19:0/1137931581 shutdown_connections 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.002+0000 7fcba9d5c640 1 -- 172.21.15.19:0/1137931581 wait complete. 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.003+0000 7fcba9d5c640 1 Processor -- start 2024-03-04T08:51:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.003+0000 7fcba9d5c640 1 -- start start 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 0x7fcba4145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ce380 con 0x7fcba406b220 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ce200 con 0x7fcba40ce920 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba9d5c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba406b600 con 0x7fcba4071ec0 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40982/0 (socket says 172.21.15.19:40982) 2024-03-04T08:51:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 -- 172.21.15.19:0/781204351 learned_addr learned my addr 172.21.15.19:0/781204351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba3fff640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 0x7fcba4145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba2ffd640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 -- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 msgr2=0x7fcba4157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 -- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 msgr2=0x7fcba4145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 0x7fcba4145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 -- 172.21.15.19:0/781204351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4158560 con 0x7fcba406b220 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba3fff640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 0x7fcba4145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.004+0000 7fcba37fe640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402b8c0 tx=0x7fcb940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.005+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94032880 con 0x7fcba406b220 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.005+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94032a20 con 0x7fcba406b220 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.005+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba4158840 con 0x7fcba406b220 2024-03-04T08:51:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.005+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94032e10 con 0x7fcba406b220 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.005+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba4158e00 con 0x7fcba406b220 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.006+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba404f330 con 0x7fcba406b220 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.006+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb9404c060 con 0x7fcba406b220 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.006+0000 7fcb8bfff640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 0x7fcb9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.007+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb940abd70 con 0x7fcba406b220 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.007+0000 7fcba2ffd640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 0x7fcb9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.007+0000 7fcba2ffd640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 0x7fcb9006d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcba40cd3c0 tx=0x7fcb98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.011+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcb94040070 con 0x7fcba406b220 2024-03-04T08:51:38.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.194+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba40cf9f0 con 0x7fcba406b220 2024-03-04T08:51:38.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.195+0000 7fcb8bfff640 1 -- 172.21.15.19:0/781204351 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16670 (secure 0 0 0) 0x7fcb9407ac80 con 0x7fcba406b220 2024-03-04T08:51:38.192 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:38.192 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:37.211437+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 msgr2=0x7fcb9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 0x7fcb9006d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcba40cd3c0 tx=0x7fcb98008040 comp rx=0 tx=0).stop 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 msgr2=0x7fcba41579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402b8c0 tx=0x7fcb940046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 shutdown_connections 2024-03-04T08:51:38.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcb9006b4d0 0x7fcb9006d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcba40ce920 0x7fcba4145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcba4071ec0 0x7fcba4157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 --2- 172.21.15.19:0/781204351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcba406b220 0x7fcba41579f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 >> 172.21.15.19:0/781204351 conn(0x7fcba406c0c0 msgr2=0x7fcba4162000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 shutdown_connections 2024-03-04T08:51:38.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.197+0000 7fcba9d5c640 1 -- 172.21.15.19:0/781204351 wait complete. 2024-03-04T08:51:38.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:38.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 Processor -- start 2024-03-04T08:51:38.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 -- start start 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 0x7f2fa80d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fa80ce1b0 0x7f2fa80ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa806ca90 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80d09e0 con 0x7f2fa80d00c0 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.310+0000 7f2facc0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa815e380 con 0x7f2fa80cf850 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fa80ce1b0 0x7f2fa80ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2fa80ce1b0 0x7f2fa80ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40990/0 (socket says 172.21.15.19:40990) 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 -- 172.21.15.19:0/2054482227 learned_addr learned my addr 172.21.15.19:0/2054482227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa659c640 1 --2- 172.21.15.19:0/2054482227 >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 0x7f2fa80d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 -- 172.21.15.19:0/2054482227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 msgr2=0x7f2fa80cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 -- 172.21.15.19:0/2054482227 >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 msgr2=0x7f2fa80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 --2- 172.21.15.19:0/2054482227 >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 0x7f2fa80d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa6d9d640 1 -- 172.21.15.19:0/2054482227 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80cdc10 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2fa659c640 1 --2- 172.21.15.19:0/2054482227 >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 0x7f2fa80d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.311+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2fa6d9d640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa80ce640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80d1a40 tx=0x7f2fa002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743abf4a28dfe8db server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2fa5d9b640 1 -- 172.21.15.19:0/2054482227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa002ca70 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2fa5d9b640 1 -- 172.21.15.19:0/2054482227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa002cc10 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2fa5d9b640 1 -- 172.21.15.19:0/2054482227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00343f0 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 -- 172.21.15.19:0/2054482227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 msgr2=0x7f2fa80ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa80ce640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80d1a40 tx=0x7f2fa002bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 -- 172.21.15.19:0/2054482227 shutdown_connections 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa80ce640 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 --2- 172.21.15.19:0/2054482227 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 --2- 172.21.15.19:0/2054482227 >> v2:172.21.15.204:3300/0 conn(0x7f2fa80d00c0 0x7f2fa80d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 -- 172.21.15.19:0/2054482227 >> 172.21.15.19:0/2054482227 conn(0x7f2fa80b35a0 msgr2=0x7f2fa80b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 -- 172.21.15.19:0/2054482227 shutdown_connections 2024-03-04T08:51:38.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.312+0000 7f2facc0e640 1 -- 172.21.15.19:0/2054482227 wait complete. 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 Processor -- start 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 -- start start 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fa80d00c0 0x7f2fa8154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa806c720 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa806c440 con 0x7f2fa80d00c0 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.314+0000 7f2facc0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80cd900 con 0x7f2fa80cf850 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40996/0 (socket says 172.21.15.19:40996) 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 -- 172.21.15.19:0/3312863895 learned_addr learned my addr 172.21.15.19:0/3312863895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa6d9d640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fa80d00c0 0x7f2fa8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 -- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 msgr2=0x7f2fa80b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 -- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fa80d00c0 msgr2=0x7f2fa8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fa80d00c0 0x7f2fa8154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 -- 172.21.15.19:0/3312863895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80c6aa0 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2fa659c640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7f0 tx=0x7f2f9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98015070 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98007820 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa80c6d80 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007bd0 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.315+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa80c7340 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.316+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa804f330 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.317+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f98018070 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.317+0000 7f2f9effd640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 0x7f2f8806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.317+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f9808a2b0 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.317+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 0x7f2f8806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.318+0000 7f2f9ffff640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 0x7f2f8806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006fd0 tx=0x7f2f90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.321+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2f98059130 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.502+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fa80cbf30 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.503+0000 7f2f9effd640 1 -- 172.21.15.19:0/3312863895 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16670 (secure 0 0 0) 0x7f2f98058a30 con 0x7f2fa80ce1b0 2024-03-04T08:51:38.499 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:38.500 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:37.211437+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 msgr2=0x7f2f8806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 0x7f2f8806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006fd0 tx=0x7f2f90008040 comp rx=0 tx=0).stop 2024-03-04T08:51:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 msgr2=0x7f2fa8153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7f0 tx=0x7f2f9800ccb0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 shutdown_connections 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f8806b500 0x7f2f8806d9c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2fa80d00c0 0x7f2fa8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2fa80cf850 0x7f2fa80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 --2- 172.21.15.19:0/3312863895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fa80ce1b0 0x7f2fa8153ea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 >> 172.21.15.19:0/3312863895 conn(0x7f2fa80b35a0 msgr2=0x7f2fa80d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 shutdown_connections 2024-03-04T08:51:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.505+0000 7f2facc0e640 1 -- 172.21.15.19:0/3312863895 wait complete. 2024-03-04T08:51:38.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T08:51:38.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.621+0000 7f173ec2a640 1 Processor -- start 2024-03-04T08:51:38.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.621+0000 7f173ec2a640 1 -- start start 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173ec2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17380cea50 0x7f17380b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173ec2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f173806cab0 0x7f17380ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173ec2a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173806d030 con 0x7f173815def0 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173ec2a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380cf1c0 con 0x7f17380cea50 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173ec2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17380cc760 con 0x7f173806cab0 2024-03-04T08:51:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17380cea50 0x7f17380b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17380cea50 0x7f17380b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41000/0 (socket says 172.21.15.19:41000) 2024-03-04T08:51:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 -- 172.21.15.19:0/3633902931 learned_addr learned my addr 172.21.15.19:0/3633902931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f173d1c7640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f173806cab0 0x7f17380ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 -- 172.21.15.19:0/3633902931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f173806cab0 msgr2=0x7f17380ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f173806cab0 0x7f17380ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 -- 172.21.15.19:0/3633902931 >> v1:172.21.15.204:6789/0 conn(0x7f173815def0 legacy=0x7f17380ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.622+0000 7f1737fff640 1 -- 172.21.15.19:0/3633902931 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173806d310 con 0x7f17380cea50 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.623+0000 7f1737fff640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17380cea50 0x7f17380b41b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f172c009870 tx=0x7f172c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552733f7acee4ba2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.623+0000 7f17377fe640 1 -- 172.21.15.19:0/3633902931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c034070 con 0x7f17380cea50 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.623+0000 7f17377fe640 1 -- 172.21.15.19:0/3633902931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c030840 con 0x7f17380cea50 2024-03-04T08:51:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.623+0000 7f17377fe640 1 -- 172.21.15.19:0/3633902931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c030c10 con 0x7f17380cea50 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 -- 172.21.15.19:0/3633902931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17380cea50 msgr2=0x7f17380b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17380cea50 0x7f17380b41b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f172c009870 tx=0x7f172c02b980 comp rx=0 tx=0).stop 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 -- 172.21.15.19:0/3633902931 shutdown_connections 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f173806cab0 0x7f17380ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 --2- 172.21.15.19:0/3633902931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17380cea50 0x7f17380b41b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 -- 172.21.15.19:0/3633902931 >> 172.21.15.19:0/3633902931 conn(0x7f17380b3690 msgr2=0x7f17380b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 -- 172.21.15.19:0/3633902931 shutdown_connections 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.624+0000 7f173ec2a640 1 -- 172.21.15.19:0/3633902931 wait complete. 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.625+0000 7f173ec2a640 1 Processor -- start 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.625+0000 7f173ec2a640 1 -- start start 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 0x7f17380c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 0x7f17381e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173815e2d0 con 0x7f173815def0 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380cc3f0 con 0x7f173806cab0 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173ec2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173815e450 con 0x7f17380cea50 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41012/0 (socket says 172.21.15.19:41012) 2024-03-04T08:51:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 -- 172.21.15.19:0/2011047002 learned_addr learned my addr 172.21.15.19:0/2011047002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173c9c6640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 0x7f17380c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 -- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 msgr2=0x7f17381e7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f1737fff640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 0x7f17381e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 0x7f17381e7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 -- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 msgr2=0x7f17380c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 0x7f17380c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 -- 172.21.15.19:0/2011047002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380c8320 con 0x7f173815def0 2024-03-04T08:51:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173c9c6640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 0x7f17380c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f1737fff640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 0x7f17381e7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.626+0000 7f173d1c7640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f172800c820 tx=0x7f172800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.627+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728015070 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.627+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728004020 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.627+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17380c71d0 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.627+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728004410 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.627+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17380c7790 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.628+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173809fcf0 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.628+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1728007830 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.628+0000 7f17357fa640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 0x7f172406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.629+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f172808a040 con 0x7f173815def0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.629+0000 7f173c9c6640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 0x7f172406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.629+0000 7f173c9c6640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 0x7f172406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1730007e90 tx=0x7f17300073a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.633+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1728058ed0 con 0x7f173815def0 2024-03-04T08:51:38.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.849+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1738068ff0 con 0x7f173815def0 2024-03-04T08:51:38.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.863+0000 7f17357fa640 1 -- 172.21.15.19:0/2011047002 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f17280587d0 con 0x7f173815def0 2024-03-04T08:51:38.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 msgr2=0x7f172406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 0x7f172406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1730007e90 tx=0x7f17300073a0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 msgr2=0x7f173815cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f172800c820 tx=0x7f172800cce0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 shutdown_connections 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173815def0 0x7f173815cb60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f17380cea50 0x7f17381e7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f172406b4d0 0x7f172406d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 --2- 172.21.15.19:0/2011047002 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f173806cab0 0x7f17380c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 >> 172.21.15.19:0/2011047002 conn(0x7f17380b3690 msgr2=0x7f17380b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 shutdown_connections 2024-03-04T08:51:38.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.866+0000 7f173ec2a640 1 -- 172.21.15.19:0/2011047002 wait complete. 2024-03-04T08:51:38.874 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-04T08:51:38.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-04T08:51:38.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.990+0000 7f3837316640 1 Processor -- start 2024-03-04T08:51:38.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.990+0000 7f3837316640 1 -- start start 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3837316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38301455d0 0x7f3830072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3837316640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f383006afb0 0x7f383006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3837316640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38301459b0 con 0x7f383006ded0 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3837316640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300cfdf0 con 0x7f383006afb0 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3837316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383006b930 con 0x7f38301455d0 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f383006afb0 0x7f383006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38358b3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f383006ded0 0x7f383006e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41476/0 (socket says 172.21.15.19:41476) 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38358b3640 1 -- 172.21.15.19:0/3000840605 learned_addr learned my addr 172.21.15.19:0/3000840605 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f383006afb0 0x7f383006b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41020/0 (socket says 172.21.15.19:41020) 2024-03-04T08:51:38.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38350b2640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38301455d0 0x7f3830072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 -- 172.21.15.19:0/3000840605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38301455d0 msgr2=0x7f3830072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38301455d0 0x7f3830072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 -- 172.21.15.19:0/3000840605 >> v1:172.21.15.19:6789/0 conn(0x7f383006ded0 legacy=0x7f383006e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f38348b1640 1 -- 172.21.15.19:0/3000840605 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300cf1e0 con 0x7f383006afb0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.991+0000 7f3827fff640 1 -- 172.21.15.19:0/3000840605 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082418921 0 0) 0x7f38301459b0 con 0x7f383006ded0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.992+0000 7f38348b1640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006afb0 0x7f383006b3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f38200097a0 tx=0x7f382002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6369675aac5cdde0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.992+0000 7f3827fff640 1 -- 172.21.15.19:0/3000840605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820035020 con 0x7f383006afb0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.992+0000 7f3827fff640 1 -- 172.21.15.19:0/3000840605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820031830 con 0x7f383006afb0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3827fff640 1 -- 172.21.15.19:0/3000840605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820031c00 con 0x7f383006afb0 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 -- 172.21.15.19:0/3000840605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006afb0 msgr2=0x7f383006b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006afb0 0x7f383006b3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f38200097a0 tx=0x7f382002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 -- 172.21.15.19:0/3000840605 shutdown_connections 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006afb0 0x7f383006b3f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 --2- 172.21.15.19:0/3000840605 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38301455d0 0x7f3830072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 -- 172.21.15.19:0/3000840605 >> 172.21.15.19:0/3000840605 conn(0x7f38300b2660 msgr2=0x7f38300b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:38.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 -- 172.21.15.19:0/3000840605 shutdown_connections 2024-03-04T08:51:38.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.993+0000 7f3837316640 1 -- 172.21.15.19:0/3000840605 wait complete. 2024-03-04T08:51:38.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.994+0000 7f3837316640 1 Processor -- start 2024-03-04T08:51:38.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.994+0000 7f3837316640 1 -- start start 2024-03-04T08:51:38.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 0x7f38300ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38301455d0 0x7f383015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300cfa80 con 0x7f383006ded0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300cf7a0 con 0x7f38301455d0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f3837316640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300729c0 con 0x7f383006afb0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41022/0 (socket says 172.21.15.19:41022) 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 -- 172.21.15.19:0/2187289335 learned_addr learned my addr 172.21.15.19:0/2187289335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38350b2640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 0x7f38300ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38358b3640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38301455d0 0x7f383015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 -- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 msgr2=0x7f38300ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 0x7f38300ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 -- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38301455d0 msgr2=0x7f383015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38301455d0 0x7f383015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38348b1640 1 -- 172.21.15.19:0/2187289335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383015b770 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.995+0000 7f38350b2640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 0x7f38300ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f38348b1640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3820034040 tx=0x7f38200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820035040 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820004230 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38300aba60 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382003a700 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.996+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38300ac020 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.997+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3830073390 con 0x7f383006ded0 2024-03-04T08:51:38.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.998+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3820038020 con 0x7f383006ded0 2024-03-04T08:51:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.998+0000 7f3825ffb640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 0x7f381406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.998+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38200ac0d0 con 0x7f383006ded0 2024-03-04T08:51:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.998+0000 7f38350b2640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 0x7f381406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:38.999+0000 7f38350b2640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 0x7f381406d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.002+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f382007ae20 con 0x7f383006ded0 2024-03-04T08:51:39.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.221+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3830068230 con 0x7f383006ded0 2024-03-04T08:51:39.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.864+0000 7f3825ffb640 1 -- 172.21.15.19:0/2187289335 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f382007a720 con 0x7f383006ded0 2024-03-04T08:51:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 msgr2=0x7f381406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 0x7f381406d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).stop 2024-03-04T08:51:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 msgr2=0x7f38300afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3820034040 tx=0x7f38200046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 shutdown_connections 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f381406b500 0x7f381406d9c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38301455d0 0x7f383015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f383006ded0 0x7f38300afe90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 --2- 172.21.15.19:0/2187289335 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f383006afb0 0x7f38300ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 >> 172.21.15.19:0/2187289335 conn(0x7f38300b2660 msgr2=0x7f383015c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 shutdown_connections 2024-03-04T08:51:39.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.867+0000 7f3837316640 1 -- 172.21.15.19:0/2187289335 wait complete. 2024-03-04T08:51:39.874 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-04T08:51:39.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:39.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.979+0000 7f5860a4e640 1 Processor -- start 2024-03-04T08:51:39.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.979+0000 7f5860a4e640 1 -- start start 2024-03-04T08:51:39.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5860a4e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f585c15dfe0 0x7f585c0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:39.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5860a4e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0b3430 con 0x7f585c0cf830 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5860a4e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0b3710 con 0x7f585c0d29c0 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5860a4e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0b31e0 con 0x7f585c15dfe0 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f585a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f585c15dfe0 0x7f585c0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5853fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f585c0cf830 0x7f585c0d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41482/0 (socket says 172.21.15.19:41482) 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5853fff640 1 -- 172.21.15.19:0/1027961066 learned_addr learned my addr 172.21.15.19:0/1027961066 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f585a59c640 1 -- 172.21.15.19:0/1027961066 >> v1:172.21.15.204:6789/0 conn(0x7f585c0d29c0 legacy=0x7f585c0b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f585a59c640 1 -- 172.21.15.19:0/1027961066 >> v1:172.21.15.19:6789/0 conn(0x7f585c0cf830 legacy=0x7f585c0d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f585a59c640 1 -- 172.21.15.19:0/1027961066 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0b39f0 con 0x7f585c15dfe0 2024-03-04T08:51:39.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.980+0000 7f5859d9b640 1 -- 172.21.15.19:0/1027961066 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295138285 0 0) 0x7f585c0b3430 con 0x7f585c0cf830 2024-03-04T08:51:39.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.981+0000 7f585a59c640 1 --2- 172.21.15.19:0/1027961066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c15dfe0 0x7f585c0cf2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b3360 tx=0x7f584c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6bd29e2ff30e9b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:39.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.981+0000 7f5859d9b640 1 -- 172.21.15.19:0/1027961066 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c035020 con 0x7f585c15dfe0 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.981+0000 7f5859d9b640 1 -- 172.21.15.19:0/1027961066 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c031830 con 0x7f585c15dfe0 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.981+0000 7f5859d9b640 1 -- 172.21.15.19:0/1027961066 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c031c00 con 0x7f585c15dfe0 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 -- 172.21.15.19:0/1027961066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c15dfe0 msgr2=0x7f585c0cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1027961066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c15dfe0 0x7f585c0cf2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b3360 tx=0x7f584c02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 -- 172.21.15.19:0/1027961066 shutdown_connections 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1027961066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c15dfe0 0x7f585c0cf2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 -- 172.21.15.19:0/1027961066 >> 172.21.15.19:0/1027961066 conn(0x7f585c0d3cd0 msgr2=0x7f585c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 -- 172.21.15.19:0/1027961066 shutdown_connections 2024-03-04T08:51:39.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.982+0000 7f5860a4e640 1 -- 172.21.15.19:0/1027961066 wait complete. 2024-03-04T08:51:39.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.983+0000 7f5860a4e640 1 Processor -- start 2024-03-04T08:51:39.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.983+0000 7f5860a4e640 1 -- start start 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f585c0cf830 0x7f585c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 0x7f585c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15e3c0 con 0x7f585c0d29c0 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b3d60 con 0x7f585c0cf830 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.984+0000 7f5860a4e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c15e540 con 0x7f585c15dfe0 2024-03-04T08:51:39.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41040/0 (socket says 172.21.15.19:41040) 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 -- 172.21.15.19:0/1933605679 learned_addr learned my addr 172.21.15.19:0/1933605679 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f585a59c640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f585c0cf830 0x7f585c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f585ad9d640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 0x7f585c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 -- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 msgr2=0x7f585c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 0x7f585c0cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 -- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f585c0cf830 msgr2=0x7f585c15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f585c0cf830 0x7f585c15c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 -- 172.21.15.19:0/1933605679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0cbaf0 con 0x7f585c0d29c0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f585ad9d640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 0x7f585c0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5853fff640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f584400c4b0 tx=0x7f584400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844018070 con 0x7f585c0d29c0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5844007500 con 0x7f585c0d29c0 2024-03-04T08:51:39.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c0b79c0 con 0x7f585c0d29c0 2024-03-04T08:51:39.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844004a20 con 0x7f585c0d29c0 2024-03-04T08:51:39.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.985+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c0cbdd0 con 0x7f585c0d29c0 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.986+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c04f330 con 0x7f585c0d29c0 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.987+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f584401b070 con 0x7f585c0d29c0 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.987+0000 7f5852ffd640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 0x7f583c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.987+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5844089500 con 0x7f585c0d29c0 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.988+0000 7f585a59c640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 0x7f583c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:39.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.988+0000 7f585a59c640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 0x7f583c06d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f584c036000 tx=0x7f584c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:39.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:39.992+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5844058440 con 0x7f585c0d29c0 2024-03-04T08:51:40.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.250+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f585c0d4a80 con 0x7f585c0d29c0 2024-03-04T08:51:40.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.250+0000 7f5852ffd640 1 -- 172.21.15.19:0/1933605679 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4979 (secure 0 0 0) 0x7f5844057d40 con 0x7f585c0d29c0 2024-03-04T08:51:40.247 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:40.247 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:39.223178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:51:40.247 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 msgr2=0x7f583c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 0x7f583c06d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f584c036000 tx=0x7f584c03c040 comp rx=0 tx=0).stop 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 msgr2=0x7f585c15b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f584400c4b0 tx=0x7f584400c970 comp rx=0 tx=0).stop 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 shutdown_connections 2024-03-04T08:51:40.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f585c15dfe0 0x7f585c0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c0d29c0 0x7f585c15b350 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f583c06b500 0x7f583c06d9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 --2- 172.21.15.19:0/1933605679 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f585c0cf830 0x7f585c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 >> 172.21.15.19:0/1933605679 conn(0x7f585c0d3cd0 msgr2=0x7f585c06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 shutdown_connections 2024-03-04T08:51:40.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.252+0000 7f5860a4e640 1 -- 172.21.15.19:0/1933605679 wait complete. 2024-03-04T08:51:40.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.364+0000 7f99371f7640 1 Processor -- start 2024-03-04T08:51:40.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.364+0000 7f99371f7640 1 -- start start 2024-03-04T08:51:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f99371f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f99300d22b0 0x7f99300d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f99371f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99300b3430 con 0x7f993015dfe0 2024-03-04T08:51:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f99371f7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99300b3710 con 0x7f99300b41f0 2024-03-04T08:51:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f99371f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99300d2c50 con 0x7f99300d22b0 2024-03-04T08:51:40.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f9934f93640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f993015dfe0 0x7f99300cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41492/0 (socket says 172.21.15.19:41492) 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.365+0000 7f9934f93640 1 -- 172.21.15.19:0/599187244 learned_addr learned my addr 172.21.15.19:0/599187244 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 --2- 172.21.15.19:0/599187244 >> v2:172.21.15.204:3300/0 conn(0x7f99300d22b0 0x7f99300d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256768541 0 0) 0x7f99300b3430 con 0x7f993015dfe0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9920003520 con 0x7f993015dfe0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317761252 0 0) 0x7f9920003520 con 0x7f993015dfe0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 >> v2:172.21.15.204:3300/0 conn(0x7f99300d22b0 msgr2=0x7f99300d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 --2- 172.21.15.19:0/599187244 >> v2:172.21.15.204:3300/0 conn(0x7f99300d22b0 0x7f99300d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 >> v1:172.21.15.204:6789/0 conn(0x7f99300b41f0 legacy=0x7f99300b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300b39f0 con 0x7f993015dfe0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f9924001670 con 0x7f993015dfe0 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 >> v1:172.21.15.19:6789/0 conn(0x7f993015dfe0 legacy=0x7f99300cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99200039b0 0x7f9920003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 0x7f9920004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99200051c0 0x7f992000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992000c030 con 0x7f9920004800 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992000c1e0 con 0x7f99200039b0 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992000c3e0 con 0x7f99200051c0 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 0x7f9920004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f9934f93640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99200039b0 0x7f9920003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f9935794640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99200051c0 0x7f992000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 -- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99200051c0 msgr2=0x7f992000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99200051c0 0x7f992000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 -- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99200039b0 msgr2=0x7f9920003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99200039b0 0x7f9920003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f992ffff640 1 -- 172.21.15.19:0/599187244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920003520 con 0x7f9920004800 2024-03-04T08:51:40.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.366+0000 7f9935794640 1 -- 172.21.15.19:0/599187244 reap_dead start 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.367+0000 7f992ffff640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 0x7f9920004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f991c009ac0 tx=0x7f9920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db1d62c760204a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.367+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c039070 con 0x7f9920004800 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.367+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c02c6b0 con 0x7f9920004800 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.367+0000 7f992f7fe640 1 -- 172.21.15.19:0/599187244 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c009690 con 0x7f9920004800 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 -- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 msgr2=0x7f9920004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 0x7f9920004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f991c009ac0 tx=0x7f9920005830 comp rx=0 tx=0).stop 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 -- 172.21.15.19:0/599187244 shutdown_connections 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 --2- 172.21.15.19:0/599187244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920004800 0x7f9920004c80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 -- 172.21.15.19:0/599187244 >> 172.21.15.19:0/599187244 conn(0x7f99300d3cd0 msgr2=0x7f99300d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 -- 172.21.15.19:0/599187244 shutdown_connections 2024-03-04T08:51:40.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.368+0000 7f99371f7640 1 -- 172.21.15.19:0/599187244 wait complete. 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.369+0000 7f99371f7640 1 Processor -- start 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.369+0000 7f99371f7640 1 -- start start 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9920004800 0x7f99301f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f993015f300 0x7f99300b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300b3d60 con 0x7f9930159d80 2024-03-04T08:51:40.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300b31e0 con 0x7f9920004800 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f99371f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993015e3c0 con 0x7f993015f300 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41060/0 (socket says 172.21.15.19:41060) 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 -- 172.21.15.19:0/2151178974 learned_addr learned my addr 172.21.15.19:0/2151178974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f992ffff640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f993015f300 0x7f99300b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9934f93640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9920004800 0x7f99301f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 -- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f993015f300 msgr2=0x7f99300b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f993015f300 0x7f99300b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 -- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9920004800 msgr2=0x7f99301f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9920004800 0x7f99301f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.370+0000 7f9935794640 1 -- 172.21.15.19:0/2151178974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993015f880 con 0x7f9930159d80 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f9935794640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f992800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928003970 con 0x7f9930159d80 2024-03-04T08:51:40.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9928018070 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993015fb60 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928003d70 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.371+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9930160120 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.372+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99300ce3c0 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.372+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99280050d0 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.373+0000 7f992d7fa640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.373+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9928089dd0 con 0x7f9930159d80 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.373+0000 7f9934f93640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.373+0000 7f9934f93640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 0x7f991406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9924001050 tx=0x7f9924009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.377+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f99300ce3c0 con 0x7f9930159d80 2024-03-04T08:51:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.558+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99300670d0 con 0x7f9930159d80 2024-03-04T08:51:40.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.560+0000 7f992d7fa640 1 -- 172.21.15.19:0/2151178974 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f992808b090 con 0x7f9930159d80 2024-03-04T08:51:40.556 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:40.556 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:38.859550+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 msgr2=0x7f991406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 0x7f991406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9924001050 tx=0x7f9924009040 comp rx=0 tx=0).stop 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 msgr2=0x7f99300b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f992800eb90 comp rx=0 tx=0).stop 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 shutdown_connections 2024-03-04T08:51:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9930159d80 0x7f99300b8d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f993015f300 0x7f99300b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 --2- 172.21.15.19:0/2151178974 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9920004800 0x7f99301f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 >> 172.21.15.19:0/2151178974 conn(0x7f99300d3cd0 msgr2=0x7f99300cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 shutdown_connections 2024-03-04T08:51:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.562+0000 7f99371f7640 1 -- 172.21.15.19:0/2151178974 wait complete. 2024-03-04T08:51:40.573 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T08:51:40.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:51:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.678+0000 7f6c81040640 1 Processor -- start 2024-03-04T08:51:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.678+0000 7f6c81040640 1 -- start start 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 0x7f6c7c0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c7c0d4760 0x7f6c7c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0d4bf0 con 0x7f6c7c0d4760 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0ce9e0 con 0x7f6c7c0b4170 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c81040640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0d25d0 con 0x7f6c7c0b4dd0 2024-03-04T08:51:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c73fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c7c0d4760 0x7f6c7c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c73fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c7c0d4760 0x7f6c7c0d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41074/0 (socket says 172.21.15.19:41074) 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c73fff640 1 -- 172.21.15.19:0/2529814930 learned_addr learned my addr 172.21.15.19:0/2529814930 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.679+0000 7f6c7ad9d640 1 --2- 172.21.15.19:0/2529814930 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 0x7f6c7c0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c7b59e640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 -- 172.21.15.19:0/2529814930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 msgr2=0x7f6c7c0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 -- 172.21.15.19:0/2529814930 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 msgr2=0x7f6c7c0b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 --2- 172.21.15.19:0/2529814930 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 0x7f6c7c0b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 -- 172.21.15.19:0/2529814930 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0d2870 con 0x7f6c7c0d4760 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c7b59e640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c7ad9d640 1 --2- 172.21.15.19:0/2529814930 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 0x7f6c7c0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.680+0000 7f6c73fff640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0d4760 0x7f6c7c0d0370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06e030 tx=0x7f6c6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b34593b46cbabab server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c7a59c640 1 -- 172.21.15.19:0/2529814930 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64035020 con 0x7f6c7c0d4760 2024-03-04T08:51:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c7a59c640 1 -- 172.21.15.19:0/2529814930 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64031870 con 0x7f6c7c0d4760 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c7a59c640 1 -- 172.21.15.19:0/2529814930 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64031c40 con 0x7f6c7c0d4760 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 -- 172.21.15.19:0/2529814930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0d4760 msgr2=0x7f6c7c0d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0d4760 0x7f6c7c0d0370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06e030 tx=0x7f6c6402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 -- 172.21.15.19:0/2529814930 shutdown_connections 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 --2- 172.21.15.19:0/2529814930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0d4760 0x7f6c7c0d0370 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 --2- 172.21.15.19:0/2529814930 >> v2:172.21.15.204:3300/0 conn(0x7f6c7c0b4170 0x7f6c7c0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 -- 172.21.15.19:0/2529814930 >> 172.21.15.19:0/2529814930 conn(0x7f6c7c0d3c40 msgr2=0x7f6c7c0d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 -- 172.21.15.19:0/2529814930 shutdown_connections 2024-03-04T08:51:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.681+0000 7f6c81040640 1 -- 172.21.15.19:0/2529814930 wait complete. 2024-03-04T08:51:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.682+0000 7f6c81040640 1 Processor -- start 2024-03-04T08:51:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.682+0000 7f6c81040640 1 -- start start 2024-03-04T08:51:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4170 0x7f6c7c1f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b47d0 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b4550 con 0x7f6c7c0b4dd0 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c81040640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b4950 con 0x7f6c7c0b4170 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c7b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c7b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41078/0 (socket says 172.21.15.19:41078) 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c7b59e640 1 -- 172.21.15.19:0/2168184248 learned_addr learned my addr 172.21.15.19:0/2168184248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:40.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c73fff640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.683+0000 7f6c7ad9d640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4170 0x7f6c7c1f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 -- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4170 msgr2=0x7f6c7c1f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4170 0x7f6c7c1f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 -- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c0b4dd0 msgr2=0x7f6c7c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 -- 172.21.15.19:0/2168184248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0ca110 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c7b59e640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400cef0 tx=0x7f6c7400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7401a070 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400d860 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0ca3f0 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400dc50 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.684+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c0c7820 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.685+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c04f330 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.686+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c7401d070 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.686+0000 7f6c737fe640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 0x7f6c5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:40.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.686+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c7408a990 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.686+0000 7f6c7ad9d640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 0x7f6c5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:40.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.687+0000 7f6c7ad9d640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 0x7f6c5c06d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c006fd0 tx=0x7f6c6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:40.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.694+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6c74059310 con 0x7f6c7c0cf2b0 2024-03-04T08:51:40.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.988+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c7c0733b0 con 0x7f6c5c06b4d0 2024-03-04T08:51:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.994+0000 7f6c737fe640 1 -- 172.21.15.19:0/2168184248 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243585 (secure 0 0 0) 0x7f6c7c0733b0 con 0x7f6c5c06b4d0 2024-03-04T08:51:40.994 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:51:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 msgr2=0x7f6c5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 0x7f6c5c06d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c006fd0 tx=0x7f6c6c008040 comp rx=0 tx=0).stop 2024-03-04T08:51:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 msgr2=0x7f6c7c0c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400cef0 tx=0x7f6c7400a710 comp rx=0 tx=0).stop 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 shutdown_connections 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c0cf2b0 0x7f6c7c0c93a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c5c06b4d0 0x7f6c5c06d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c7c0b4dd0 0x7f6c7c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 --2- 172.21.15.19:0/2168184248 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c7c0b4170 0x7f6c7c1f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 >> 172.21.15.19:0/2168184248 conn(0x7f6c7c0d3c40 msgr2=0x7f6c7c0b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 shutdown_connections 2024-03-04T08:51:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:40.998+0000 7f6c81040640 1 -- 172.21.15.19:0/2168184248 wait complete. 2024-03-04T08:51:41.005 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-03-04T08:51:39.150442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":220044,"kb_used_data":3852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754676,"statfs":{"total":773094113280,"available":772868788224,"internally_reserved":0,"allocated":3944448,"data_stored":2236157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000808"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851882+0000","last_change":"2024-03-04T08:51:36.851882+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851882+0000","last_undegraded":"2024-03-04T08:51:36.851882+0000","last_fullsized":"2024-03-04T08:51:36.851882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.855551+0000","last_change":"2024-03-04T08:51:36.855551+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.855551+0000","last_undegraded":"2024-03-04T08:51:36.855551+0000","last_fullsized":"2024-03-04T08:51:36.855551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856522+0000","last_change":"2024-03-04T08:51:36.856522+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856522+0000","last_undegraded":"2024-03-04T08:51:36.856522+0000","last_fullsized":"2024-03-04T08:51:36.856522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849733+0000","last_change":"2024-03-04T08:51:36.849733+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849733+0000","last_undegraded":"2024-03-04T08:51:36.849733+0000","last_fullsized":"2024-03-04T08:51:36.849733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853415+0000","last_change":"2024-03-04T08:51:36.853415+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853415+0000","last_undegraded":"2024-03-04T08:51:36.853415+0000","last_fullsized":"2024-03-04T08:51:36.853415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851133+0000","last_change":"2024-03-04T08:51:36.851133+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851133+0000","last_undegraded":"2024-03-04T08:51:36.851133+0000","last_fullsized":"2024-03-04T08:51:36.851133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854292+0000","last_change":"2024-03-04T08:51:36.854292+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854292+0000","last_undegraded":"2024-03-04T08:51:36.854292+0000","last_fullsized":"2024-03-04T08:51:36.854292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852280+0000","last_change":"2024-03-04T08:51:36.852280+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852280+0000","last_undegraded":"2024-03-04T08:51:36.852280+0000","last_fullsized":"2024-03-04T08:51:36.852280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852023+0000","last_change":"2024-03-04T08:51:36.852023+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852023+0000","last_undegraded":"2024-03-04T08:51:36.852023+0000","last_fullsized":"2024-03-04T08:51:36.852023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849264+0000","last_change":"2024-03-04T08:51:36.849264+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849264+0000","last_undegraded":"2024-03-04T08:51:36.849264+0000","last_fullsized":"2024-03-04T08:51:36.849264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852951+0000","last_change":"2024-03-04T08:51:36.852951+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852951+0000","last_undegraded":"2024-03-04T08:51:36.852951+0000","last_fullsized":"2024-03-04T08:51:36.852951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851474+0000","last_change":"2024-03-04T08:51:36.851474+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851474+0000","last_undegraded":"2024-03-04T08:51:36.851474+0000","last_fullsized":"2024-03-04T08:51:36.851474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852676+0000","last_change":"2024-03-04T08:51:36.852676+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852676+0000","last_undegraded":"2024-03-04T08:51:36.852676+0000","last_fullsized":"2024-03-04T08:51:36.852676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854691+0000","last_change":"2024-03-04T08:51:36.854691+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854691+0000","last_undegraded":"2024-03-04T08:51:36.854691+0000","last_fullsized":"2024-03-04T08:51:36.854691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853301+0000","last_change":"2024-03-04T08:51:36.853301+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853301+0000","last_undegraded":"2024-03-04T08:51:36.853301+0000","last_fullsized":"2024-03-04T08:51:36.853301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854968+0000","last_change":"2024-03-04T08:51:36.854968+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854968+0000","last_undegraded":"2024-03-04T08:51:36.854968+0000","last_fullsized":"2024-03-04T08:51:36.854968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848904+0000","last_change":"2024-03-04T08:51:36.848904+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848904+0000","last_undegraded":"2024-03-04T08:51:36.848904+0000","last_fullsized":"2024-03-04T08:51:36.848904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850730+0000","last_change":"2024-03-04T08:51:36.850730+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850730+0000","last_undegraded":"2024-03-04T08:51:36.850730+0000","last_fullsized":"2024-03-04T08:51:36.850730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853677+0000","last_change":"2024-03-04T08:51:36.853677+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853677+0000","last_undegraded":"2024-03-04T08:51:36.853677+0000","last_fullsized":"2024-03-04T08:51:36.853677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849302+0000","last_change":"2024-03-04T08:51:36.849302+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849302+0000","last_undegraded":"2024-03-04T08:51:36.849302+0000","last_fullsized":"2024-03-04T08:51:36.849302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851600+0000","last_change":"2024-03-04T08:51:36.851600+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851600+0000","last_undegraded":"2024-03-04T08:51:36.851600+0000","last_fullsized":"2024-03-04T08:51:36.851600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853205+0000","last_change":"2024-03-04T08:51:36.853205+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853205+0000","last_undegraded":"2024-03-04T08:51:36.853205+0000","last_fullsized":"2024-03-04T08:51:36.853205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851067+0000","last_change":"2024-03-04T08:51:36.851067+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851067+0000","last_undegraded":"2024-03-04T08:51:36.851067+0000","last_fullsized":"2024-03-04T08:51:36.851067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853910+0000","last_change":"2024-03-04T08:51:36.853910+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853910+0000","last_undegraded":"2024-03-04T08:51:36.853910+0000","last_fullsized":"2024-03-04T08:51:36.853910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851966+0000","last_change":"2024-03-04T08:51:36.851966+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851966+0000","last_undegraded":"2024-03-04T08:51:36.851966+0000","last_fullsized":"2024-03-04T08:51:36.851966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862822+0000","last_change":"2024-03-04T08:51:36.861353+0000","last_active":"2024-03-04T08:51:36.862822+0000","last_peered":"2024-03-04T08:51:36.862822+0000","last_clean":"2024-03-04T08:51:36.862822+0000","last_became_active":"2024-03-04T08:51:36.861087+0000","last_became_peered":"2024-03-04T08:51:36.861087+0000","last_unstale":"2024-03-04T08:51:36.862822+0000","last_undegraded":"2024-03-04T08:51:36.862822+0000","last_fullsized":"2024-03-04T08:51:36.862822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851451+0000","last_change":"2024-03-04T08:51:36.851451+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851451+0000","last_undegraded":"2024-03-04T08:51:36.851451+0000","last_fullsized":"2024-03-04T08:51:36.851451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865235+0000","last_change":"2024-03-04T08:51:36.862187+0000","last_active":"2024-03-04T08:51:36.865235+0000","last_peered":"2024-03-04T08:51:36.865235+0000","last_clean":"2024-03-04T08:51:36.865235+0000","last_became_active":"2024-03-04T08:51:36.861833+0000","last_became_peered":"2024-03-04T08:51:36.861833+0000","last_unstale":"2024-03-04T08:51:36.865235+0000","last_undegraded":"2024-03-04T08:51:36.865235+0000","last_fullsized":"2024-03-04T08:51:36.865235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871917+0000","last_change":"2024-03-04T08:51:36.867819+0000","last_active":"2024-03-04T08:51:36.871917+0000","last_peered":"2024-03-04T08:51:36.871917+0000","last_clean":"2024-03-04T08:51:36.871917+0000","last_became_active":"2024-03-04T08:51:36.867496+0000","last_became_peered":"2024-03-04T08:51:36.867496+0000","last_unstale":"2024-03-04T08:51:36.871917+0000","last_undegraded":"2024-03-04T08:51:36.871917+0000","last_fullsized":"2024-03-04T08:51:36.871917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:09.770388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869520+0000","last_change":"2024-03-04T08:51:36.865647+0000","last_active":"2024-03-04T08:51:36.869520+0000","last_peered":"2024-03-04T08:51:36.869520+0000","last_clean":"2024-03-04T08:51:36.869520+0000","last_became_active":"2024-03-04T08:51:36.865371+0000","last_became_peered":"2024-03-04T08:51:36.865371+0000","last_unstale":"2024-03-04T08:51:36.869520+0000","last_undegraded":"2024-03-04T08:51:36.869520+0000","last_fullsized":"2024-03-04T08:51:36.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.190641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851249+0000","last_change":"2024-03-04T08:51:36.851249+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851249+0000","last_undegraded":"2024-03-04T08:51:36.851249+0000","last_fullsized":"2024-03-04T08:51:36.851249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854244+0000","last_change":"2024-03-04T08:51:36.854244+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854244+0000","last_undegraded":"2024-03-04T08:51:36.854244+0000","last_fullsized":"2024-03-04T08:51:36.854244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866959+0000","last_change":"2024-03-04T08:51:36.862686+0000","last_active":"2024-03-04T08:51:36.866959+0000","last_peered":"2024-03-04T08:51:36.866959+0000","last_clean":"2024-03-04T08:51:36.866959+0000","last_became_active":"2024-03-04T08:51:36.862384+0000","last_became_peered":"2024-03-04T08:51:36.862384+0000","last_unstale":"2024-03-04T08:51:36.866959+0000","last_undegraded":"2024-03-04T08:51:36.866959+0000","last_fullsized":"2024-03-04T08:51:36.866959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850953+0000","last_change":"2024-03-04T08:51:36.850953+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850953+0000","last_undegraded":"2024-03-04T08:51:36.850953+0000","last_fullsized":"2024-03-04T08:51:36.850953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866739+0000","last_change":"2024-03-04T08:51:36.863469+0000","last_active":"2024-03-04T08:51:36.866739+0000","last_peered":"2024-03-04T08:51:36.866739+0000","last_clean":"2024-03-04T08:51:36.866739+0000","last_became_active":"2024-03-04T08:51:36.863185+0000","last_became_peered":"2024-03-04T08:51:36.863185+0000","last_unstale":"2024-03-04T08:51:36.866739+0000","last_undegraded":"2024-03-04T08:51:36.866739+0000","last_fullsized":"2024-03-04T08:51:36.866739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:59.155097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849769+0000","last_change":"2024-03-04T08:51:36.849769+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849769+0000","last_undegraded":"2024-03-04T08:51:36.849769+0000","last_fullsized":"2024-03-04T08:51:36.849769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866542+0000","last_change":"2024-03-04T08:51:36.864814+0000","last_active":"2024-03-04T08:51:36.866542+0000","last_peered":"2024-03-04T08:51:36.866542+0000","last_clean":"2024-03-04T08:51:36.866542+0000","last_became_active":"2024-03-04T08:51:36.864469+0000","last_became_peered":"2024-03-04T08:51:36.864469+0000","last_unstale":"2024-03-04T08:51:36.866542+0000","last_undegraded":"2024-03-04T08:51:36.866542+0000","last_fullsized":"2024-03-04T08:51:36.866542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:19.377354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851463+0000","last_change":"2024-03-04T08:51:36.851463+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851463+0000","last_undegraded":"2024-03-04T08:51:36.851463+0000","last_fullsized":"2024-03-04T08:51:36.851463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865646+0000","last_change":"2024-03-04T08:51:36.862948+0000","last_active":"2024-03-04T08:51:36.865646+0000","last_peered":"2024-03-04T08:51:36.865646+0000","last_clean":"2024-03-04T08:51:36.865646+0000","last_became_active":"2024-03-04T08:51:36.862660+0000","last_became_peered":"2024-03-04T08:51:36.862660+0000","last_unstale":"2024-03-04T08:51:36.865646+0000","last_undegraded":"2024-03-04T08:51:36.865646+0000","last_fullsized":"2024-03-04T08:51:36.865646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:41.411669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856927+0000","last_change":"2024-03-04T08:51:36.856927+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856927+0000","last_undegraded":"2024-03-04T08:51:36.856927+0000","last_fullsized":"2024-03-04T08:51:36.856927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871913+0000","last_change":"2024-03-04T08:51:36.868052+0000","last_active":"2024-03-04T08:51:36.871913+0000","last_peered":"2024-03-04T08:51:36.871913+0000","last_clean":"2024-03-04T08:51:36.871913+0000","last_became_active":"2024-03-04T08:51:36.867386+0000","last_became_peered":"2024-03-04T08:51:36.867386+0000","last_unstale":"2024-03-04T08:51:36.871913+0000","last_undegraded":"2024-03-04T08:51:36.871913+0000","last_fullsized":"2024-03-04T08:51:36.871913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:34.678540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850238+0000","last_change":"2024-03-04T08:51:36.850238+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850238+0000","last_undegraded":"2024-03-04T08:51:36.850238+0000","last_fullsized":"2024-03-04T08:51:36.850238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853446+0000","last_change":"2024-03-04T08:51:36.853446+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853446+0000","last_undegraded":"2024-03-04T08:51:36.853446+0000","last_fullsized":"2024-03-04T08:51:36.853446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869295+0000","last_change":"2024-03-04T08:51:36.863744+0000","last_active":"2024-03-04T08:51:36.869295+0000","last_peered":"2024-03-04T08:51:36.869295+0000","last_clean":"2024-03-04T08:51:36.869295+0000","last_became_active":"2024-03-04T08:51:36.863042+0000","last_became_peered":"2024-03-04T08:51:36.863042+0000","last_unstale":"2024-03-04T08:51:36.869295+0000","last_undegraded":"2024-03-04T08:51:36.869295+0000","last_fullsized":"2024-03-04T08:51:36.869295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:00.889514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850605+0000","last_change":"2024-03-04T08:51:36.850605+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850605+0000","last_undegraded":"2024-03-04T08:51:36.850605+0000","last_fullsized":"2024-03-04T08:51:36.850605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871938+0000","last_change":"2024-03-04T08:51:36.868568+0000","last_active":"2024-03-04T08:51:36.871938+0000","last_peered":"2024-03-04T08:51:36.871938+0000","last_clean":"2024-03-04T08:51:36.871938+0000","last_became_active":"2024-03-04T08:51:36.868032+0000","last_became_peered":"2024-03-04T08:51:36.868032+0000","last_unstale":"2024-03-04T08:51:36.871938+0000","last_undegraded":"2024-03-04T08:51:36.871938+0000","last_fullsized":"2024-03-04T08:51:36.871938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:55.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852871+0000","last_change":"2024-03-04T08:51:36.852871+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852871+0000","last_undegraded":"2024-03-04T08:51:36.852871+0000","last_fullsized":"2024-03-04T08:51:36.852871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848323+0000","last_change":"2024-03-04T08:51:36.848323+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848323+0000","last_undegraded":"2024-03-04T08:51:36.848323+0000","last_fullsized":"2024-03-04T08:51:36.848323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848414+0000","last_change":"2024-03-04T08:51:36.848414+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848414+0000","last_undegraded":"2024-03-04T08:51:36.848414+0000","last_fullsized":"2024-03-04T08:51:36.848414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871856+0000","last_change":"2024-03-04T08:51:36.868118+0000","last_active":"2024-03-04T08:51:36.871856+0000","last_peered":"2024-03-04T08:51:36.871856+0000","last_clean":"2024-03-04T08:51:36.871856+0000","last_became_active":"2024-03-04T08:51:36.867809+0000","last_became_peered":"2024-03-04T08:51:36.867809+0000","last_unstale":"2024-03-04T08:51:36.871856+0000","last_undegraded":"2024-03-04T08:51:36.871856+0000","last_fullsized":"2024-03-04T08:51:36.871856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848307+0000","last_change":"2024-03-04T08:51:36.848307+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848307+0000","last_undegraded":"2024-03-04T08:51:36.848307+0000","last_fullsized":"2024-03-04T08:51:36.848307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.868481+0000","last_change":"2024-03-04T08:51:36.867341+0000","last_active":"2024-03-04T08:51:36.868481+0000","last_peered":"2024-03-04T08:51:36.868481+0000","last_clean":"2024-03-04T08:51:36.868481+0000","last_became_active":"2024-03-04T08:51:36.867060+0000","last_became_peered":"2024-03-04T08:51:36.867060+0000","last_unstale":"2024-03-04T08:51:36.868481+0000","last_undegraded":"2024-03-04T08:51:36.868481+0000","last_fullsized":"2024-03-04T08:51:36.868481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848681+0000","last_change":"2024-03-04T08:51:36.848681+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848681+0000","last_undegraded":"2024-03-04T08:51:36.848681+0000","last_fullsized":"2024-03-04T08:51:36.848681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851736+0000","last_change":"2024-03-04T08:51:36.851736+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851736+0000","last_undegraded":"2024-03-04T08:51:36.851736+0000","last_fullsized":"2024-03-04T08:51:36.851736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865623+0000","last_change":"2024-03-04T08:51:36.862821+0000","last_active":"2024-03-04T08:51:36.865623+0000","last_peered":"2024-03-04T08:51:36.865623+0000","last_clean":"2024-03-04T08:51:36.865623+0000","last_became_active":"2024-03-04T08:51:36.862503+0000","last_became_peered":"2024-03-04T08:51:36.862503+0000","last_unstale":"2024-03-04T08:51:36.865623+0000","last_undegraded":"2024-03-04T08:51:36.865623+0000","last_fullsized":"2024-03-04T08:51:36.865623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:43.796665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848160+0000","last_change":"2024-03-04T08:51:36.848160+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848160+0000","last_undegraded":"2024-03-04T08:51:36.848160+0000","last_fullsized":"2024-03-04T08:51:36.848160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852471+0000","last_change":"2024-03-04T08:51:36.852471+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852471+0000","last_undegraded":"2024-03-04T08:51:36.852471+0000","last_fullsized":"2024-03-04T08:51:36.852471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871826+0000","last_change":"2024-03-04T08:51:36.867678+0000","last_active":"2024-03-04T08:51:36.871826+0000","last_peered":"2024-03-04T08:51:36.871826+0000","last_clean":"2024-03-04T08:51:36.871826+0000","last_became_active":"2024-03-04T08:51:36.867357+0000","last_became_peered":"2024-03-04T08:51:36.867357+0000","last_unstale":"2024-03-04T08:51:36.871826+0000","last_undegraded":"2024-03-04T08:51:36.871826+0000","last_fullsized":"2024-03-04T08:51:36.871826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:25.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850242+0000","last_change":"2024-03-04T08:51:36.850242+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850242+0000","last_undegraded":"2024-03-04T08:51:36.850242+0000","last_fullsized":"2024-03-04T08:51:36.850242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851010+0000","last_change":"2024-03-04T08:51:36.851010+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851010+0000","last_undegraded":"2024-03-04T08:51:36.851010+0000","last_fullsized":"2024-03-04T08:51:36.851010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.863992+0000","last_change":"2024-03-04T08:51:36.859342+0000","last_active":"2024-03-04T08:51:36.863992+0000","last_peered":"2024-03-04T08:51:36.863992+0000","last_clean":"2024-03-04T08:51:36.863992+0000","last_became_active":"2024-03-04T08:51:36.859042+0000","last_became_peered":"2024-03-04T08:51:36.859042+0000","last_unstale":"2024-03-04T08:51:36.863992+0000","last_undegraded":"2024-03-04T08:51:36.863992+0000","last_fullsized":"2024-03-04T08:51:36.863992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850933+0000","last_change":"2024-03-04T08:51:36.850933+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850933+0000","last_undegraded":"2024-03-04T08:51:36.850933+0000","last_fullsized":"2024-03-04T08:51:36.850933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850453+0000","last_change":"2024-03-04T08:51:36.850453+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850453+0000","last_undegraded":"2024-03-04T08:51:36.850453+0000","last_fullsized":"2024-03-04T08:51:36.850453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:35.832436+0000","last_change":"2024-03-04T08:51:35.832436+0000","last_active":"2024-03-04T08:51:35.832436+0000","last_peered":"2024-03-04T08:51:35.832436+0000","last_clean":"2024-03-04T08:51:35.832436+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:35.832436+0000","last_undegraded":"2024-03-04T08:51:35.832436+0000","last_fullsized":"2024-03-04T08:51:35.832436+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-04T08:51:36.840369+0000","last_change":"2024-03-04T08:51:36.840369+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.840369+0000","last_undegraded":"2024-03-04T08:51:36.840369+0000","last_fullsized":"2024-03-04T08:51:36.840369+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866704+0000","last_change":"2024-03-04T08:51:36.863377+0000","last_active":"2024-03-04T08:51:36.866704+0000","last_peered":"2024-03-04T08:51:36.866704+0000","last_clean":"2024-03-04T08:51:36.866704+0000","last_became_active":"2024-03-04T08:51:36.863028+0000","last_became_peered":"2024-03-04T08:51:36.863028+0000","last_unstale":"2024-03-04T08:51:36.866704+0000","last_undegraded":"2024-03-04T08:51:36.866704+0000","last_fullsized":"2024-03-04T08:51:36.866704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:24.983053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851177+0000","last_change":"2024-03-04T08:51:36.851177+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851177+0000","last_undegraded":"2024-03-04T08:51:36.851177+0000","last_fullsized":"2024-03-04T08:51:36.851177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862743+0000","last_change":"2024-03-04T08:51:36.861136+0000","last_active":"2024-03-04T08:51:36.862743+0000","last_peered":"2024-03-04T08:51:36.862743+0000","last_clean":"2024-03-04T08:51:36.862743+0000","last_became_active":"2024-03-04T08:51:36.860816+0000","last_became_peered":"2024-03-04T08:51:36.860816+0000","last_unstale":"2024-03-04T08:51:36.862743+0000","last_undegraded":"2024-03-04T08:51:36.862743+0000","last_fullsized":"2024-03-04T08:51:36.862743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:37:05.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.854496+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:51:36.854496+0000","last_peered":"2024-03-04T08:51:36.854496+0000","last_clean":"2024-03-04T08:51:36.854496+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:51:36.854496+0000","last_undegraded":"2024-03-04T08:51:36.854496+0000","last_fullsized":"2024-03-04T08:51:36.854496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":726100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":123648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:51:41.010 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:51:41.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.166+0000 7f58c2f8a640 1 Processor -- start 2024-03-04T08:51:41.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.166+0000 7f58c2f8a640 1 -- start start 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c2f8a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f58bc0d22b0 0x7f58bc0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c2f8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58bc0b41f0 0x7f58bc0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c2f8a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0b3430 con 0x7f58bc15dfe0 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c2f8a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0d2c50 con 0x7f58bc0b41f0 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c2f8a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0b31e0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58bc0b41f0 0x7f58bc0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58bc0b41f0 0x7f58bc0b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41084/0 (socket says 172.21.15.19:41084) 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 -- 172.21.15.19:0/2234392578 learned_addr learned my addr 172.21.15.19:0/2234392578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58bbfff640 1 --2- 172.21.15.19:0/2234392578 >> v2:172.21.15.204:3300/0 conn(0x7f58bc0d22b0 0x7f58bc0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 -- 172.21.15.19:0/2234392578 >> v2:172.21.15.204:3300/0 conn(0x7f58bc0d22b0 msgr2=0x7f58bc0d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 --2- 172.21.15.19:0/2234392578 >> v2:172.21.15.204:3300/0 conn(0x7f58bc0d22b0 0x7f58bc0d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 -- 172.21.15.19:0/2234392578 >> v1:172.21.15.204:6789/0 conn(0x7f58bc15dfe0 legacy=0x7f58bc0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.167+0000 7f58c1527640 1 -- 172.21.15.19:0/2234392578 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0b3710 con 0x7f58bc0b41f0 2024-03-04T08:51:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.168+0000 7f58c1527640 1 --2- 172.21.15.19:0/2234392578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0b41f0 0x7f58bc0b4680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009e50 tx=0x7f58b402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84487d76d52a3afc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.168+0000 7f58bb7fe640 1 -- 172.21.15.19:0/2234392578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b402cb20 con 0x7f58bc0b41f0 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.168+0000 7f58bb7fe640 1 -- 172.21.15.19:0/2234392578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b402ccc0 con 0x7f58bc0b41f0 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.168+0000 7f58bb7fe640 1 -- 172.21.15.19:0/2234392578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4034610 con 0x7f58bc0b41f0 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 -- 172.21.15.19:0/2234392578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0b41f0 msgr2=0x7f58bc0b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/2234392578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0b41f0 0x7f58bc0b4680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009e50 tx=0x7f58b402bf80 comp rx=0 tx=0).stop 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 -- 172.21.15.19:0/2234392578 shutdown_connections 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/2234392578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0b41f0 0x7f58bc0b4680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/2234392578 >> v2:172.21.15.204:3300/0 conn(0x7f58bc0d22b0 0x7f58bc0d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 -- 172.21.15.19:0/2234392578 >> 172.21.15.19:0/2234392578 conn(0x7f58bc0d3cd0 msgr2=0x7f58bc0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 -- 172.21.15.19:0/2234392578 shutdown_connections 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.169+0000 7f58c2f8a640 1 -- 172.21.15.19:0/2234392578 wait complete. 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.170+0000 7f58c2f8a640 1 Processor -- start 2024-03-04T08:51:41.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.170+0000 7f58c2f8a640 1 -- start start 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58bc0b41f0 0x7f58bc1f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 0x7f58bc149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0cfa00 con 0x7f58bc0d22b0 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0b3d60 con 0x7f58bc15dfe0 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c2f8a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0d1c70 con 0x7f58bc0b41f0 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41086/0 (socket says 172.21.15.19:41086) 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 -- 172.21.15.19:0/3313706743 learned_addr learned my addr 172.21.15.19:0/3313706743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 -- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58bc0b41f0 msgr2=0x7f58bc1f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c0d26640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58bc0b41f0 0x7f58bc1f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c1527640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 0x7f58bc149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58bc0b41f0 0x7f58bc1f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 -- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 msgr2=0x7f58bc149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 0x7f58bc149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58bbfff640 1 -- 172.21.15.19:0/3313706743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0b70b0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.171+0000 7f58c1527640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 0x7f58bc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58bbfff640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58a800d830 tx=0x7f58a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a800b6c0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a8019070 con 0x7f58bc0d22b0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a800ba80 con 0x7f58bc0d22b0 2024-03-04T08:51:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc0b6af0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.172+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc0cc9a0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.173+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc04f330 con 0x7f58bc0d22b0 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.173+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58a801e460 con 0x7f58bc0d22b0 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.174+0000 7f58b97fa640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 0x7f58a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.174+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58a808b3e0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.174+0000 7f58c0d26640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 0x7f58a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.175+0000 7f58c0d26640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 0x7f58a006d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58b0001500 tx=0x7f58b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.177+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f58bc0b70b0 con 0x7f58bc0d22b0 2024-03-04T08:51:41.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.356+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58bc0d0860 con 0x7f58a006b4d0 2024-03-04T08:51:41.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.363+0000 7f58b97fa640 1 -- 172.21.15.19:0/3313706743 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247984 (secure 0 0 0) 0x7f58bc0d0860 con 0x7f58a006b4d0 2024-03-04T08:51:41.362 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:41.363 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:51:41.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 msgr2=0x7f58a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 0x7f58a006d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58b0001500 tx=0x7f58b0009040 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 msgr2=0x7f58bc0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58a800d830 tx=0x7f58a800dcf0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 shutdown_connections 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f58a006b4d0 0x7f58a006d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f58bc15dfe0 0x7f58bc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58bc0d22b0 0x7f58bc0cd1a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 --2- 172.21.15.19:0/3313706743 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58bc0b41f0 0x7f58bc1f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 >> 172.21.15.19:0/3313706743 conn(0x7f58bc0d3cd0 msgr2=0x7f58bc0b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 shutdown_connections 2024-03-04T08:51:41.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.366+0000 7f58c2f8a640 1 -- 172.21.15.19:0/3313706743 wait complete. 2024-03-04T08:51:41.377 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-03-04T08:51:41.150850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224296,"kb_used_data":3972,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750424,"statfs":{"total":773094113280,"available":772864434176,"internally_reserved":0,"allocated":4067328,"data_stored":2288213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.304059"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851882+0000","last_change":"2024-03-04T08:51:36.851882+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851882+0000","last_undegraded":"2024-03-04T08:51:36.851882+0000","last_fullsized":"2024-03-04T08:51:36.851882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.855551+0000","last_change":"2024-03-04T08:51:36.855551+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.855551+0000","last_undegraded":"2024-03-04T08:51:36.855551+0000","last_fullsized":"2024-03-04T08:51:36.855551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856522+0000","last_change":"2024-03-04T08:51:36.856522+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856522+0000","last_undegraded":"2024-03-04T08:51:36.856522+0000","last_fullsized":"2024-03-04T08:51:36.856522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872827+0000","last_change":"2024-03-04T08:51:37.876460+0000","last_active":"2024-03-04T08:51:38.872827+0000","last_peered":"2024-03-04T08:51:38.872827+0000","last_clean":"2024-03-04T08:51:38.872827+0000","last_became_active":"2024-03-04T08:51:37.876191+0000","last_became_peered":"2024-03-04T08:51:37.876191+0000","last_unstale":"2024-03-04T08:51:38.872827+0000","last_undegraded":"2024-03-04T08:51:38.872827+0000","last_fullsized":"2024-03-04T08:51:38.872827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849733+0000","last_change":"2024-03-04T08:51:36.849733+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849733+0000","last_undegraded":"2024-03-04T08:51:36.849733+0000","last_fullsized":"2024-03-04T08:51:36.849733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853415+0000","last_change":"2024-03-04T08:51:36.853415+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853415+0000","last_undegraded":"2024-03-04T08:51:36.853415+0000","last_fullsized":"2024-03-04T08:51:36.853415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851133+0000","last_change":"2024-03-04T08:51:36.851133+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851133+0000","last_undegraded":"2024-03-04T08:51:36.851133+0000","last_fullsized":"2024-03-04T08:51:36.851133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854292+0000","last_change":"2024-03-04T08:51:36.854292+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854292+0000","last_undegraded":"2024-03-04T08:51:36.854292+0000","last_fullsized":"2024-03-04T08:51:36.854292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392010+0000","last_change":"2024-03-04T08:51:37.871847+0000","last_active":"2024-03-04T08:51:39.392010+0000","last_peered":"2024-03-04T08:51:39.392010+0000","last_clean":"2024-03-04T08:51:39.392010+0000","last_became_active":"2024-03-04T08:51:37.871513+0000","last_became_peered":"2024-03-04T08:51:37.871513+0000","last_unstale":"2024-03-04T08:51:39.392010+0000","last_undegraded":"2024-03-04T08:51:39.392010+0000","last_fullsized":"2024-03-04T08:51:39.392010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872958+0000","last_change":"2024-03-04T08:51:37.881764+0000","last_active":"2024-03-04T08:51:38.872958+0000","last_peered":"2024-03-04T08:51:38.872958+0000","last_clean":"2024-03-04T08:51:38.872958+0000","last_became_active":"2024-03-04T08:51:37.881212+0000","last_became_peered":"2024-03-04T08:51:37.881212+0000","last_unstale":"2024-03-04T08:51:38.872958+0000","last_undegraded":"2024-03-04T08:51:38.872958+0000","last_fullsized":"2024-03-04T08:51:38.872958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852280+0000","last_change":"2024-03-04T08:51:36.852280+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852280+0000","last_undegraded":"2024-03-04T08:51:36.852280+0000","last_fullsized":"2024-03-04T08:51:36.852280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852023+0000","last_change":"2024-03-04T08:51:36.852023+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852023+0000","last_undegraded":"2024-03-04T08:51:36.852023+0000","last_fullsized":"2024-03-04T08:51:36.852023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849264+0000","last_change":"2024-03-04T08:51:36.849264+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849264+0000","last_undegraded":"2024-03-04T08:51:36.849264+0000","last_fullsized":"2024-03-04T08:51:36.849264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852951+0000","last_change":"2024-03-04T08:51:36.852951+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852951+0000","last_undegraded":"2024-03-04T08:51:36.852951+0000","last_fullsized":"2024-03-04T08:51:36.852951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851474+0000","last_change":"2024-03-04T08:51:36.851474+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851474+0000","last_undegraded":"2024-03-04T08:51:36.851474+0000","last_fullsized":"2024-03-04T08:51:36.851474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852676+0000","last_change":"2024-03-04T08:51:36.852676+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852676+0000","last_undegraded":"2024-03-04T08:51:36.852676+0000","last_fullsized":"2024-03-04T08:51:36.852676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854691+0000","last_change":"2024-03-04T08:51:36.854691+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854691+0000","last_undegraded":"2024-03-04T08:51:36.854691+0000","last_fullsized":"2024-03-04T08:51:36.854691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853301+0000","last_change":"2024-03-04T08:51:36.853301+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853301+0000","last_undegraded":"2024-03-04T08:51:36.853301+0000","last_fullsized":"2024-03-04T08:51:36.853301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854968+0000","last_change":"2024-03-04T08:51:36.854968+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854968+0000","last_undegraded":"2024-03-04T08:51:36.854968+0000","last_fullsized":"2024-03-04T08:51:36.854968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848904+0000","last_change":"2024-03-04T08:51:36.848904+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848904+0000","last_undegraded":"2024-03-04T08:51:36.848904+0000","last_fullsized":"2024-03-04T08:51:36.848904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392188+0000","last_change":"2024-03-04T08:51:37.872571+0000","last_active":"2024-03-04T08:51:39.392188+0000","last_peered":"2024-03-04T08:51:39.392188+0000","last_clean":"2024-03-04T08:51:39.392188+0000","last_became_active":"2024-03-04T08:51:37.871862+0000","last_became_peered":"2024-03-04T08:51:37.871862+0000","last_unstale":"2024-03-04T08:51:39.392188+0000","last_undegraded":"2024-03-04T08:51:39.392188+0000","last_fullsized":"2024-03-04T08:51:39.392188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391611+0000","last_change":"2024-03-04T08:51:37.873090+0000","last_active":"2024-03-04T08:51:39.391611+0000","last_peered":"2024-03-04T08:51:39.391611+0000","last_clean":"2024-03-04T08:51:39.391611+0000","last_became_active":"2024-03-04T08:51:37.872648+0000","last_became_peered":"2024-03-04T08:51:37.872648+0000","last_unstale":"2024-03-04T08:51:39.391611+0000","last_undegraded":"2024-03-04T08:51:39.391611+0000","last_fullsized":"2024-03-04T08:51:39.391611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850730+0000","last_change":"2024-03-04T08:51:36.850730+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850730+0000","last_undegraded":"2024-03-04T08:51:36.850730+0000","last_fullsized":"2024-03-04T08:51:36.850730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853677+0000","last_change":"2024-03-04T08:51:36.853677+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853677+0000","last_undegraded":"2024-03-04T08:51:36.853677+0000","last_fullsized":"2024-03-04T08:51:36.853677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873039+0000","last_change":"2024-03-04T08:51:37.873138+0000","last_active":"2024-03-04T08:51:38.873039+0000","last_peered":"2024-03-04T08:51:38.873039+0000","last_clean":"2024-03-04T08:51:38.873039+0000","last_became_active":"2024-03-04T08:51:37.872797+0000","last_became_peered":"2024-03-04T08:51:37.872797+0000","last_unstale":"2024-03-04T08:51:38.873039+0000","last_undegraded":"2024-03-04T08:51:38.873039+0000","last_fullsized":"2024-03-04T08:51:38.873039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849302+0000","last_change":"2024-03-04T08:51:36.849302+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849302+0000","last_undegraded":"2024-03-04T08:51:36.849302+0000","last_fullsized":"2024-03-04T08:51:36.849302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873131+0000","last_change":"2024-03-04T08:51:37.874965+0000","last_active":"2024-03-04T08:51:38.873131+0000","last_peered":"2024-03-04T08:51:38.873131+0000","last_clean":"2024-03-04T08:51:38.873131+0000","last_became_active":"2024-03-04T08:51:37.874674+0000","last_became_peered":"2024-03-04T08:51:37.874674+0000","last_unstale":"2024-03-04T08:51:38.873131+0000","last_undegraded":"2024-03-04T08:51:38.873131+0000","last_fullsized":"2024-03-04T08:51:38.873131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:42.266540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851600+0000","last_change":"2024-03-04T08:51:36.851600+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851600+0000","last_undegraded":"2024-03-04T08:51:36.851600+0000","last_fullsized":"2024-03-04T08:51:36.851600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392332+0000","last_change":"2024-03-04T08:51:37.870986+0000","last_active":"2024-03-04T08:51:39.392332+0000","last_peered":"2024-03-04T08:51:39.392332+0000","last_clean":"2024-03-04T08:51:39.392332+0000","last_became_active":"2024-03-04T08:51:37.870677+0000","last_became_peered":"2024-03-04T08:51:37.870677+0000","last_unstale":"2024-03-04T08:51:39.392332+0000","last_undegraded":"2024-03-04T08:51:39.392332+0000","last_fullsized":"2024-03-04T08:51:39.392332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853205+0000","last_change":"2024-03-04T08:51:36.853205+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853205+0000","last_undegraded":"2024-03-04T08:51:36.853205+0000","last_fullsized":"2024-03-04T08:51:36.853205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851067+0000","last_change":"2024-03-04T08:51:36.851067+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851067+0000","last_undegraded":"2024-03-04T08:51:36.851067+0000","last_fullsized":"2024-03-04T08:51:36.851067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853910+0000","last_change":"2024-03-04T08:51:36.853910+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853910+0000","last_undegraded":"2024-03-04T08:51:36.853910+0000","last_fullsized":"2024-03-04T08:51:36.853910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851966+0000","last_change":"2024-03-04T08:51:36.851966+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851966+0000","last_undegraded":"2024-03-04T08:51:36.851966+0000","last_fullsized":"2024-03-04T08:51:36.851966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862822+0000","last_change":"2024-03-04T08:51:36.861353+0000","last_active":"2024-03-04T08:51:36.862822+0000","last_peered":"2024-03-04T08:51:36.862822+0000","last_clean":"2024-03-04T08:51:36.862822+0000","last_became_active":"2024-03-04T08:51:36.861087+0000","last_became_peered":"2024-03-04T08:51:36.861087+0000","last_unstale":"2024-03-04T08:51:36.862822+0000","last_undegraded":"2024-03-04T08:51:36.862822+0000","last_fullsized":"2024-03-04T08:51:36.862822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851451+0000","last_change":"2024-03-04T08:51:36.851451+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851451+0000","last_undegraded":"2024-03-04T08:51:36.851451+0000","last_fullsized":"2024-03-04T08:51:36.851451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865235+0000","last_change":"2024-03-04T08:51:36.862187+0000","last_active":"2024-03-04T08:51:36.865235+0000","last_peered":"2024-03-04T08:51:36.865235+0000","last_clean":"2024-03-04T08:51:36.865235+0000","last_became_active":"2024-03-04T08:51:36.861833+0000","last_became_peered":"2024-03-04T08:51:36.861833+0000","last_unstale":"2024-03-04T08:51:36.865235+0000","last_undegraded":"2024-03-04T08:51:36.865235+0000","last_fullsized":"2024-03-04T08:51:36.865235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392416+0000","last_change":"2024-03-04T08:51:37.880138+0000","last_active":"2024-03-04T08:51:39.392416+0000","last_peered":"2024-03-04T08:51:39.392416+0000","last_clean":"2024-03-04T08:51:39.392416+0000","last_became_active":"2024-03-04T08:51:37.879016+0000","last_became_peered":"2024-03-04T08:51:37.879016+0000","last_unstale":"2024-03-04T08:51:39.392416+0000","last_undegraded":"2024-03-04T08:51:39.392416+0000","last_fullsized":"2024-03-04T08:51:39.392416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871917+0000","last_change":"2024-03-04T08:51:36.867819+0000","last_active":"2024-03-04T08:51:36.871917+0000","last_peered":"2024-03-04T08:51:36.871917+0000","last_clean":"2024-03-04T08:51:36.871917+0000","last_became_active":"2024-03-04T08:51:36.867496+0000","last_became_peered":"2024-03-04T08:51:36.867496+0000","last_unstale":"2024-03-04T08:51:36.871917+0000","last_undegraded":"2024-03-04T08:51:36.871917+0000","last_fullsized":"2024-03-04T08:51:36.871917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:09.770388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873129+0000","last_change":"2024-03-04T08:51:37.873799+0000","last_active":"2024-03-04T08:51:38.873129+0000","last_peered":"2024-03-04T08:51:38.873129+0000","last_clean":"2024-03-04T08:51:38.873129+0000","last_became_active":"2024-03-04T08:51:37.873368+0000","last_became_peered":"2024-03-04T08:51:37.873368+0000","last_unstale":"2024-03-04T08:51:38.873129+0000","last_undegraded":"2024-03-04T08:51:38.873129+0000","last_fullsized":"2024-03-04T08:51:38.873129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869520+0000","last_change":"2024-03-04T08:51:36.865647+0000","last_active":"2024-03-04T08:51:36.869520+0000","last_peered":"2024-03-04T08:51:36.869520+0000","last_clean":"2024-03-04T08:51:36.869520+0000","last_became_active":"2024-03-04T08:51:36.865371+0000","last_became_peered":"2024-03-04T08:51:36.865371+0000","last_unstale":"2024-03-04T08:51:36.869520+0000","last_undegraded":"2024-03-04T08:51:36.869520+0000","last_fullsized":"2024-03-04T08:51:36.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.190641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851249+0000","last_change":"2024-03-04T08:51:36.851249+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851249+0000","last_undegraded":"2024-03-04T08:51:36.851249+0000","last_fullsized":"2024-03-04T08:51:36.851249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392295+0000","last_change":"2024-03-04T08:51:36.859075+0000","last_active":"2024-03-04T08:51:39.392295+0000","last_peered":"2024-03-04T08:51:39.392295+0000","last_clean":"2024-03-04T08:51:39.392295+0000","last_became_active":"2024-03-04T08:51:36.858824+0000","last_became_peered":"2024-03-04T08:51:36.858824+0000","last_unstale":"2024-03-04T08:51:39.392295+0000","last_undegraded":"2024-03-04T08:51:39.392295+0000","last_fullsized":"2024-03-04T08:51:39.392295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:07.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854244+0000","last_change":"2024-03-04T08:51:36.854244+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854244+0000","last_undegraded":"2024-03-04T08:51:36.854244+0000","last_fullsized":"2024-03-04T08:51:36.854244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391740+0000","last_change":"2024-03-04T08:51:36.859719+0000","last_active":"2024-03-04T08:51:39.391740+0000","last_peered":"2024-03-04T08:51:39.391740+0000","last_clean":"2024-03-04T08:51:39.391740+0000","last_became_active":"2024-03-04T08:51:36.859453+0000","last_became_peered":"2024-03-04T08:51:36.859453+0000","last_unstale":"2024-03-04T08:51:39.391740+0000","last_undegraded":"2024-03-04T08:51:39.391740+0000","last_fullsized":"2024-03-04T08:51:39.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391315+0000","last_change":"2024-03-04T08:51:37.864891+0000","last_active":"2024-03-04T08:51:39.391315+0000","last_peered":"2024-03-04T08:51:39.391315+0000","last_clean":"2024-03-04T08:51:39.391315+0000","last_became_active":"2024-03-04T08:51:37.864575+0000","last_became_peered":"2024-03-04T08:51:37.864575+0000","last_unstale":"2024-03-04T08:51:39.391315+0000","last_undegraded":"2024-03-04T08:51:39.391315+0000","last_fullsized":"2024-03-04T08:51:39.391315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:41.263175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866959+0000","last_change":"2024-03-04T08:51:36.862686+0000","last_active":"2024-03-04T08:51:36.866959+0000","last_peered":"2024-03-04T08:51:36.866959+0000","last_clean":"2024-03-04T08:51:36.866959+0000","last_became_active":"2024-03-04T08:51:36.862384+0000","last_became_peered":"2024-03-04T08:51:36.862384+0000","last_unstale":"2024-03-04T08:51:36.866959+0000","last_undegraded":"2024-03-04T08:51:36.866959+0000","last_fullsized":"2024-03-04T08:51:36.866959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872573+0000","last_change":"2024-03-04T08:51:37.870071+0000","last_active":"2024-03-04T08:51:38.872573+0000","last_peered":"2024-03-04T08:51:38.872573+0000","last_clean":"2024-03-04T08:51:38.872573+0000","last_became_active":"2024-03-04T08:51:37.869797+0000","last_became_peered":"2024-03-04T08:51:37.869797+0000","last_unstale":"2024-03-04T08:51:38.872573+0000","last_undegraded":"2024-03-04T08:51:38.872573+0000","last_fullsized":"2024-03-04T08:51:38.872573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391413+0000","last_change":"2024-03-04T08:51:36.862238+0000","last_active":"2024-03-04T08:51:39.391413+0000","last_peered":"2024-03-04T08:51:39.391413+0000","last_clean":"2024-03-04T08:51:39.391413+0000","last_became_active":"2024-03-04T08:51:36.861973+0000","last_became_peered":"2024-03-04T08:51:36.861973+0000","last_unstale":"2024-03-04T08:51:39.391413+0000","last_undegraded":"2024-03-04T08:51:39.391413+0000","last_fullsized":"2024-03-04T08:51:39.391413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850953+0000","last_change":"2024-03-04T08:51:36.850953+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850953+0000","last_undegraded":"2024-03-04T08:51:36.850953+0000","last_fullsized":"2024-03-04T08:51:36.850953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866739+0000","last_change":"2024-03-04T08:51:36.863469+0000","last_active":"2024-03-04T08:51:36.866739+0000","last_peered":"2024-03-04T08:51:36.866739+0000","last_clean":"2024-03-04T08:51:36.866739+0000","last_became_active":"2024-03-04T08:51:36.863185+0000","last_became_peered":"2024-03-04T08:51:36.863185+0000","last_unstale":"2024-03-04T08:51:36.866739+0000","last_undegraded":"2024-03-04T08:51:36.866739+0000","last_fullsized":"2024-03-04T08:51:36.866739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:59.155097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849769+0000","last_change":"2024-03-04T08:51:36.849769+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849769+0000","last_undegraded":"2024-03-04T08:51:36.849769+0000","last_fullsized":"2024-03-04T08:51:36.849769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866542+0000","last_change":"2024-03-04T08:51:36.864814+0000","last_active":"2024-03-04T08:51:36.866542+0000","last_peered":"2024-03-04T08:51:36.866542+0000","last_clean":"2024-03-04T08:51:36.866542+0000","last_became_active":"2024-03-04T08:51:36.864469+0000","last_became_peered":"2024-03-04T08:51:36.864469+0000","last_unstale":"2024-03-04T08:51:36.866542+0000","last_undegraded":"2024-03-04T08:51:36.866542+0000","last_fullsized":"2024-03-04T08:51:36.866542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:19.377354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851463+0000","last_change":"2024-03-04T08:51:36.851463+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851463+0000","last_undegraded":"2024-03-04T08:51:36.851463+0000","last_fullsized":"2024-03-04T08:51:36.851463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865646+0000","last_change":"2024-03-04T08:51:36.862948+0000","last_active":"2024-03-04T08:51:36.865646+0000","last_peered":"2024-03-04T08:51:36.865646+0000","last_clean":"2024-03-04T08:51:36.865646+0000","last_became_active":"2024-03-04T08:51:36.862660+0000","last_became_peered":"2024-03-04T08:51:36.862660+0000","last_unstale":"2024-03-04T08:51:36.865646+0000","last_undegraded":"2024-03-04T08:51:36.865646+0000","last_fullsized":"2024-03-04T08:51:36.865646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:41.411669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856927+0000","last_change":"2024-03-04T08:51:36.856927+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856927+0000","last_undegraded":"2024-03-04T08:51:36.856927+0000","last_fullsized":"2024-03-04T08:51:36.856927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871913+0000","last_change":"2024-03-04T08:51:36.868052+0000","last_active":"2024-03-04T08:51:36.871913+0000","last_peered":"2024-03-04T08:51:36.871913+0000","last_clean":"2024-03-04T08:51:36.871913+0000","last_became_active":"2024-03-04T08:51:36.867386+0000","last_became_peered":"2024-03-04T08:51:36.867386+0000","last_unstale":"2024-03-04T08:51:36.871913+0000","last_undegraded":"2024-03-04T08:51:36.871913+0000","last_fullsized":"2024-03-04T08:51:36.871913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:34.678540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872657+0000","last_change":"2024-03-04T08:51:37.874458+0000","last_active":"2024-03-04T08:51:38.872657+0000","last_peered":"2024-03-04T08:51:38.872657+0000","last_clean":"2024-03-04T08:51:38.872657+0000","last_became_active":"2024-03-04T08:51:37.873503+0000","last_became_peered":"2024-03-04T08:51:37.873503+0000","last_unstale":"2024-03-04T08:51:38.872657+0000","last_undegraded":"2024-03-04T08:51:38.872657+0000","last_fullsized":"2024-03-04T08:51:38.872657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392385+0000","last_change":"2024-03-04T08:51:36.862148+0000","last_active":"2024-03-04T08:51:39.392385+0000","last_peered":"2024-03-04T08:51:39.392385+0000","last_clean":"2024-03-04T08:51:39.392385+0000","last_became_active":"2024-03-04T08:51:36.861872+0000","last_became_peered":"2024-03-04T08:51:36.861872+0000","last_unstale":"2024-03-04T08:51:39.392385+0000","last_undegraded":"2024-03-04T08:51:39.392385+0000","last_fullsized":"2024-03-04T08:51:39.392385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850238+0000","last_change":"2024-03-04T08:51:36.850238+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850238+0000","last_undegraded":"2024-03-04T08:51:36.850238+0000","last_fullsized":"2024-03-04T08:51:36.850238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872609+0000","last_change":"2024-03-04T08:51:36.865777+0000","last_active":"2024-03-04T08:51:38.872609+0000","last_peered":"2024-03-04T08:51:38.872609+0000","last_clean":"2024-03-04T08:51:38.872609+0000","last_became_active":"2024-03-04T08:51:36.865481+0000","last_became_peered":"2024-03-04T08:51:36.865481+0000","last_unstale":"2024-03-04T08:51:38.872609+0000","last_undegraded":"2024-03-04T08:51:38.872609+0000","last_fullsized":"2024-03-04T08:51:38.872609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853446+0000","last_change":"2024-03-04T08:51:36.853446+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853446+0000","last_undegraded":"2024-03-04T08:51:36.853446+0000","last_fullsized":"2024-03-04T08:51:36.853446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869295+0000","last_change":"2024-03-04T08:51:36.863744+0000","last_active":"2024-03-04T08:51:36.869295+0000","last_peered":"2024-03-04T08:51:36.869295+0000","last_clean":"2024-03-04T08:51:36.869295+0000","last_became_active":"2024-03-04T08:51:36.863042+0000","last_became_peered":"2024-03-04T08:51:36.863042+0000","last_unstale":"2024-03-04T08:51:36.869295+0000","last_undegraded":"2024-03-04T08:51:36.869295+0000","last_fullsized":"2024-03-04T08:51:36.869295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:00.889514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850605+0000","last_change":"2024-03-04T08:51:36.850605+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850605+0000","last_undegraded":"2024-03-04T08:51:36.850605+0000","last_fullsized":"2024-03-04T08:51:36.850605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871938+0000","last_change":"2024-03-04T08:51:36.868568+0000","last_active":"2024-03-04T08:51:36.871938+0000","last_peered":"2024-03-04T08:51:36.871938+0000","last_clean":"2024-03-04T08:51:36.871938+0000","last_became_active":"2024-03-04T08:51:36.868032+0000","last_became_peered":"2024-03-04T08:51:36.868032+0000","last_unstale":"2024-03-04T08:51:36.871938+0000","last_undegraded":"2024-03-04T08:51:36.871938+0000","last_fullsized":"2024-03-04T08:51:36.871938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:55.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392029+0000","last_change":"2024-03-04T08:51:37.870420+0000","last_active":"2024-03-04T08:51:39.392029+0000","last_peered":"2024-03-04T08:51:39.392029+0000","last_clean":"2024-03-04T08:51:39.392029+0000","last_became_active":"2024-03-04T08:51:37.870140+0000","last_became_peered":"2024-03-04T08:51:37.870140+0000","last_unstale":"2024-03-04T08:51:39.392029+0000","last_undegraded":"2024-03-04T08:51:39.392029+0000","last_fullsized":"2024-03-04T08:51:39.392029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873118+0000","last_change":"2024-03-04T08:51:36.865246+0000","last_active":"2024-03-04T08:51:38.873118+0000","last_peered":"2024-03-04T08:51:38.873118+0000","last_clean":"2024-03-04T08:51:38.873118+0000","last_became_active":"2024-03-04T08:51:36.864608+0000","last_became_peered":"2024-03-04T08:51:36.864608+0000","last_unstale":"2024-03-04T08:51:38.873118+0000","last_undegraded":"2024-03-04T08:51:38.873118+0000","last_fullsized":"2024-03-04T08:51:38.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852871+0000","last_change":"2024-03-04T08:51:36.852871+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852871+0000","last_undegraded":"2024-03-04T08:51:36.852871+0000","last_fullsized":"2024-03-04T08:51:36.852871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392143+0000","last_change":"2024-03-04T08:51:36.857891+0000","last_active":"2024-03-04T08:51:39.392143+0000","last_peered":"2024-03-04T08:51:39.392143+0000","last_clean":"2024-03-04T08:51:39.392143+0000","last_became_active":"2024-03-04T08:51:36.857296+0000","last_became_peered":"2024-03-04T08:51:36.857296+0000","last_unstale":"2024-03-04T08:51:39.392143+0000","last_undegraded":"2024-03-04T08:51:39.392143+0000","last_fullsized":"2024-03-04T08:51:39.392143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872861+0000","last_change":"2024-03-04T08:51:37.874163+0000","last_active":"2024-03-04T08:51:38.872861+0000","last_peered":"2024-03-04T08:51:38.872861+0000","last_clean":"2024-03-04T08:51:38.872861+0000","last_became_active":"2024-03-04T08:51:37.873895+0000","last_became_peered":"2024-03-04T08:51:37.873895+0000","last_unstale":"2024-03-04T08:51:38.872861+0000","last_undegraded":"2024-03-04T08:51:38.872861+0000","last_fullsized":"2024-03-04T08:51:38.872861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391964+0000","last_change":"2024-03-04T08:51:36.857464+0000","last_active":"2024-03-04T08:51:39.391964+0000","last_peered":"2024-03-04T08:51:39.391964+0000","last_clean":"2024-03-04T08:51:39.391964+0000","last_became_active":"2024-03-04T08:51:36.857197+0000","last_became_peered":"2024-03-04T08:51:36.857197+0000","last_unstale":"2024-03-04T08:51:39.391964+0000","last_undegraded":"2024-03-04T08:51:39.391964+0000","last_fullsized":"2024-03-04T08:51:39.391964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848323+0000","last_change":"2024-03-04T08:51:36.848323+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848323+0000","last_undegraded":"2024-03-04T08:51:36.848323+0000","last_fullsized":"2024-03-04T08:51:36.848323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392398+0000","last_change":"2024-03-04T08:51:36.861233+0000","last_active":"2024-03-04T08:51:39.392398+0000","last_peered":"2024-03-04T08:51:39.392398+0000","last_clean":"2024-03-04T08:51:39.392398+0000","last_became_active":"2024-03-04T08:51:36.860828+0000","last_became_peered":"2024-03-04T08:51:36.860828+0000","last_unstale":"2024-03-04T08:51:39.392398+0000","last_undegraded":"2024-03-04T08:51:39.392398+0000","last_fullsized":"2024-03-04T08:51:39.392398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:27.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848414+0000","last_change":"2024-03-04T08:51:36.848414+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848414+0000","last_undegraded":"2024-03-04T08:51:36.848414+0000","last_fullsized":"2024-03-04T08:51:36.848414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871856+0000","last_change":"2024-03-04T08:51:36.868118+0000","last_active":"2024-03-04T08:51:36.871856+0000","last_peered":"2024-03-04T08:51:36.871856+0000","last_clean":"2024-03-04T08:51:36.871856+0000","last_became_active":"2024-03-04T08:51:36.867809+0000","last_became_peered":"2024-03-04T08:51:36.867809+0000","last_unstale":"2024-03-04T08:51:36.871856+0000","last_undegraded":"2024-03-04T08:51:36.871856+0000","last_fullsized":"2024-03-04T08:51:36.871856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848307+0000","last_change":"2024-03-04T08:51:36.848307+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848307+0000","last_undegraded":"2024-03-04T08:51:36.848307+0000","last_fullsized":"2024-03-04T08:51:36.848307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.868481+0000","last_change":"2024-03-04T08:51:36.867341+0000","last_active":"2024-03-04T08:51:36.868481+0000","last_peered":"2024-03-04T08:51:36.868481+0000","last_clean":"2024-03-04T08:51:36.868481+0000","last_became_active":"2024-03-04T08:51:36.867060+0000","last_became_peered":"2024-03-04T08:51:36.867060+0000","last_unstale":"2024-03-04T08:51:36.868481+0000","last_undegraded":"2024-03-04T08:51:36.868481+0000","last_fullsized":"2024-03-04T08:51:36.868481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848681+0000","last_change":"2024-03-04T08:51:36.848681+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848681+0000","last_undegraded":"2024-03-04T08:51:36.848681+0000","last_fullsized":"2024-03-04T08:51:36.848681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392166+0000","last_change":"2024-03-04T08:51:36.864921+0000","last_active":"2024-03-04T08:51:39.392166+0000","last_peered":"2024-03-04T08:51:39.392166+0000","last_clean":"2024-03-04T08:51:39.392166+0000","last_became_active":"2024-03-04T08:51:36.864722+0000","last_became_peered":"2024-03-04T08:51:36.864722+0000","last_unstale":"2024-03-04T08:51:39.392166+0000","last_undegraded":"2024-03-04T08:51:39.392166+0000","last_fullsized":"2024-03-04T08:51:39.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:29.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851736+0000","last_change":"2024-03-04T08:51:36.851736+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851736+0000","last_undegraded":"2024-03-04T08:51:36.851736+0000","last_fullsized":"2024-03-04T08:51:36.851736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865623+0000","last_change":"2024-03-04T08:51:36.862821+0000","last_active":"2024-03-04T08:51:36.865623+0000","last_peered":"2024-03-04T08:51:36.865623+0000","last_clean":"2024-03-04T08:51:36.865623+0000","last_became_active":"2024-03-04T08:51:36.862503+0000","last_became_peered":"2024-03-04T08:51:36.862503+0000","last_unstale":"2024-03-04T08:51:36.865623+0000","last_undegraded":"2024-03-04T08:51:36.865623+0000","last_fullsized":"2024-03-04T08:51:36.865623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:43.796665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848160+0000","last_change":"2024-03-04T08:51:36.848160+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848160+0000","last_undegraded":"2024-03-04T08:51:36.848160+0000","last_fullsized":"2024-03-04T08:51:36.848160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873140+0000","last_change":"2024-03-04T08:51:36.865400+0000","last_active":"2024-03-04T08:51:38.873140+0000","last_peered":"2024-03-04T08:51:38.873140+0000","last_clean":"2024-03-04T08:51:38.873140+0000","last_became_active":"2024-03-04T08:51:36.864934+0000","last_became_peered":"2024-03-04T08:51:36.864934+0000","last_unstale":"2024-03-04T08:51:38.873140+0000","last_undegraded":"2024-03-04T08:51:38.873140+0000","last_fullsized":"2024-03-04T08:51:38.873140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852471+0000","last_change":"2024-03-04T08:51:36.852471+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852471+0000","last_undegraded":"2024-03-04T08:51:36.852471+0000","last_fullsized":"2024-03-04T08:51:36.852471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871826+0000","last_change":"2024-03-04T08:51:36.867678+0000","last_active":"2024-03-04T08:51:36.871826+0000","last_peered":"2024-03-04T08:51:36.871826+0000","last_clean":"2024-03-04T08:51:36.871826+0000","last_became_active":"2024-03-04T08:51:36.867357+0000","last_became_peered":"2024-03-04T08:51:36.867357+0000","last_unstale":"2024-03-04T08:51:36.871826+0000","last_undegraded":"2024-03-04T08:51:36.871826+0000","last_fullsized":"2024-03-04T08:51:36.871826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:25.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850242+0000","last_change":"2024-03-04T08:51:36.850242+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850242+0000","last_undegraded":"2024-03-04T08:51:36.850242+0000","last_fullsized":"2024-03-04T08:51:36.850242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872982+0000","last_change":"2024-03-04T08:51:36.864963+0000","last_active":"2024-03-04T08:51:38.872982+0000","last_peered":"2024-03-04T08:51:38.872982+0000","last_clean":"2024-03-04T08:51:38.872982+0000","last_became_active":"2024-03-04T08:51:36.864629+0000","last_became_peered":"2024-03-04T08:51:36.864629+0000","last_unstale":"2024-03-04T08:51:38.872982+0000","last_undegraded":"2024-03-04T08:51:38.872982+0000","last_fullsized":"2024-03-04T08:51:38.872982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:19.925101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851010+0000","last_change":"2024-03-04T08:51:36.851010+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851010+0000","last_undegraded":"2024-03-04T08:51:36.851010+0000","last_fullsized":"2024-03-04T08:51:36.851010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.863992+0000","last_change":"2024-03-04T08:51:36.859342+0000","last_active":"2024-03-04T08:51:36.863992+0000","last_peered":"2024-03-04T08:51:36.863992+0000","last_clean":"2024-03-04T08:51:36.863992+0000","last_became_active":"2024-03-04T08:51:36.859042+0000","last_became_peered":"2024-03-04T08:51:36.859042+0000","last_unstale":"2024-03-04T08:51:36.863992+0000","last_undegraded":"2024-03-04T08:51:36.863992+0000","last_fullsized":"2024-03-04T08:51:36.863992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850933+0000","last_change":"2024-03-04T08:51:36.850933+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850933+0000","last_undegraded":"2024-03-04T08:51:36.850933+0000","last_fullsized":"2024-03-04T08:51:36.850933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872707+0000","last_change":"2024-03-04T08:51:36.865216+0000","last_active":"2024-03-04T08:51:38.872707+0000","last_peered":"2024-03-04T08:51:38.872707+0000","last_clean":"2024-03-04T08:51:38.872707+0000","last_became_active":"2024-03-04T08:51:36.864887+0000","last_became_peered":"2024-03-04T08:51:36.864887+0000","last_unstale":"2024-03-04T08:51:38.872707+0000","last_undegraded":"2024-03-04T08:51:38.872707+0000","last_fullsized":"2024-03-04T08:51:38.872707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850453+0000","last_change":"2024-03-04T08:51:36.850453+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850453+0000","last_undegraded":"2024-03-04T08:51:36.850453+0000","last_fullsized":"2024-03-04T08:51:36.850453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392225+0000","last_change":"2024-03-04T08:51:36.856581+0000","last_active":"2024-03-04T08:51:39.392225+0000","last_peered":"2024-03-04T08:51:39.392225+0000","last_clean":"2024-03-04T08:51:39.392225+0000","last_became_active":"2024-03-04T08:51:36.856288+0000","last_became_peered":"2024-03-04T08:51:36.856288+0000","last_unstale":"2024-03-04T08:51:39.392225+0000","last_undegraded":"2024-03-04T08:51:39.392225+0000","last_fullsized":"2024-03-04T08:51:39.392225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:53.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392092+0000","last_change":"2024-03-04T08:51:37.872745+0000","last_active":"2024-03-04T08:51:39.392092+0000","last_peered":"2024-03-04T08:51:39.392092+0000","last_clean":"2024-03-04T08:51:39.392092+0000","last_became_active":"2024-03-04T08:51:37.872463+0000","last_became_peered":"2024-03-04T08:51:37.872463+0000","last_unstale":"2024-03-04T08:51:39.392092+0000","last_undegraded":"2024-03-04T08:51:39.392092+0000","last_fullsized":"2024-03-04T08:51:39.392092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866704+0000","last_change":"2024-03-04T08:51:36.863377+0000","last_active":"2024-03-04T08:51:36.866704+0000","last_peered":"2024-03-04T08:51:36.866704+0000","last_clean":"2024-03-04T08:51:36.866704+0000","last_became_active":"2024-03-04T08:51:36.863028+0000","last_became_peered":"2024-03-04T08:51:36.863028+0000","last_unstale":"2024-03-04T08:51:36.866704+0000","last_undegraded":"2024-03-04T08:51:36.866704+0000","last_fullsized":"2024-03-04T08:51:36.866704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:24.983053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851177+0000","last_change":"2024-03-04T08:51:36.851177+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851177+0000","last_undegraded":"2024-03-04T08:51:36.851177+0000","last_fullsized":"2024-03-04T08:51:36.851177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862743+0000","last_change":"2024-03-04T08:51:36.861136+0000","last_active":"2024-03-04T08:51:36.862743+0000","last_peered":"2024-03-04T08:51:36.862743+0000","last_clean":"2024-03-04T08:51:36.862743+0000","last_became_active":"2024-03-04T08:51:36.860816+0000","last_became_peered":"2024-03-04T08:51:36.860816+0000","last_unstale":"2024-03-04T08:51:36.862743+0000","last_undegraded":"2024-03-04T08:51:36.862743+0000","last_fullsized":"2024-03-04T08:51:36.862743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:37:05.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.854496+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:51:36.854496+0000","last_peered":"2024-03-04T08:51:36.854496+0000","last_clean":"2024-03-04T08:51:36.854496+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:51:36.854496+0000","last_undegraded":"2024-03-04T08:51:36.854496+0000","last_fullsized":"2024-03-04T08:51:36.854496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":726100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:51:41.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:51:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.523+0000 7f22665ac640 1 Processor -- start 2024-03-04T08:51:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.524+0000 7f22665ac640 1 -- start start 2024-03-04T08:51:41.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f22665ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600d4760 0x7f22600b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f22665ac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22600d0a80 0x7f22600cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f22665ac640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600d25d0 con 0x7f22600b4170 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f22665ac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22600d4bf0 con 0x7f22600d0a80 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f22665ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22600ce9e0 con 0x7f22600d4760 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22600d0a80 0x7f22600cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22600d0a80 0x7f22600cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41096/0 (socket says 172.21.15.19:41096) 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 -- 172.21.15.19:0/2351346390 learned_addr learned my addr 172.21.15.19:0/2351346390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f225f7fe640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600d4760 0x7f22600b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 -- 172.21.15.19:0/2351346390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600d4760 msgr2=0x7f22600b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600d4760 0x7f22600b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 -- 172.21.15.19:0/2351346390 >> v1:172.21.15.204:6789/0 conn(0x7f22600b4170 legacy=0x7f22600d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:41.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.525+0000 7f2264b49640 1 -- 172.21.15.19:0/2351346390 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600d2870 con 0x7f22600d0a80 2024-03-04T08:51:41.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.526+0000 7f2264b49640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600cee70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2258009e50 tx=0x7f225802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd4da7d1f57d045 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.526+0000 7f225effd640 1 -- 172.21.15.19:0/2351346390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225802ca70 con 0x7f22600d0a80 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.526+0000 7f225effd640 1 -- 172.21.15.19:0/2351346390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225802cc10 con 0x7f22600d0a80 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.526+0000 7f225effd640 1 -- 172.21.15.19:0/2351346390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580343f0 con 0x7f22600d0a80 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 -- 172.21.15.19:0/2351346390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 msgr2=0x7f22600cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600cee70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2258009e50 tx=0x7f225802bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 -- 172.21.15.19:0/2351346390 shutdown_connections 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600cee70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 --2- 172.21.15.19:0/2351346390 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600d4760 0x7f22600b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 -- 172.21.15.19:0/2351346390 >> 172.21.15.19:0/2351346390 conn(0x7f22600d3c40 msgr2=0x7f22600d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 -- 172.21.15.19:0/2351346390 shutdown_connections 2024-03-04T08:51:41.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.527+0000 7f22665ac640 1 -- 172.21.15.19:0/2351346390 wait complete. 2024-03-04T08:51:41.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.529+0000 7f22665ac640 1 Processor -- start 2024-03-04T08:51:41.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.529+0000 7f22665ac640 1 -- start start 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22600b4170 0x7f22601f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 0x7f22601555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b4dd0 con 0x7f22600d0a80 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b4550 con 0x7f22600b4170 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f22665ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b4f50 con 0x7f22600b9490 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41102/0 (socket says 172.21.15.19:41102) 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 -- 172.21.15.19:0/2880338832 learned_addr learned my addr 172.21.15.19:0/2880338832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225ffff640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22600b4170 0x7f22601f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f2264b49640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 0x7f22601555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 -- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 msgr2=0x7f22601555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 0x7f22601555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 -- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22600b4170 msgr2=0x7f22601f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22600b4170 0x7f22601f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f225f7fe640 1 -- 172.21.15.19:0/2880338832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600cbcb0 con 0x7f22600d0a80 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.530+0000 7f2264b49640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 0x7f22601555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f225f7fe640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f224800c7f0 tx=0x7f224800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248015070 con 0x7f22600d0a80 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248004220 con 0x7f22600d0a80 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22600c9470 con 0x7f22600d0a80 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248007620 con 0x7f22600d0a80 2024-03-04T08:51:41.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.531+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22600c9d10 con 0x7f22600d0a80 2024-03-04T08:51:41.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.532+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22600c9860 con 0x7f22600d0a80 2024-03-04T08:51:41.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.532+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22480079d0 con 0x7f22600d0a80 2024-03-04T08:51:41.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.533+0000 7f225cff9640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 0x7f224006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.533+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f224808a4a0 con 0x7f22600d0a80 2024-03-04T08:51:41.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.533+0000 7f225ffff640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 0x7f224006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.533+0000 7f225ffff640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 0x7f224006d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2250004ea0 tx=0x7f2250009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.537+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f22600cbcb0 con 0x7f22600d0a80 2024-03-04T08:51:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.714+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f226004f330 con 0x7f224006b4d0 2024-03-04T08:51:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.720+0000 7f225cff9640 1 -- 172.21.15.19:0/2880338832 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247984 (secure 0 0 0) 0x7f226004f330 con 0x7f224006b4d0 2024-03-04T08:51:41.719 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:51:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 msgr2=0x7f224006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 0x7f224006d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2250004ea0 tx=0x7f2250009040 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 msgr2=0x7f22600b8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f224800c7f0 tx=0x7f224800ccb0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 shutdown_connections 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22600b9490 0x7f22601555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22600d0a80 0x7f22600b8f50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f224006b4d0 0x7f224006d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 --2- 172.21.15.19:0/2880338832 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22600b4170 0x7f22601f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.723+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 >> 172.21.15.19:0/2880338832 conn(0x7f22600d3c40 msgr2=0x7f22600d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.724+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 shutdown_connections 2024-03-04T08:51:41.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.724+0000 7f22665ac640 1 -- 172.21.15.19:0/2880338832 wait complete. 2024-03-04T08:51:41.731 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-03-04T08:51:41.150850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224296,"kb_used_data":3972,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750424,"statfs":{"total":773094113280,"available":772864434176,"internally_reserved":0,"allocated":4067328,"data_stored":2288213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.304059"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851882+0000","last_change":"2024-03-04T08:51:36.851882+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851882+0000","last_undegraded":"2024-03-04T08:51:36.851882+0000","last_fullsized":"2024-03-04T08:51:36.851882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.855551+0000","last_change":"2024-03-04T08:51:36.855551+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.855551+0000","last_undegraded":"2024-03-04T08:51:36.855551+0000","last_fullsized":"2024-03-04T08:51:36.855551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856522+0000","last_change":"2024-03-04T08:51:36.856522+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856522+0000","last_undegraded":"2024-03-04T08:51:36.856522+0000","last_fullsized":"2024-03-04T08:51:36.856522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872827+0000","last_change":"2024-03-04T08:51:37.876460+0000","last_active":"2024-03-04T08:51:38.872827+0000","last_peered":"2024-03-04T08:51:38.872827+0000","last_clean":"2024-03-04T08:51:38.872827+0000","last_became_active":"2024-03-04T08:51:37.876191+0000","last_became_peered":"2024-03-04T08:51:37.876191+0000","last_unstale":"2024-03-04T08:51:38.872827+0000","last_undegraded":"2024-03-04T08:51:38.872827+0000","last_fullsized":"2024-03-04T08:51:38.872827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849733+0000","last_change":"2024-03-04T08:51:36.849733+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849733+0000","last_undegraded":"2024-03-04T08:51:36.849733+0000","last_fullsized":"2024-03-04T08:51:36.849733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853415+0000","last_change":"2024-03-04T08:51:36.853415+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853415+0000","last_undegraded":"2024-03-04T08:51:36.853415+0000","last_fullsized":"2024-03-04T08:51:36.853415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851133+0000","last_change":"2024-03-04T08:51:36.851133+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851133+0000","last_undegraded":"2024-03-04T08:51:36.851133+0000","last_fullsized":"2024-03-04T08:51:36.851133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854292+0000","last_change":"2024-03-04T08:51:36.854292+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854292+0000","last_undegraded":"2024-03-04T08:51:36.854292+0000","last_fullsized":"2024-03-04T08:51:36.854292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392010+0000","last_change":"2024-03-04T08:51:37.871847+0000","last_active":"2024-03-04T08:51:39.392010+0000","last_peered":"2024-03-04T08:51:39.392010+0000","last_clean":"2024-03-04T08:51:39.392010+0000","last_became_active":"2024-03-04T08:51:37.871513+0000","last_became_peered":"2024-03-04T08:51:37.871513+0000","last_unstale":"2024-03-04T08:51:39.392010+0000","last_undegraded":"2024-03-04T08:51:39.392010+0000","last_fullsized":"2024-03-04T08:51:39.392010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872958+0000","last_change":"2024-03-04T08:51:37.881764+0000","last_active":"2024-03-04T08:51:38.872958+0000","last_peered":"2024-03-04T08:51:38.872958+0000","last_clean":"2024-03-04T08:51:38.872958+0000","last_became_active":"2024-03-04T08:51:37.881212+0000","last_became_peered":"2024-03-04T08:51:37.881212+0000","last_unstale":"2024-03-04T08:51:38.872958+0000","last_undegraded":"2024-03-04T08:51:38.872958+0000","last_fullsized":"2024-03-04T08:51:38.872958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852280+0000","last_change":"2024-03-04T08:51:36.852280+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852280+0000","last_undegraded":"2024-03-04T08:51:36.852280+0000","last_fullsized":"2024-03-04T08:51:36.852280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852023+0000","last_change":"2024-03-04T08:51:36.852023+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852023+0000","last_undegraded":"2024-03-04T08:51:36.852023+0000","last_fullsized":"2024-03-04T08:51:36.852023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849264+0000","last_change":"2024-03-04T08:51:36.849264+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849264+0000","last_undegraded":"2024-03-04T08:51:36.849264+0000","last_fullsized":"2024-03-04T08:51:36.849264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852951+0000","last_change":"2024-03-04T08:51:36.852951+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852951+0000","last_undegraded":"2024-03-04T08:51:36.852951+0000","last_fullsized":"2024-03-04T08:51:36.852951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851474+0000","last_change":"2024-03-04T08:51:36.851474+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851474+0000","last_undegraded":"2024-03-04T08:51:36.851474+0000","last_fullsized":"2024-03-04T08:51:36.851474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852676+0000","last_change":"2024-03-04T08:51:36.852676+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852676+0000","last_undegraded":"2024-03-04T08:51:36.852676+0000","last_fullsized":"2024-03-04T08:51:36.852676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854691+0000","last_change":"2024-03-04T08:51:36.854691+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854691+0000","last_undegraded":"2024-03-04T08:51:36.854691+0000","last_fullsized":"2024-03-04T08:51:36.854691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853301+0000","last_change":"2024-03-04T08:51:36.853301+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853301+0000","last_undegraded":"2024-03-04T08:51:36.853301+0000","last_fullsized":"2024-03-04T08:51:36.853301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854968+0000","last_change":"2024-03-04T08:51:36.854968+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854968+0000","last_undegraded":"2024-03-04T08:51:36.854968+0000","last_fullsized":"2024-03-04T08:51:36.854968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848904+0000","last_change":"2024-03-04T08:51:36.848904+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848904+0000","last_undegraded":"2024-03-04T08:51:36.848904+0000","last_fullsized":"2024-03-04T08:51:36.848904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392188+0000","last_change":"2024-03-04T08:51:37.872571+0000","last_active":"2024-03-04T08:51:39.392188+0000","last_peered":"2024-03-04T08:51:39.392188+0000","last_clean":"2024-03-04T08:51:39.392188+0000","last_became_active":"2024-03-04T08:51:37.871862+0000","last_became_peered":"2024-03-04T08:51:37.871862+0000","last_unstale":"2024-03-04T08:51:39.392188+0000","last_undegraded":"2024-03-04T08:51:39.392188+0000","last_fullsized":"2024-03-04T08:51:39.392188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391611+0000","last_change":"2024-03-04T08:51:37.873090+0000","last_active":"2024-03-04T08:51:39.391611+0000","last_peered":"2024-03-04T08:51:39.391611+0000","last_clean":"2024-03-04T08:51:39.391611+0000","last_became_active":"2024-03-04T08:51:37.872648+0000","last_became_peered":"2024-03-04T08:51:37.872648+0000","last_unstale":"2024-03-04T08:51:39.391611+0000","last_undegraded":"2024-03-04T08:51:39.391611+0000","last_fullsized":"2024-03-04T08:51:39.391611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850730+0000","last_change":"2024-03-04T08:51:36.850730+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850730+0000","last_undegraded":"2024-03-04T08:51:36.850730+0000","last_fullsized":"2024-03-04T08:51:36.850730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853677+0000","last_change":"2024-03-04T08:51:36.853677+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853677+0000","last_undegraded":"2024-03-04T08:51:36.853677+0000","last_fullsized":"2024-03-04T08:51:36.853677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873039+0000","last_change":"2024-03-04T08:51:37.873138+0000","last_active":"2024-03-04T08:51:38.873039+0000","last_peered":"2024-03-04T08:51:38.873039+0000","last_clean":"2024-03-04T08:51:38.873039+0000","last_became_active":"2024-03-04T08:51:37.872797+0000","last_became_peered":"2024-03-04T08:51:37.872797+0000","last_unstale":"2024-03-04T08:51:38.873039+0000","last_undegraded":"2024-03-04T08:51:38.873039+0000","last_fullsized":"2024-03-04T08:51:38.873039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849302+0000","last_change":"2024-03-04T08:51:36.849302+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849302+0000","last_undegraded":"2024-03-04T08:51:36.849302+0000","last_fullsized":"2024-03-04T08:51:36.849302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873131+0000","last_change":"2024-03-04T08:51:37.874965+0000","last_active":"2024-03-04T08:51:38.873131+0000","last_peered":"2024-03-04T08:51:38.873131+0000","last_clean":"2024-03-04T08:51:38.873131+0000","last_became_active":"2024-03-04T08:51:37.874674+0000","last_became_peered":"2024-03-04T08:51:37.874674+0000","last_unstale":"2024-03-04T08:51:38.873131+0000","last_undegraded":"2024-03-04T08:51:38.873131+0000","last_fullsized":"2024-03-04T08:51:38.873131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:42.266540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851600+0000","last_change":"2024-03-04T08:51:36.851600+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851600+0000","last_undegraded":"2024-03-04T08:51:36.851600+0000","last_fullsized":"2024-03-04T08:51:36.851600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392332+0000","last_change":"2024-03-04T08:51:37.870986+0000","last_active":"2024-03-04T08:51:39.392332+0000","last_peered":"2024-03-04T08:51:39.392332+0000","last_clean":"2024-03-04T08:51:39.392332+0000","last_became_active":"2024-03-04T08:51:37.870677+0000","last_became_peered":"2024-03-04T08:51:37.870677+0000","last_unstale":"2024-03-04T08:51:39.392332+0000","last_undegraded":"2024-03-04T08:51:39.392332+0000","last_fullsized":"2024-03-04T08:51:39.392332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853205+0000","last_change":"2024-03-04T08:51:36.853205+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853205+0000","last_undegraded":"2024-03-04T08:51:36.853205+0000","last_fullsized":"2024-03-04T08:51:36.853205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851067+0000","last_change":"2024-03-04T08:51:36.851067+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851067+0000","last_undegraded":"2024-03-04T08:51:36.851067+0000","last_fullsized":"2024-03-04T08:51:36.851067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853910+0000","last_change":"2024-03-04T08:51:36.853910+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853910+0000","last_undegraded":"2024-03-04T08:51:36.853910+0000","last_fullsized":"2024-03-04T08:51:36.853910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851966+0000","last_change":"2024-03-04T08:51:36.851966+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851966+0000","last_undegraded":"2024-03-04T08:51:36.851966+0000","last_fullsized":"2024-03-04T08:51:36.851966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862822+0000","last_change":"2024-03-04T08:51:36.861353+0000","last_active":"2024-03-04T08:51:36.862822+0000","last_peered":"2024-03-04T08:51:36.862822+0000","last_clean":"2024-03-04T08:51:36.862822+0000","last_became_active":"2024-03-04T08:51:36.861087+0000","last_became_peered":"2024-03-04T08:51:36.861087+0000","last_unstale":"2024-03-04T08:51:36.862822+0000","last_undegraded":"2024-03-04T08:51:36.862822+0000","last_fullsized":"2024-03-04T08:51:36.862822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851451+0000","last_change":"2024-03-04T08:51:36.851451+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851451+0000","last_undegraded":"2024-03-04T08:51:36.851451+0000","last_fullsized":"2024-03-04T08:51:36.851451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865235+0000","last_change":"2024-03-04T08:51:36.862187+0000","last_active":"2024-03-04T08:51:36.865235+0000","last_peered":"2024-03-04T08:51:36.865235+0000","last_clean":"2024-03-04T08:51:36.865235+0000","last_became_active":"2024-03-04T08:51:36.861833+0000","last_became_peered":"2024-03-04T08:51:36.861833+0000","last_unstale":"2024-03-04T08:51:36.865235+0000","last_undegraded":"2024-03-04T08:51:36.865235+0000","last_fullsized":"2024-03-04T08:51:36.865235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392416+0000","last_change":"2024-03-04T08:51:37.880138+0000","last_active":"2024-03-04T08:51:39.392416+0000","last_peered":"2024-03-04T08:51:39.392416+0000","last_clean":"2024-03-04T08:51:39.392416+0000","last_became_active":"2024-03-04T08:51:37.879016+0000","last_became_peered":"2024-03-04T08:51:37.879016+0000","last_unstale":"2024-03-04T08:51:39.392416+0000","last_undegraded":"2024-03-04T08:51:39.392416+0000","last_fullsized":"2024-03-04T08:51:39.392416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871917+0000","last_change":"2024-03-04T08:51:36.867819+0000","last_active":"2024-03-04T08:51:36.871917+0000","last_peered":"2024-03-04T08:51:36.871917+0000","last_clean":"2024-03-04T08:51:36.871917+0000","last_became_active":"2024-03-04T08:51:36.867496+0000","last_became_peered":"2024-03-04T08:51:36.867496+0000","last_unstale":"2024-03-04T08:51:36.871917+0000","last_undegraded":"2024-03-04T08:51:36.871917+0000","last_fullsized":"2024-03-04T08:51:36.871917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:09.770388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873129+0000","last_change":"2024-03-04T08:51:37.873799+0000","last_active":"2024-03-04T08:51:38.873129+0000","last_peered":"2024-03-04T08:51:38.873129+0000","last_clean":"2024-03-04T08:51:38.873129+0000","last_became_active":"2024-03-04T08:51:37.873368+0000","last_became_peered":"2024-03-04T08:51:37.873368+0000","last_unstale":"2024-03-04T08:51:38.873129+0000","last_undegraded":"2024-03-04T08:51:38.873129+0000","last_fullsized":"2024-03-04T08:51:38.873129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869520+0000","last_change":"2024-03-04T08:51:36.865647+0000","last_active":"2024-03-04T08:51:36.869520+0000","last_peered":"2024-03-04T08:51:36.869520+0000","last_clean":"2024-03-04T08:51:36.869520+0000","last_became_active":"2024-03-04T08:51:36.865371+0000","last_became_peered":"2024-03-04T08:51:36.865371+0000","last_unstale":"2024-03-04T08:51:36.869520+0000","last_undegraded":"2024-03-04T08:51:36.869520+0000","last_fullsized":"2024-03-04T08:51:36.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.190641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851249+0000","last_change":"2024-03-04T08:51:36.851249+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851249+0000","last_undegraded":"2024-03-04T08:51:36.851249+0000","last_fullsized":"2024-03-04T08:51:36.851249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392295+0000","last_change":"2024-03-04T08:51:36.859075+0000","last_active":"2024-03-04T08:51:39.392295+0000","last_peered":"2024-03-04T08:51:39.392295+0000","last_clean":"2024-03-04T08:51:39.392295+0000","last_became_active":"2024-03-04T08:51:36.858824+0000","last_became_peered":"2024-03-04T08:51:36.858824+0000","last_unstale":"2024-03-04T08:51:39.392295+0000","last_undegraded":"2024-03-04T08:51:39.392295+0000","last_fullsized":"2024-03-04T08:51:39.392295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:07.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854244+0000","last_change":"2024-03-04T08:51:36.854244+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854244+0000","last_undegraded":"2024-03-04T08:51:36.854244+0000","last_fullsized":"2024-03-04T08:51:36.854244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391740+0000","last_change":"2024-03-04T08:51:36.859719+0000","last_active":"2024-03-04T08:51:39.391740+0000","last_peered":"2024-03-04T08:51:39.391740+0000","last_clean":"2024-03-04T08:51:39.391740+0000","last_became_active":"2024-03-04T08:51:36.859453+0000","last_became_peered":"2024-03-04T08:51:36.859453+0000","last_unstale":"2024-03-04T08:51:39.391740+0000","last_undegraded":"2024-03-04T08:51:39.391740+0000","last_fullsized":"2024-03-04T08:51:39.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391315+0000","last_change":"2024-03-04T08:51:37.864891+0000","last_active":"2024-03-04T08:51:39.391315+0000","last_peered":"2024-03-04T08:51:39.391315+0000","last_clean":"2024-03-04T08:51:39.391315+0000","last_became_active":"2024-03-04T08:51:37.864575+0000","last_became_peered":"2024-03-04T08:51:37.864575+0000","last_unstale":"2024-03-04T08:51:39.391315+0000","last_undegraded":"2024-03-04T08:51:39.391315+0000","last_fullsized":"2024-03-04T08:51:39.391315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:41.263175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866959+0000","last_change":"2024-03-04T08:51:36.862686+0000","last_active":"2024-03-04T08:51:36.866959+0000","last_peered":"2024-03-04T08:51:36.866959+0000","last_clean":"2024-03-04T08:51:36.866959+0000","last_became_active":"2024-03-04T08:51:36.862384+0000","last_became_peered":"2024-03-04T08:51:36.862384+0000","last_unstale":"2024-03-04T08:51:36.866959+0000","last_undegraded":"2024-03-04T08:51:36.866959+0000","last_fullsized":"2024-03-04T08:51:36.866959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872573+0000","last_change":"2024-03-04T08:51:37.870071+0000","last_active":"2024-03-04T08:51:38.872573+0000","last_peered":"2024-03-04T08:51:38.872573+0000","last_clean":"2024-03-04T08:51:38.872573+0000","last_became_active":"2024-03-04T08:51:37.869797+0000","last_became_peered":"2024-03-04T08:51:37.869797+0000","last_unstale":"2024-03-04T08:51:38.872573+0000","last_undegraded":"2024-03-04T08:51:38.872573+0000","last_fullsized":"2024-03-04T08:51:38.872573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391413+0000","last_change":"2024-03-04T08:51:36.862238+0000","last_active":"2024-03-04T08:51:39.391413+0000","last_peered":"2024-03-04T08:51:39.391413+0000","last_clean":"2024-03-04T08:51:39.391413+0000","last_became_active":"2024-03-04T08:51:36.861973+0000","last_became_peered":"2024-03-04T08:51:36.861973+0000","last_unstale":"2024-03-04T08:51:39.391413+0000","last_undegraded":"2024-03-04T08:51:39.391413+0000","last_fullsized":"2024-03-04T08:51:39.391413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850953+0000","last_change":"2024-03-04T08:51:36.850953+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850953+0000","last_undegraded":"2024-03-04T08:51:36.850953+0000","last_fullsized":"2024-03-04T08:51:36.850953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866739+0000","last_change":"2024-03-04T08:51:36.863469+0000","last_active":"2024-03-04T08:51:36.866739+0000","last_peered":"2024-03-04T08:51:36.866739+0000","last_clean":"2024-03-04T08:51:36.866739+0000","last_became_active":"2024-03-04T08:51:36.863185+0000","last_became_peered":"2024-03-04T08:51:36.863185+0000","last_unstale":"2024-03-04T08:51:36.866739+0000","last_undegraded":"2024-03-04T08:51:36.866739+0000","last_fullsized":"2024-03-04T08:51:36.866739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:59.155097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849769+0000","last_change":"2024-03-04T08:51:36.849769+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849769+0000","last_undegraded":"2024-03-04T08:51:36.849769+0000","last_fullsized":"2024-03-04T08:51:36.849769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866542+0000","last_change":"2024-03-04T08:51:36.864814+0000","last_active":"2024-03-04T08:51:36.866542+0000","last_peered":"2024-03-04T08:51:36.866542+0000","last_clean":"2024-03-04T08:51:36.866542+0000","last_became_active":"2024-03-04T08:51:36.864469+0000","last_became_peered":"2024-03-04T08:51:36.864469+0000","last_unstale":"2024-03-04T08:51:36.866542+0000","last_undegraded":"2024-03-04T08:51:36.866542+0000","last_fullsized":"2024-03-04T08:51:36.866542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:19.377354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851463+0000","last_change":"2024-03-04T08:51:36.851463+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851463+0000","last_undegraded":"2024-03-04T08:51:36.851463+0000","last_fullsized":"2024-03-04T08:51:36.851463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865646+0000","last_change":"2024-03-04T08:51:36.862948+0000","last_active":"2024-03-04T08:51:36.865646+0000","last_peered":"2024-03-04T08:51:36.865646+0000","last_clean":"2024-03-04T08:51:36.865646+0000","last_became_active":"2024-03-04T08:51:36.862660+0000","last_became_peered":"2024-03-04T08:51:36.862660+0000","last_unstale":"2024-03-04T08:51:36.865646+0000","last_undegraded":"2024-03-04T08:51:36.865646+0000","last_fullsized":"2024-03-04T08:51:36.865646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:41.411669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856927+0000","last_change":"2024-03-04T08:51:36.856927+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856927+0000","last_undegraded":"2024-03-04T08:51:36.856927+0000","last_fullsized":"2024-03-04T08:51:36.856927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871913+0000","last_change":"2024-03-04T08:51:36.868052+0000","last_active":"2024-03-04T08:51:36.871913+0000","last_peered":"2024-03-04T08:51:36.871913+0000","last_clean":"2024-03-04T08:51:36.871913+0000","last_became_active":"2024-03-04T08:51:36.867386+0000","last_became_peered":"2024-03-04T08:51:36.867386+0000","last_unstale":"2024-03-04T08:51:36.871913+0000","last_undegraded":"2024-03-04T08:51:36.871913+0000","last_fullsized":"2024-03-04T08:51:36.871913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:34.678540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872657+0000","last_change":"2024-03-04T08:51:37.874458+0000","last_active":"2024-03-04T08:51:38.872657+0000","last_peered":"2024-03-04T08:51:38.872657+0000","last_clean":"2024-03-04T08:51:38.872657+0000","last_became_active":"2024-03-04T08:51:37.873503+0000","last_became_peered":"2024-03-04T08:51:37.873503+0000","last_unstale":"2024-03-04T08:51:38.872657+0000","last_undegraded":"2024-03-04T08:51:38.872657+0000","last_fullsized":"2024-03-04T08:51:38.872657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392385+0000","last_change":"2024-03-04T08:51:36.862148+0000","last_active":"2024-03-04T08:51:39.392385+0000","last_peered":"2024-03-04T08:51:39.392385+0000","last_clean":"2024-03-04T08:51:39.392385+0000","last_became_active":"2024-03-04T08:51:36.861872+0000","last_became_peered":"2024-03-04T08:51:36.861872+0000","last_unstale":"2024-03-04T08:51:39.392385+0000","last_undegraded":"2024-03-04T08:51:39.392385+0000","last_fullsized":"2024-03-04T08:51:39.392385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850238+0000","last_change":"2024-03-04T08:51:36.850238+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850238+0000","last_undegraded":"2024-03-04T08:51:36.850238+0000","last_fullsized":"2024-03-04T08:51:36.850238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872609+0000","last_change":"2024-03-04T08:51:36.865777+0000","last_active":"2024-03-04T08:51:38.872609+0000","last_peered":"2024-03-04T08:51:38.872609+0000","last_clean":"2024-03-04T08:51:38.872609+0000","last_became_active":"2024-03-04T08:51:36.865481+0000","last_became_peered":"2024-03-04T08:51:36.865481+0000","last_unstale":"2024-03-04T08:51:38.872609+0000","last_undegraded":"2024-03-04T08:51:38.872609+0000","last_fullsized":"2024-03-04T08:51:38.872609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853446+0000","last_change":"2024-03-04T08:51:36.853446+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853446+0000","last_undegraded":"2024-03-04T08:51:36.853446+0000","last_fullsized":"2024-03-04T08:51:36.853446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869295+0000","last_change":"2024-03-04T08:51:36.863744+0000","last_active":"2024-03-04T08:51:36.869295+0000","last_peered":"2024-03-04T08:51:36.869295+0000","last_clean":"2024-03-04T08:51:36.869295+0000","last_became_active":"2024-03-04T08:51:36.863042+0000","last_became_peered":"2024-03-04T08:51:36.863042+0000","last_unstale":"2024-03-04T08:51:36.869295+0000","last_undegraded":"2024-03-04T08:51:36.869295+0000","last_fullsized":"2024-03-04T08:51:36.869295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:00.889514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850605+0000","last_change":"2024-03-04T08:51:36.850605+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850605+0000","last_undegraded":"2024-03-04T08:51:36.850605+0000","last_fullsized":"2024-03-04T08:51:36.850605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871938+0000","last_change":"2024-03-04T08:51:36.868568+0000","last_active":"2024-03-04T08:51:36.871938+0000","last_peered":"2024-03-04T08:51:36.871938+0000","last_clean":"2024-03-04T08:51:36.871938+0000","last_became_active":"2024-03-04T08:51:36.868032+0000","last_became_peered":"2024-03-04T08:51:36.868032+0000","last_unstale":"2024-03-04T08:51:36.871938+0000","last_undegraded":"2024-03-04T08:51:36.871938+0000","last_fullsized":"2024-03-04T08:51:36.871938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:55.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392029+0000","last_change":"2024-03-04T08:51:37.870420+0000","last_active":"2024-03-04T08:51:39.392029+0000","last_peered":"2024-03-04T08:51:39.392029+0000","last_clean":"2024-03-04T08:51:39.392029+0000","last_became_active":"2024-03-04T08:51:37.870140+0000","last_became_peered":"2024-03-04T08:51:37.870140+0000","last_unstale":"2024-03-04T08:51:39.392029+0000","last_undegraded":"2024-03-04T08:51:39.392029+0000","last_fullsized":"2024-03-04T08:51:39.392029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873118+0000","last_change":"2024-03-04T08:51:36.865246+0000","last_active":"2024-03-04T08:51:38.873118+0000","last_peered":"2024-03-04T08:51:38.873118+0000","last_clean":"2024-03-04T08:51:38.873118+0000","last_became_active":"2024-03-04T08:51:36.864608+0000","last_became_peered":"2024-03-04T08:51:36.864608+0000","last_unstale":"2024-03-04T08:51:38.873118+0000","last_undegraded":"2024-03-04T08:51:38.873118+0000","last_fullsized":"2024-03-04T08:51:38.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852871+0000","last_change":"2024-03-04T08:51:36.852871+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852871+0000","last_undegraded":"2024-03-04T08:51:36.852871+0000","last_fullsized":"2024-03-04T08:51:36.852871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392143+0000","last_change":"2024-03-04T08:51:36.857891+0000","last_active":"2024-03-04T08:51:39.392143+0000","last_peered":"2024-03-04T08:51:39.392143+0000","last_clean":"2024-03-04T08:51:39.392143+0000","last_became_active":"2024-03-04T08:51:36.857296+0000","last_became_peered":"2024-03-04T08:51:36.857296+0000","last_unstale":"2024-03-04T08:51:39.392143+0000","last_undegraded":"2024-03-04T08:51:39.392143+0000","last_fullsized":"2024-03-04T08:51:39.392143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872861+0000","last_change":"2024-03-04T08:51:37.874163+0000","last_active":"2024-03-04T08:51:38.872861+0000","last_peered":"2024-03-04T08:51:38.872861+0000","last_clean":"2024-03-04T08:51:38.872861+0000","last_became_active":"2024-03-04T08:51:37.873895+0000","last_became_peered":"2024-03-04T08:51:37.873895+0000","last_unstale":"2024-03-04T08:51:38.872861+0000","last_undegraded":"2024-03-04T08:51:38.872861+0000","last_fullsized":"2024-03-04T08:51:38.872861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391964+0000","last_change":"2024-03-04T08:51:36.857464+0000","last_active":"2024-03-04T08:51:39.391964+0000","last_peered":"2024-03-04T08:51:39.391964+0000","last_clean":"2024-03-04T08:51:39.391964+0000","last_became_active":"2024-03-04T08:51:36.857197+0000","last_became_peered":"2024-03-04T08:51:36.857197+0000","last_unstale":"2024-03-04T08:51:39.391964+0000","last_undegraded":"2024-03-04T08:51:39.391964+0000","last_fullsized":"2024-03-04T08:51:39.391964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848323+0000","last_change":"2024-03-04T08:51:36.848323+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848323+0000","last_undegraded":"2024-03-04T08:51:36.848323+0000","last_fullsized":"2024-03-04T08:51:36.848323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392398+0000","last_change":"2024-03-04T08:51:36.861233+0000","last_active":"2024-03-04T08:51:39.392398+0000","last_peered":"2024-03-04T08:51:39.392398+0000","last_clean":"2024-03-04T08:51:39.392398+0000","last_became_active":"2024-03-04T08:51:36.860828+0000","last_became_peered":"2024-03-04T08:51:36.860828+0000","last_unstale":"2024-03-04T08:51:39.392398+0000","last_undegraded":"2024-03-04T08:51:39.392398+0000","last_fullsized":"2024-03-04T08:51:39.392398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:27.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848414+0000","last_change":"2024-03-04T08:51:36.848414+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848414+0000","last_undegraded":"2024-03-04T08:51:36.848414+0000","last_fullsized":"2024-03-04T08:51:36.848414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871856+0000","last_change":"2024-03-04T08:51:36.868118+0000","last_active":"2024-03-04T08:51:36.871856+0000","last_peered":"2024-03-04T08:51:36.871856+0000","last_clean":"2024-03-04T08:51:36.871856+0000","last_became_active":"2024-03-04T08:51:36.867809+0000","last_became_peered":"2024-03-04T08:51:36.867809+0000","last_unstale":"2024-03-04T08:51:36.871856+0000","last_undegraded":"2024-03-04T08:51:36.871856+0000","last_fullsized":"2024-03-04T08:51:36.871856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848307+0000","last_change":"2024-03-04T08:51:36.848307+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848307+0000","last_undegraded":"2024-03-04T08:51:36.848307+0000","last_fullsized":"2024-03-04T08:51:36.848307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.868481+0000","last_change":"2024-03-04T08:51:36.867341+0000","last_active":"2024-03-04T08:51:36.868481+0000","last_peered":"2024-03-04T08:51:36.868481+0000","last_clean":"2024-03-04T08:51:36.868481+0000","last_became_active":"2024-03-04T08:51:36.867060+0000","last_became_peered":"2024-03-04T08:51:36.867060+0000","last_unstale":"2024-03-04T08:51:36.868481+0000","last_undegraded":"2024-03-04T08:51:36.868481+0000","last_fullsized":"2024-03-04T08:51:36.868481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848681+0000","last_change":"2024-03-04T08:51:36.848681+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848681+0000","last_undegraded":"2024-03-04T08:51:36.848681+0000","last_fullsized":"2024-03-04T08:51:36.848681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392166+0000","last_change":"2024-03-04T08:51:36.864921+0000","last_active":"2024-03-04T08:51:39.392166+0000","last_peered":"2024-03-04T08:51:39.392166+0000","last_clean":"2024-03-04T08:51:39.392166+0000","last_became_active":"2024-03-04T08:51:36.864722+0000","last_became_peered":"2024-03-04T08:51:36.864722+0000","last_unstale":"2024-03-04T08:51:39.392166+0000","last_undegraded":"2024-03-04T08:51:39.392166+0000","last_fullsized":"2024-03-04T08:51:39.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:29.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851736+0000","last_change":"2024-03-04T08:51:36.851736+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851736+0000","last_undegraded":"2024-03-04T08:51:36.851736+0000","last_fullsized":"2024-03-04T08:51:36.851736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865623+0000","last_change":"2024-03-04T08:51:36.862821+0000","last_active":"2024-03-04T08:51:36.865623+0000","last_peered":"2024-03-04T08:51:36.865623+0000","last_clean":"2024-03-04T08:51:36.865623+0000","last_became_active":"2024-03-04T08:51:36.862503+0000","last_became_peered":"2024-03-04T08:51:36.862503+0000","last_unstale":"2024-03-04T08:51:36.865623+0000","last_undegraded":"2024-03-04T08:51:36.865623+0000","last_fullsized":"2024-03-04T08:51:36.865623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:43.796665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848160+0000","last_change":"2024-03-04T08:51:36.848160+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848160+0000","last_undegraded":"2024-03-04T08:51:36.848160+0000","last_fullsized":"2024-03-04T08:51:36.848160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873140+0000","last_change":"2024-03-04T08:51:36.865400+0000","last_active":"2024-03-04T08:51:38.873140+0000","last_peered":"2024-03-04T08:51:38.873140+0000","last_clean":"2024-03-04T08:51:38.873140+0000","last_became_active":"2024-03-04T08:51:36.864934+0000","last_became_peered":"2024-03-04T08:51:36.864934+0000","last_unstale":"2024-03-04T08:51:38.873140+0000","last_undegraded":"2024-03-04T08:51:38.873140+0000","last_fullsized":"2024-03-04T08:51:38.873140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852471+0000","last_change":"2024-03-04T08:51:36.852471+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852471+0000","last_undegraded":"2024-03-04T08:51:36.852471+0000","last_fullsized":"2024-03-04T08:51:36.852471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871826+0000","last_change":"2024-03-04T08:51:36.867678+0000","last_active":"2024-03-04T08:51:36.871826+0000","last_peered":"2024-03-04T08:51:36.871826+0000","last_clean":"2024-03-04T08:51:36.871826+0000","last_became_active":"2024-03-04T08:51:36.867357+0000","last_became_peered":"2024-03-04T08:51:36.867357+0000","last_unstale":"2024-03-04T08:51:36.871826+0000","last_undegraded":"2024-03-04T08:51:36.871826+0000","last_fullsized":"2024-03-04T08:51:36.871826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:25.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850242+0000","last_change":"2024-03-04T08:51:36.850242+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850242+0000","last_undegraded":"2024-03-04T08:51:36.850242+0000","last_fullsized":"2024-03-04T08:51:36.850242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872982+0000","last_change":"2024-03-04T08:51:36.864963+0000","last_active":"2024-03-04T08:51:38.872982+0000","last_peered":"2024-03-04T08:51:38.872982+0000","last_clean":"2024-03-04T08:51:38.872982+0000","last_became_active":"2024-03-04T08:51:36.864629+0000","last_became_peered":"2024-03-04T08:51:36.864629+0000","last_unstale":"2024-03-04T08:51:38.872982+0000","last_undegraded":"2024-03-04T08:51:38.872982+0000","last_fullsized":"2024-03-04T08:51:38.872982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:19.925101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851010+0000","last_change":"2024-03-04T08:51:36.851010+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851010+0000","last_undegraded":"2024-03-04T08:51:36.851010+0000","last_fullsized":"2024-03-04T08:51:36.851010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.863992+0000","last_change":"2024-03-04T08:51:36.859342+0000","last_active":"2024-03-04T08:51:36.863992+0000","last_peered":"2024-03-04T08:51:36.863992+0000","last_clean":"2024-03-04T08:51:36.863992+0000","last_became_active":"2024-03-04T08:51:36.859042+0000","last_became_peered":"2024-03-04T08:51:36.859042+0000","last_unstale":"2024-03-04T08:51:36.863992+0000","last_undegraded":"2024-03-04T08:51:36.863992+0000","last_fullsized":"2024-03-04T08:51:36.863992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850933+0000","last_change":"2024-03-04T08:51:36.850933+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850933+0000","last_undegraded":"2024-03-04T08:51:36.850933+0000","last_fullsized":"2024-03-04T08:51:36.850933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872707+0000","last_change":"2024-03-04T08:51:36.865216+0000","last_active":"2024-03-04T08:51:38.872707+0000","last_peered":"2024-03-04T08:51:38.872707+0000","last_clean":"2024-03-04T08:51:38.872707+0000","last_became_active":"2024-03-04T08:51:36.864887+0000","last_became_peered":"2024-03-04T08:51:36.864887+0000","last_unstale":"2024-03-04T08:51:38.872707+0000","last_undegraded":"2024-03-04T08:51:38.872707+0000","last_fullsized":"2024-03-04T08:51:38.872707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850453+0000","last_change":"2024-03-04T08:51:36.850453+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850453+0000","last_undegraded":"2024-03-04T08:51:36.850453+0000","last_fullsized":"2024-03-04T08:51:36.850453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392225+0000","last_change":"2024-03-04T08:51:36.856581+0000","last_active":"2024-03-04T08:51:39.392225+0000","last_peered":"2024-03-04T08:51:39.392225+0000","last_clean":"2024-03-04T08:51:39.392225+0000","last_became_active":"2024-03-04T08:51:36.856288+0000","last_became_peered":"2024-03-04T08:51:36.856288+0000","last_unstale":"2024-03-04T08:51:39.392225+0000","last_undegraded":"2024-03-04T08:51:39.392225+0000","last_fullsized":"2024-03-04T08:51:39.392225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:53.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392092+0000","last_change":"2024-03-04T08:51:37.872745+0000","last_active":"2024-03-04T08:51:39.392092+0000","last_peered":"2024-03-04T08:51:39.392092+0000","last_clean":"2024-03-04T08:51:39.392092+0000","last_became_active":"2024-03-04T08:51:37.872463+0000","last_became_peered":"2024-03-04T08:51:37.872463+0000","last_unstale":"2024-03-04T08:51:39.392092+0000","last_undegraded":"2024-03-04T08:51:39.392092+0000","last_fullsized":"2024-03-04T08:51:39.392092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866704+0000","last_change":"2024-03-04T08:51:36.863377+0000","last_active":"2024-03-04T08:51:36.866704+0000","last_peered":"2024-03-04T08:51:36.866704+0000","last_clean":"2024-03-04T08:51:36.866704+0000","last_became_active":"2024-03-04T08:51:36.863028+0000","last_became_peered":"2024-03-04T08:51:36.863028+0000","last_unstale":"2024-03-04T08:51:36.866704+0000","last_undegraded":"2024-03-04T08:51:36.866704+0000","last_fullsized":"2024-03-04T08:51:36.866704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:24.983053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851177+0000","last_change":"2024-03-04T08:51:36.851177+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851177+0000","last_undegraded":"2024-03-04T08:51:36.851177+0000","last_fullsized":"2024-03-04T08:51:36.851177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862743+0000","last_change":"2024-03-04T08:51:36.861136+0000","last_active":"2024-03-04T08:51:36.862743+0000","last_peered":"2024-03-04T08:51:36.862743+0000","last_clean":"2024-03-04T08:51:36.862743+0000","last_became_active":"2024-03-04T08:51:36.860816+0000","last_became_peered":"2024-03-04T08:51:36.860816+0000","last_unstale":"2024-03-04T08:51:36.862743+0000","last_undegraded":"2024-03-04T08:51:36.862743+0000","last_fullsized":"2024-03-04T08:51:36.862743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:37:05.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.854496+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:51:36.854496+0000","last_peered":"2024-03-04T08:51:36.854496+0000","last_clean":"2024-03-04T08:51:36.854496+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:51:36.854496+0000","last_undegraded":"2024-03-04T08:51:36.854496+0000","last_fullsized":"2024-03-04T08:51:36.854496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":726100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:51:41.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-04T08:51:41.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851882+0000', 'last_change': '2024-03-04T08:51:36.851882+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851882+0000', 'last_undegraded': '2024-03-04T08:51:36.851882+0000', 'last_fullsized': '2024-03-04T08:51:36.851882+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.855551+0000', 'last_change': '2024-03-04T08:51:36.855551+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.855551+0000', 'last_undegraded': '2024-03-04T08:51:36.855551+0000', 'last_fullsized': '2024-03-04T08:51:36.855551+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.856522+0000', 'last_change': '2024-03-04T08:51:36.856522+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.856522+0000', 'last_undegraded': '2024-03-04T08:51:36.856522+0000', 'last_fullsized': '2024-03-04T08:51:36.856522+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-04T08:51:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.849733+0000', 'last_change': '2024-03-04T08:51:36.849733+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.849733+0000', 'last_undegraded': '2024-03-04T08:51:36.849733+0000', 'last_fullsized': '2024-03-04T08:51:36.849733+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-04T08:51:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853415+0000', 'last_change': '2024-03-04T08:51:36.853415+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853415+0000', 'last_undegraded': '2024-03-04T08:51:36.853415+0000', 'last_fullsized': '2024-03-04T08:51:36.853415+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-04T08:51:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851133+0000', 'last_change': '2024-03-04T08:51:36.851133+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851133+0000', 'last_undegraded': '2024-03-04T08:51:36.851133+0000', 'last_fullsized': '2024-03-04T08:51:36.851133+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.854292+0000', 'last_change': '2024-03-04T08:51:36.854292+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.854292+0000', 'last_undegraded': '2024-03-04T08:51:36.854292+0000', 'last_fullsized': '2024-03-04T08:51:36.854292+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852280+0000', 'last_change': '2024-03-04T08:51:36.852280+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852280+0000', 'last_undegraded': '2024-03-04T08:51:36.852280+0000', 'last_fullsized': '2024-03-04T08:51:36.852280+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852023+0000', 'last_change': '2024-03-04T08:51:36.852023+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852023+0000', 'last_undegraded': '2024-03-04T08:51:36.852023+0000', 'last_fullsized': '2024-03-04T08:51:36.852023+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-04T08:51:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.849264+0000', 'last_change': '2024-03-04T08:51:36.849264+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.849264+0000', 'last_undegraded': '2024-03-04T08:51:36.849264+0000', 'last_fullsized': '2024-03-04T08:51:36.849264+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852951+0000', 'last_change': '2024-03-04T08:51:36.852951+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852951+0000', 'last_undegraded': '2024-03-04T08:51:36.852951+0000', 'last_fullsized': '2024-03-04T08:51:36.852951+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851474+0000', 'last_change': '2024-03-04T08:51:36.851474+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851474+0000', 'last_undegraded': '2024-03-04T08:51:36.851474+0000', 'last_fullsized': '2024-03-04T08:51:36.851474+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852676+0000', 'last_change': '2024-03-04T08:51:36.852676+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852676+0000', 'last_undegraded': '2024-03-04T08:51:36.852676+0000', 'last_fullsized': '2024-03-04T08:51:36.852676+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-04T08:51:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.854691+0000', 'last_change': '2024-03-04T08:51:36.854691+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.854691+0000', 'last_undegraded': '2024-03-04T08:51:36.854691+0000', 'last_fullsized': '2024-03-04T08:51:36.854691+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853301+0000', 'last_change': '2024-03-04T08:51:36.853301+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853301+0000', 'last_undegraded': '2024-03-04T08:51:36.853301+0000', 'last_fullsized': '2024-03-04T08:51:36.853301+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.854968+0000', 'last_change': '2024-03-04T08:51:36.854968+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.854968+0000', 'last_undegraded': '2024-03-04T08:51:36.854968+0000', 'last_fullsized': '2024-03-04T08:51:36.854968+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848904+0000', 'last_change': '2024-03-04T08:51:36.848904+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848904+0000', 'last_undegraded': '2024-03-04T08:51:36.848904+0000', 'last_fullsized': '2024-03-04T08:51:36.848904+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850730+0000', 'last_change': '2024-03-04T08:51:36.850730+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850730+0000', 'last_undegraded': '2024-03-04T08:51:36.850730+0000', 'last_fullsized': '2024-03-04T08:51:36.850730+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853677+0000', 'last_change': '2024-03-04T08:51:36.853677+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853677+0000', 'last_undegraded': '2024-03-04T08:51:36.853677+0000', 'last_fullsized': '2024-03-04T08:51:36.853677+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-04T08:51:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.849302+0000', 'last_change': '2024-03-04T08:51:36.849302+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.849302+0000', 'last_undegraded': '2024-03-04T08:51:36.849302+0000', 'last_fullsized': '2024-03-04T08:51:36.849302+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851600+0000', 'last_change': '2024-03-04T08:51:36.851600+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851600+0000', 'last_undegraded': '2024-03-04T08:51:36.851600+0000', 'last_fullsized': '2024-03-04T08:51:36.851600+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853205+0000', 'last_change': '2024-03-04T08:51:36.853205+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853205+0000', 'last_undegraded': '2024-03-04T08:51:36.853205+0000', 'last_fullsized': '2024-03-04T08:51:36.853205+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851067+0000', 'last_change': '2024-03-04T08:51:36.851067+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851067+0000', 'last_undegraded': '2024-03-04T08:51:36.851067+0000', 'last_fullsized': '2024-03-04T08:51:36.851067+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853910+0000', 'last_change': '2024-03-04T08:51:36.853910+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853910+0000', 'last_undegraded': '2024-03-04T08:51:36.853910+0000', 'last_fullsized': '2024-03-04T08:51:36.853910+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-04T08:51:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851966+0000', 'last_change': '2024-03-04T08:51:36.851966+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851966+0000', 'last_undegraded': '2024-03-04T08:51:36.851966+0000', 'last_fullsized': '2024-03-04T08:51:36.851966+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851451+0000', 'last_change': '2024-03-04T08:51:36.851451+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851451+0000', 'last_undegraded': '2024-03-04T08:51:36.851451+0000', 'last_fullsized': '2024-03-04T08:51:36.851451+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851249+0000', 'last_change': '2024-03-04T08:51:36.851249+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851249+0000', 'last_undegraded': '2024-03-04T08:51:36.851249+0000', 'last_fullsized': '2024-03-04T08:51:36.851249+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.854244+0000', 'last_change': '2024-03-04T08:51:36.854244+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.854244+0000', 'last_undegraded': '2024-03-04T08:51:36.854244+0000', 'last_fullsized': '2024-03-04T08:51:36.854244+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850953+0000', 'last_change': '2024-03-04T08:51:36.850953+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850953+0000', 'last_undegraded': '2024-03-04T08:51:36.850953+0000', 'last_fullsized': '2024-03-04T08:51:36.850953+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.849769+0000', 'last_change': '2024-03-04T08:51:36.849769+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.849769+0000', 'last_undegraded': '2024-03-04T08:51:36.849769+0000', 'last_fullsized': '2024-03-04T08:51:36.849769+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851463+0000', 'last_change': '2024-03-04T08:51:36.851463+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851463+0000', 'last_undegraded': '2024-03-04T08:51:36.851463+0000', 'last_fullsized': '2024-03-04T08:51:36.851463+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.856927+0000', 'last_change': '2024-03-04T08:51:36.856927+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.856927+0000', 'last_undegraded': '2024-03-04T08:51:36.856927+0000', 'last_fullsized': '2024-03-04T08:51:36.856927+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850238+0000', 'last_change': '2024-03-04T08:51:36.850238+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850238+0000', 'last_undegraded': '2024-03-04T08:51:36.850238+0000', 'last_fullsized': '2024-03-04T08:51:36.850238+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.853446+0000', 'last_change': '2024-03-04T08:51:36.853446+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.853446+0000', 'last_undegraded': '2024-03-04T08:51:36.853446+0000', 'last_fullsized': '2024-03-04T08:51:36.853446+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850605+0000', 'last_change': '2024-03-04T08:51:36.850605+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850605+0000', 'last_undegraded': '2024-03-04T08:51:36.850605+0000', 'last_fullsized': '2024-03-04T08:51:36.850605+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-04T08:51:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852871+0000', 'last_change': '2024-03-04T08:51:36.852871+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852871+0000', 'last_undegraded': '2024-03-04T08:51:36.852871+0000', 'last_fullsized': '2024-03-04T08:51:36.852871+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848323+0000', 'last_change': '2024-03-04T08:51:36.848323+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848323+0000', 'last_undegraded': '2024-03-04T08:51:36.848323+0000', 'last_fullsized': '2024-03-04T08:51:36.848323+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848414+0000', 'last_change': '2024-03-04T08:51:36.848414+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848414+0000', 'last_undegraded': '2024-03-04T08:51:36.848414+0000', 'last_fullsized': '2024-03-04T08:51:36.848414+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848307+0000', 'last_change': '2024-03-04T08:51:36.848307+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848307+0000', 'last_undegraded': '2024-03-04T08:51:36.848307+0000', 'last_fullsized': '2024-03-04T08:51:36.848307+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848681+0000', 'last_change': '2024-03-04T08:51:36.848681+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848681+0000', 'last_undegraded': '2024-03-04T08:51:36.848681+0000', 'last_fullsized': '2024-03-04T08:51:36.848681+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851736+0000', 'last_change': '2024-03-04T08:51:36.851736+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851736+0000', 'last_undegraded': '2024-03-04T08:51:36.851736+0000', 'last_fullsized': '2024-03-04T08:51:36.851736+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.848160+0000', 'last_change': '2024-03-04T08:51:36.848160+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.848160+0000', 'last_undegraded': '2024-03-04T08:51:36.848160+0000', 'last_fullsized': '2024-03-04T08:51:36.848160+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.852471+0000', 'last_change': '2024-03-04T08:51:36.852471+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.852471+0000', 'last_undegraded': '2024-03-04T08:51:36.852471+0000', 'last_fullsized': '2024-03-04T08:51:36.852471+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850242+0000', 'last_change': '2024-03-04T08:51:36.850242+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850242+0000', 'last_undegraded': '2024-03-04T08:51:36.850242+0000', 'last_fullsized': '2024-03-04T08:51:36.850242+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851010+0000', 'last_change': '2024-03-04T08:51:36.851010+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851010+0000', 'last_undegraded': '2024-03-04T08:51:36.851010+0000', 'last_fullsized': '2024-03-04T08:51:36.851010+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850933+0000', 'last_change': '2024-03-04T08:51:36.850933+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850933+0000', 'last_undegraded': '2024-03-04T08:51:36.850933+0000', 'last_fullsized': '2024-03-04T08:51:36.850933+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-04T08:51:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.850453+0000', 'last_change': '2024-03-04T08:51:36.850453+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.850453+0000', 'last_undegraded': '2024-03-04T08:51:36.850453+0000', 'last_fullsized': '2024-03-04T08:51:36.850453+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-04T08:51:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-04T08:51:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-04T08:51:36.851177+0000', 'last_change': '2024-03-04T08:51:36.851177+0000', 'last_active': '2024-03-04T08:51:36.840369+0000', 'last_peered': '2024-03-04T08:51:36.840369+0000', 'last_clean': '2024-03-04T08:51:36.840369+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-04T08:51:36.851177+0000', 'last_undegraded': '2024-03-04T08:51:36.851177+0000', 'last_fullsized': '2024-03-04T08:51:36.851177+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'last_clean_scrub_stamp': '2024-03-04T08:51:36.840369+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-04T08:51:41.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-04T08:51:41.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.893+0000 7f3c0760f640 1 Processor -- start 2024-03-04T08:51:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.893+0000 7f3c0760f640 1 -- start start 2024-03-04T08:51:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c0760f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3c000d0d90 0x7f3c000ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c0760f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000d25e0 con 0x7f3c000c90f0 2024-03-04T08:51:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c0760f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000d2880 con 0x7f3c0015e000 2024-03-04T08:51:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c0760f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000c7c50 con 0x7f3c000d0d90 2024-03-04T08:51:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c05bac640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3c000c90f0 0x7f3c000ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41494/0 (socket says 172.21.15.19:41494) 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.894+0000 7f3c05bac640 1 -- 172.21.15.19:0/909264011 learned_addr learned my addr 172.21.15.19:0/909264011 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3c04baa640 1 --2- 172.21.15.19:0/909264011 >> v2:172.21.15.204:3300/0 conn(0x7f3c000d0d90 0x7f3c000ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673915815 0 0) 0x7f3c000d25e0 con 0x7f3c000c90f0 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be8003520 con 0x7f3c000c90f0 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238131118 0 0) 0x7f3c000d2880 con 0x7f3c0015e000 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c000d25e0 con 0x7f3c0015e000 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088113694 0 0) 0x7f3be8003520 con 0x7f3c000c90f0 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3c04baa640 1 -- 172.21.15.19:0/909264011 >> v1:172.21.15.204:6789/0 conn(0x7f3c0015e000 legacy=0x7f3c000d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3c04baa640 1 -- 172.21.15.19:0/909264011 >> v1:172.21.15.19:6789/0 conn(0x7f3c000c90f0 legacy=0x7f3c000ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.895+0000 7f3c04baa640 1 -- 172.21.15.19:0/909264011 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000d2b40 con 0x7f3c000d0d90 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c04baa640 1 --2- 172.21.15.19:0/909264011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c000d0d90 0x7f3c000ce7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40097a0 tx=0x7f3bf402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7feaaf09916a8259 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8001670 con 0x7f3c000d0d90 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4037070 con 0x7f3c000d0d90 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3bfffff640 1 -- 172.21.15.19:0/909264011 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4031790 con 0x7f3c000d0d90 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c0760f640 1 -- 172.21.15.19:0/909264011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c000d0d90 msgr2=0x7f3c000ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c0760f640 1 --2- 172.21.15.19:0/909264011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c000d0d90 0x7f3c000ce7c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40097a0 tx=0x7f3bf402b8b0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c0760f640 1 -- 172.21.15.19:0/909264011 shutdown_connections 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c0760f640 1 --2- 172.21.15.19:0/909264011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c000d0d90 0x7f3c000ce7c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.896+0000 7f3c0760f640 1 -- 172.21.15.19:0/909264011 >> 172.21.15.19:0/909264011 conn(0x7f3c000d3cf0 msgr2=0x7f3c000d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.897+0000 7f3c0760f640 1 -- 172.21.15.19:0/909264011 shutdown_connections 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.897+0000 7f3c0760f640 1 -- 172.21.15.19:0/909264011 wait complete. 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 Processor -- start 2024-03-04T08:51:41.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 -- start start 2024-03-04T08:51:41.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c000d0d90 0x7f3c000ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c0015e000 0x7f3c000cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015e3e0 con 0x7f3c000c90f0 2024-03-04T08:51:41.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000d22d0 con 0x7f3c0015e000 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.898+0000 7f3c0760f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000d4810 con 0x7f3c000d0d90 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41110/0 (socket says 172.21.15.19:41110) 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 -- 172.21.15.19:0/507660656 learned_addr learned my addr 172.21.15.19:0/507660656 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c04baa640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c000d0d90 0x7f3c000ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c05bac640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c0015e000 0x7f3c000cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 -- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c000d0d90 msgr2=0x7f3c000ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c000d0d90 0x7f3c000ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 -- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c0015e000 msgr2=0x7f3c000cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c0015e000 0x7f3c000cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 -- 172.21.15.19:0/507660656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0009dc10 con 0x7f3c000c90f0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c053ab640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c7a0 tx=0x7f3bf000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0003b70 con 0x7f3c000c90f0 2024-03-04T08:51:41.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0003d10 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000aa90 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.899+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0009def0 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.900+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0009e4b0 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.900+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0004f330 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.901+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3bf000ac30 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.901+0000 7f3bfdffb640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 0x7f3bec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.901+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bf008a030 con 0x7f3c000c90f0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.901+0000 7f3c04baa640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 0x7f3bec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.902+0000 7f3c04baa640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 0x7f3bec06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4036000 tx=0x7f3bf4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:41.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:41.905+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3bf0058860 con 0x7f3c000c90f0 2024-03-04T08:51:42.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.157+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3c000c8da0 con 0x7f3c000c90f0 2024-03-04T08:51:42.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.158+0000 7f3bfdffb640 1 -- 172.21.15.19:0/507660656 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1645 (secure 0 0 0) 0x7f3bf005c900 con 0x7f3c000c90f0 2024-03-04T08:51:42.154 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:42.154 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1709542231,"num_in_osds":8,"osd_in_since":1709542223,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":49},{"state_name":"creating+peering","count":48}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590494,"bytes_used":229679104,"bytes_avail":772864434176,"bytes_total":773094113280,"inactive_pgs_ratio":0.49484536051750183,"write_bytes_sec":1737,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5256}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-03-04T08:51:33.149329+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-04T08:51:42.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 msgr2=0x7f3bec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 0x7f3bec06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4036000 tx=0x7f3bf4008030 comp rx=0 tx=0).stop 2024-03-04T08:51:42.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 msgr2=0x7f3c000a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c7a0 tx=0x7f3bf000cc60 comp rx=0 tx=0).stop 2024-03-04T08:51:42.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 shutdown_connections 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3bec06b4d0 0x7f3bec06d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c0015e000 0x7f3c000cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3c000d0d90 0x7f3c000ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 --2- 172.21.15.19:0/507660656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c000c90f0 0x7f3c000a12b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 >> 172.21.15.19:0/507660656 conn(0x7f3c000d3cf0 msgr2=0x7f3c0006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 shutdown_connections 2024-03-04T08:51:42.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.160+0000 7f3c0760f640 1 -- 172.21.15.19:0/507660656 wait complete. 2024-03-04T08:51:42.167 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-04T08:51:42.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:51:42.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.271+0000 7f0ffd948640 1 Processor -- start 2024-03-04T08:51:42.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.272+0000 7f0ffd948640 1 -- start start 2024-03-04T08:51:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ffd948640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ff8158920 0x7f0ff815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ffd948640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80afdd0 0x7f0ff806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ffd948640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff815e740 con 0x7f0ff80d14f0 2024-03-04T08:51:42.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ffd948640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff806fae0 con 0x7f0ff8158920 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ffd948640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff815f5f0 con 0x7f0ff80afdd0 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ff8158920 0x7f0ff815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ff8158920 0x7f0ff815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41112/0 (socket says 172.21.15.19:41112) 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/800209520 learned_addr learned my addr 172.21.15.19:0/800209520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/800209520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80afdd0 msgr2=0x7f0ff806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 --2- 172.21.15.19:0/800209520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80afdd0 0x7f0ff806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/800209520 >> v1:172.21.15.204:6789/0 conn(0x7f0ff80d14f0 legacy=0x7f0ff80af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.273+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/800209520 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff815e9e0 con 0x7f0ff8158920 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.274+0000 7f0ff6ffd640 1 --2- 172.21.15.19:0/800209520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff8158920 0x7f0ff815c310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009870 tx=0x7f0fe802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46965832d698a519 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.274+0000 7f0ff67fc640 1 -- 172.21.15.19:0/800209520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8035020 con 0x7f0ff8158920 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.274+0000 7f0ff67fc640 1 -- 172.21.15.19:0/800209520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8031640 con 0x7f0ff8158920 2024-03-04T08:51:42.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.274+0000 7f0ff67fc640 1 -- 172.21.15.19:0/800209520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe802d040 con 0x7f0ff8158920 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 -- 172.21.15.19:0/800209520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff8158920 msgr2=0x7f0ff815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 --2- 172.21.15.19:0/800209520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff8158920 0x7f0ff815c310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009870 tx=0x7f0fe802b8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 -- 172.21.15.19:0/800209520 shutdown_connections 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 --2- 172.21.15.19:0/800209520 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80afdd0 0x7f0ff806f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 --2- 172.21.15.19:0/800209520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff8158920 0x7f0ff815c310 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 -- 172.21.15.19:0/800209520 >> 172.21.15.19:0/800209520 conn(0x7f0ff80d0960 msgr2=0x7f0ff80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 -- 172.21.15.19:0/800209520 shutdown_connections 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.275+0000 7f0ffd948640 1 -- 172.21.15.19:0/800209520 wait complete. 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.276+0000 7f0ffd948640 1 Processor -- start 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.276+0000 7f0ffd948640 1 -- start start 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80d14f0 0x7f0ff814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 0x7f0ff806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff815f280 con 0x7f0ff80afdd0 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff815efa0 con 0x7f0ff8158920 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ffd948640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff815b400 con 0x7f0ff80d14f0 2024-03-04T08:51:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41120/0 (socket says 172.21.15.19:41120) 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/821809750 learned_addr learned my addr 172.21.15.19:0/821809750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff77fe640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 0x7f0ff806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0feffff640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80d14f0 0x7f0ff814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80d14f0 msgr2=0x7f0ff814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80d14f0 0x7f0ff814e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 msgr2=0x7f0ff806afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 0x7f0ff806afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 -- 172.21.15.19:0/821809750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff814ebc0 con 0x7f0ff80afdd0 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff77fe640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 0x7f0ff806afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff6ffd640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0fe802b930 tx=0x7f0fe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.277+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe803ac60 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.278+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe803ae20 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.278+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80adc40 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.278+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8044630 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.278+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff80ae200 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.279+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff804f330 con 0x7f0ff80afdd0 2024-03-04T08:51:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.279+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fe804b060 con 0x7f0ff80afdd0 2024-03-04T08:51:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.279+0000 7f0ff4ff9640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 0x7f0fd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.280+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fe80abf00 con 0x7f0ff80afdd0 2024-03-04T08:51:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.280+0000 7f0feffff640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 0x7f0fd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.280+0000 7f0feffff640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 0x7f0fd806d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806be80 tx=0x7f0fe0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.284+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0fe803f070 con 0x7f0ff80afdd0 2024-03-04T08:51:42.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.460+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ff8072b80 con 0x7f0fd806b500 2024-03-04T08:51:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.466+0000 7f0ff4ff9640 1 -- 172.21.15.19:0/821809750 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247984 (secure 0 0 0) 0x7f0ff8072b80 con 0x7f0fd806b500 2024-03-04T08:51:42.465 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:42.467 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:51:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 msgr2=0x7f0fd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 0x7f0fd806d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806be80 tx=0x7f0fe0009040 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 msgr2=0x7f0ff81f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0fe802b930 tx=0x7f0fe80046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 shutdown_connections 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0fd806b500 0x7f0fd806d9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0ff8158920 0x7f0ff806afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0ff80d14f0 0x7f0ff814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 --2- 172.21.15.19:0/821809750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ff80afdd0 0x7f0ff81f45f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 >> 172.21.15.19:0/821809750 conn(0x7f0ff80d0960 msgr2=0x7f0ff80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 shutdown_connections 2024-03-04T08:51:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:42.469+0000 7f0ffd948640 1 -- 172.21.15.19:0/821809750 wait complete. 2024-03-04T08:51:42.477 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-03-04T08:51:41.150850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224296,"kb_used_data":3972,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750424,"statfs":{"total":773094113280,"available":772864434176,"internally_reserved":0,"allocated":4067328,"data_stored":2288213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.304059"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851882+0000","last_change":"2024-03-04T08:51:36.851882+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851882+0000","last_undegraded":"2024-03-04T08:51:36.851882+0000","last_fullsized":"2024-03-04T08:51:36.851882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.855551+0000","last_change":"2024-03-04T08:51:36.855551+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.855551+0000","last_undegraded":"2024-03-04T08:51:36.855551+0000","last_fullsized":"2024-03-04T08:51:36.855551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856522+0000","last_change":"2024-03-04T08:51:36.856522+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856522+0000","last_undegraded":"2024-03-04T08:51:36.856522+0000","last_fullsized":"2024-03-04T08:51:36.856522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872827+0000","last_change":"2024-03-04T08:51:37.876460+0000","last_active":"2024-03-04T08:51:38.872827+0000","last_peered":"2024-03-04T08:51:38.872827+0000","last_clean":"2024-03-04T08:51:38.872827+0000","last_became_active":"2024-03-04T08:51:37.876191+0000","last_became_peered":"2024-03-04T08:51:37.876191+0000","last_unstale":"2024-03-04T08:51:38.872827+0000","last_undegraded":"2024-03-04T08:51:38.872827+0000","last_fullsized":"2024-03-04T08:51:38.872827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849733+0000","last_change":"2024-03-04T08:51:36.849733+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849733+0000","last_undegraded":"2024-03-04T08:51:36.849733+0000","last_fullsized":"2024-03-04T08:51:36.849733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853415+0000","last_change":"2024-03-04T08:51:36.853415+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853415+0000","last_undegraded":"2024-03-04T08:51:36.853415+0000","last_fullsized":"2024-03-04T08:51:36.853415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851133+0000","last_change":"2024-03-04T08:51:36.851133+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851133+0000","last_undegraded":"2024-03-04T08:51:36.851133+0000","last_fullsized":"2024-03-04T08:51:36.851133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854292+0000","last_change":"2024-03-04T08:51:36.854292+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854292+0000","last_undegraded":"2024-03-04T08:51:36.854292+0000","last_fullsized":"2024-03-04T08:51:36.854292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392010+0000","last_change":"2024-03-04T08:51:37.871847+0000","last_active":"2024-03-04T08:51:39.392010+0000","last_peered":"2024-03-04T08:51:39.392010+0000","last_clean":"2024-03-04T08:51:39.392010+0000","last_became_active":"2024-03-04T08:51:37.871513+0000","last_became_peered":"2024-03-04T08:51:37.871513+0000","last_unstale":"2024-03-04T08:51:39.392010+0000","last_undegraded":"2024-03-04T08:51:39.392010+0000","last_fullsized":"2024-03-04T08:51:39.392010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872958+0000","last_change":"2024-03-04T08:51:37.881764+0000","last_active":"2024-03-04T08:51:38.872958+0000","last_peered":"2024-03-04T08:51:38.872958+0000","last_clean":"2024-03-04T08:51:38.872958+0000","last_became_active":"2024-03-04T08:51:37.881212+0000","last_became_peered":"2024-03-04T08:51:37.881212+0000","last_unstale":"2024-03-04T08:51:38.872958+0000","last_undegraded":"2024-03-04T08:51:38.872958+0000","last_fullsized":"2024-03-04T08:51:38.872958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852280+0000","last_change":"2024-03-04T08:51:36.852280+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852280+0000","last_undegraded":"2024-03-04T08:51:36.852280+0000","last_fullsized":"2024-03-04T08:51:36.852280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852023+0000","last_change":"2024-03-04T08:51:36.852023+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852023+0000","last_undegraded":"2024-03-04T08:51:36.852023+0000","last_fullsized":"2024-03-04T08:51:36.852023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849264+0000","last_change":"2024-03-04T08:51:36.849264+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849264+0000","last_undegraded":"2024-03-04T08:51:36.849264+0000","last_fullsized":"2024-03-04T08:51:36.849264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852951+0000","last_change":"2024-03-04T08:51:36.852951+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852951+0000","last_undegraded":"2024-03-04T08:51:36.852951+0000","last_fullsized":"2024-03-04T08:51:36.852951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851474+0000","last_change":"2024-03-04T08:51:36.851474+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851474+0000","last_undegraded":"2024-03-04T08:51:36.851474+0000","last_fullsized":"2024-03-04T08:51:36.851474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852676+0000","last_change":"2024-03-04T08:51:36.852676+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852676+0000","last_undegraded":"2024-03-04T08:51:36.852676+0000","last_fullsized":"2024-03-04T08:51:36.852676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854691+0000","last_change":"2024-03-04T08:51:36.854691+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854691+0000","last_undegraded":"2024-03-04T08:51:36.854691+0000","last_fullsized":"2024-03-04T08:51:36.854691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853301+0000","last_change":"2024-03-04T08:51:36.853301+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853301+0000","last_undegraded":"2024-03-04T08:51:36.853301+0000","last_fullsized":"2024-03-04T08:51:36.853301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854968+0000","last_change":"2024-03-04T08:51:36.854968+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854968+0000","last_undegraded":"2024-03-04T08:51:36.854968+0000","last_fullsized":"2024-03-04T08:51:36.854968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848904+0000","last_change":"2024-03-04T08:51:36.848904+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848904+0000","last_undegraded":"2024-03-04T08:51:36.848904+0000","last_fullsized":"2024-03-04T08:51:36.848904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392188+0000","last_change":"2024-03-04T08:51:37.872571+0000","last_active":"2024-03-04T08:51:39.392188+0000","last_peered":"2024-03-04T08:51:39.392188+0000","last_clean":"2024-03-04T08:51:39.392188+0000","last_became_active":"2024-03-04T08:51:37.871862+0000","last_became_peered":"2024-03-04T08:51:37.871862+0000","last_unstale":"2024-03-04T08:51:39.392188+0000","last_undegraded":"2024-03-04T08:51:39.392188+0000","last_fullsized":"2024-03-04T08:51:39.392188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391611+0000","last_change":"2024-03-04T08:51:37.873090+0000","last_active":"2024-03-04T08:51:39.391611+0000","last_peered":"2024-03-04T08:51:39.391611+0000","last_clean":"2024-03-04T08:51:39.391611+0000","last_became_active":"2024-03-04T08:51:37.872648+0000","last_became_peered":"2024-03-04T08:51:37.872648+0000","last_unstale":"2024-03-04T08:51:39.391611+0000","last_undegraded":"2024-03-04T08:51:39.391611+0000","last_fullsized":"2024-03-04T08:51:39.391611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850730+0000","last_change":"2024-03-04T08:51:36.850730+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850730+0000","last_undegraded":"2024-03-04T08:51:36.850730+0000","last_fullsized":"2024-03-04T08:51:36.850730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853677+0000","last_change":"2024-03-04T08:51:36.853677+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853677+0000","last_undegraded":"2024-03-04T08:51:36.853677+0000","last_fullsized":"2024-03-04T08:51:36.853677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873039+0000","last_change":"2024-03-04T08:51:37.873138+0000","last_active":"2024-03-04T08:51:38.873039+0000","last_peered":"2024-03-04T08:51:38.873039+0000","last_clean":"2024-03-04T08:51:38.873039+0000","last_became_active":"2024-03-04T08:51:37.872797+0000","last_became_peered":"2024-03-04T08:51:37.872797+0000","last_unstale":"2024-03-04T08:51:38.873039+0000","last_undegraded":"2024-03-04T08:51:38.873039+0000","last_fullsized":"2024-03-04T08:51:38.873039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849302+0000","last_change":"2024-03-04T08:51:36.849302+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849302+0000","last_undegraded":"2024-03-04T08:51:36.849302+0000","last_fullsized":"2024-03-04T08:51:36.849302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873131+0000","last_change":"2024-03-04T08:51:37.874965+0000","last_active":"2024-03-04T08:51:38.873131+0000","last_peered":"2024-03-04T08:51:38.873131+0000","last_clean":"2024-03-04T08:51:38.873131+0000","last_became_active":"2024-03-04T08:51:37.874674+0000","last_became_peered":"2024-03-04T08:51:37.874674+0000","last_unstale":"2024-03-04T08:51:38.873131+0000","last_undegraded":"2024-03-04T08:51:38.873131+0000","last_fullsized":"2024-03-04T08:51:38.873131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:42.266540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851600+0000","last_change":"2024-03-04T08:51:36.851600+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851600+0000","last_undegraded":"2024-03-04T08:51:36.851600+0000","last_fullsized":"2024-03-04T08:51:36.851600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392332+0000","last_change":"2024-03-04T08:51:37.870986+0000","last_active":"2024-03-04T08:51:39.392332+0000","last_peered":"2024-03-04T08:51:39.392332+0000","last_clean":"2024-03-04T08:51:39.392332+0000","last_became_active":"2024-03-04T08:51:37.870677+0000","last_became_peered":"2024-03-04T08:51:37.870677+0000","last_unstale":"2024-03-04T08:51:39.392332+0000","last_undegraded":"2024-03-04T08:51:39.392332+0000","last_fullsized":"2024-03-04T08:51:39.392332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853205+0000","last_change":"2024-03-04T08:51:36.853205+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853205+0000","last_undegraded":"2024-03-04T08:51:36.853205+0000","last_fullsized":"2024-03-04T08:51:36.853205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851067+0000","last_change":"2024-03-04T08:51:36.851067+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851067+0000","last_undegraded":"2024-03-04T08:51:36.851067+0000","last_fullsized":"2024-03-04T08:51:36.851067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853910+0000","last_change":"2024-03-04T08:51:36.853910+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853910+0000","last_undegraded":"2024-03-04T08:51:36.853910+0000","last_fullsized":"2024-03-04T08:51:36.853910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851966+0000","last_change":"2024-03-04T08:51:36.851966+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851966+0000","last_undegraded":"2024-03-04T08:51:36.851966+0000","last_fullsized":"2024-03-04T08:51:36.851966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862822+0000","last_change":"2024-03-04T08:51:36.861353+0000","last_active":"2024-03-04T08:51:36.862822+0000","last_peered":"2024-03-04T08:51:36.862822+0000","last_clean":"2024-03-04T08:51:36.862822+0000","last_became_active":"2024-03-04T08:51:36.861087+0000","last_became_peered":"2024-03-04T08:51:36.861087+0000","last_unstale":"2024-03-04T08:51:36.862822+0000","last_undegraded":"2024-03-04T08:51:36.862822+0000","last_fullsized":"2024-03-04T08:51:36.862822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851451+0000","last_change":"2024-03-04T08:51:36.851451+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851451+0000","last_undegraded":"2024-03-04T08:51:36.851451+0000","last_fullsized":"2024-03-04T08:51:36.851451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865235+0000","last_change":"2024-03-04T08:51:36.862187+0000","last_active":"2024-03-04T08:51:36.865235+0000","last_peered":"2024-03-04T08:51:36.865235+0000","last_clean":"2024-03-04T08:51:36.865235+0000","last_became_active":"2024-03-04T08:51:36.861833+0000","last_became_peered":"2024-03-04T08:51:36.861833+0000","last_unstale":"2024-03-04T08:51:36.865235+0000","last_undegraded":"2024-03-04T08:51:36.865235+0000","last_fullsized":"2024-03-04T08:51:36.865235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392416+0000","last_change":"2024-03-04T08:51:37.880138+0000","last_active":"2024-03-04T08:51:39.392416+0000","last_peered":"2024-03-04T08:51:39.392416+0000","last_clean":"2024-03-04T08:51:39.392416+0000","last_became_active":"2024-03-04T08:51:37.879016+0000","last_became_peered":"2024-03-04T08:51:37.879016+0000","last_unstale":"2024-03-04T08:51:39.392416+0000","last_undegraded":"2024-03-04T08:51:39.392416+0000","last_fullsized":"2024-03-04T08:51:39.392416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871917+0000","last_change":"2024-03-04T08:51:36.867819+0000","last_active":"2024-03-04T08:51:36.871917+0000","last_peered":"2024-03-04T08:51:36.871917+0000","last_clean":"2024-03-04T08:51:36.871917+0000","last_became_active":"2024-03-04T08:51:36.867496+0000","last_became_peered":"2024-03-04T08:51:36.867496+0000","last_unstale":"2024-03-04T08:51:36.871917+0000","last_undegraded":"2024-03-04T08:51:36.871917+0000","last_fullsized":"2024-03-04T08:51:36.871917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:09.770388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873129+0000","last_change":"2024-03-04T08:51:37.873799+0000","last_active":"2024-03-04T08:51:38.873129+0000","last_peered":"2024-03-04T08:51:38.873129+0000","last_clean":"2024-03-04T08:51:38.873129+0000","last_became_active":"2024-03-04T08:51:37.873368+0000","last_became_peered":"2024-03-04T08:51:37.873368+0000","last_unstale":"2024-03-04T08:51:38.873129+0000","last_undegraded":"2024-03-04T08:51:38.873129+0000","last_fullsized":"2024-03-04T08:51:38.873129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869520+0000","last_change":"2024-03-04T08:51:36.865647+0000","last_active":"2024-03-04T08:51:36.869520+0000","last_peered":"2024-03-04T08:51:36.869520+0000","last_clean":"2024-03-04T08:51:36.869520+0000","last_became_active":"2024-03-04T08:51:36.865371+0000","last_became_peered":"2024-03-04T08:51:36.865371+0000","last_unstale":"2024-03-04T08:51:36.869520+0000","last_undegraded":"2024-03-04T08:51:36.869520+0000","last_fullsized":"2024-03-04T08:51:36.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.190641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851249+0000","last_change":"2024-03-04T08:51:36.851249+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851249+0000","last_undegraded":"2024-03-04T08:51:36.851249+0000","last_fullsized":"2024-03-04T08:51:36.851249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392295+0000","last_change":"2024-03-04T08:51:36.859075+0000","last_active":"2024-03-04T08:51:39.392295+0000","last_peered":"2024-03-04T08:51:39.392295+0000","last_clean":"2024-03-04T08:51:39.392295+0000","last_became_active":"2024-03-04T08:51:36.858824+0000","last_became_peered":"2024-03-04T08:51:36.858824+0000","last_unstale":"2024-03-04T08:51:39.392295+0000","last_undegraded":"2024-03-04T08:51:39.392295+0000","last_fullsized":"2024-03-04T08:51:39.392295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:07.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.854244+0000","last_change":"2024-03-04T08:51:36.854244+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.854244+0000","last_undegraded":"2024-03-04T08:51:36.854244+0000","last_fullsized":"2024-03-04T08:51:36.854244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391740+0000","last_change":"2024-03-04T08:51:36.859719+0000","last_active":"2024-03-04T08:51:39.391740+0000","last_peered":"2024-03-04T08:51:39.391740+0000","last_clean":"2024-03-04T08:51:39.391740+0000","last_became_active":"2024-03-04T08:51:36.859453+0000","last_became_peered":"2024-03-04T08:51:36.859453+0000","last_unstale":"2024-03-04T08:51:39.391740+0000","last_undegraded":"2024-03-04T08:51:39.391740+0000","last_fullsized":"2024-03-04T08:51:39.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391315+0000","last_change":"2024-03-04T08:51:37.864891+0000","last_active":"2024-03-04T08:51:39.391315+0000","last_peered":"2024-03-04T08:51:39.391315+0000","last_clean":"2024-03-04T08:51:39.391315+0000","last_became_active":"2024-03-04T08:51:37.864575+0000","last_became_peered":"2024-03-04T08:51:37.864575+0000","last_unstale":"2024-03-04T08:51:39.391315+0000","last_undegraded":"2024-03-04T08:51:39.391315+0000","last_fullsized":"2024-03-04T08:51:39.391315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:41.263175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866959+0000","last_change":"2024-03-04T08:51:36.862686+0000","last_active":"2024-03-04T08:51:36.866959+0000","last_peered":"2024-03-04T08:51:36.866959+0000","last_clean":"2024-03-04T08:51:36.866959+0000","last_became_active":"2024-03-04T08:51:36.862384+0000","last_became_peered":"2024-03-04T08:51:36.862384+0000","last_unstale":"2024-03-04T08:51:36.866959+0000","last_undegraded":"2024-03-04T08:51:36.866959+0000","last_fullsized":"2024-03-04T08:51:36.866959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872573+0000","last_change":"2024-03-04T08:51:37.870071+0000","last_active":"2024-03-04T08:51:38.872573+0000","last_peered":"2024-03-04T08:51:38.872573+0000","last_clean":"2024-03-04T08:51:38.872573+0000","last_became_active":"2024-03-04T08:51:37.869797+0000","last_became_peered":"2024-03-04T08:51:37.869797+0000","last_unstale":"2024-03-04T08:51:38.872573+0000","last_undegraded":"2024-03-04T08:51:38.872573+0000","last_fullsized":"2024-03-04T08:51:38.872573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391413+0000","last_change":"2024-03-04T08:51:36.862238+0000","last_active":"2024-03-04T08:51:39.391413+0000","last_peered":"2024-03-04T08:51:39.391413+0000","last_clean":"2024-03-04T08:51:39.391413+0000","last_became_active":"2024-03-04T08:51:36.861973+0000","last_became_peered":"2024-03-04T08:51:36.861973+0000","last_unstale":"2024-03-04T08:51:39.391413+0000","last_undegraded":"2024-03-04T08:51:39.391413+0000","last_fullsized":"2024-03-04T08:51:39.391413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850953+0000","last_change":"2024-03-04T08:51:36.850953+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850953+0000","last_undegraded":"2024-03-04T08:51:36.850953+0000","last_fullsized":"2024-03-04T08:51:36.850953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866739+0000","last_change":"2024-03-04T08:51:36.863469+0000","last_active":"2024-03-04T08:51:36.866739+0000","last_peered":"2024-03-04T08:51:36.866739+0000","last_clean":"2024-03-04T08:51:36.866739+0000","last_became_active":"2024-03-04T08:51:36.863185+0000","last_became_peered":"2024-03-04T08:51:36.863185+0000","last_unstale":"2024-03-04T08:51:36.866739+0000","last_undegraded":"2024-03-04T08:51:36.866739+0000","last_fullsized":"2024-03-04T08:51:36.866739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:59.155097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.849769+0000","last_change":"2024-03-04T08:51:36.849769+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.849769+0000","last_undegraded":"2024-03-04T08:51:36.849769+0000","last_fullsized":"2024-03-04T08:51:36.849769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866542+0000","last_change":"2024-03-04T08:51:36.864814+0000","last_active":"2024-03-04T08:51:36.866542+0000","last_peered":"2024-03-04T08:51:36.866542+0000","last_clean":"2024-03-04T08:51:36.866542+0000","last_became_active":"2024-03-04T08:51:36.864469+0000","last_became_peered":"2024-03-04T08:51:36.864469+0000","last_unstale":"2024-03-04T08:51:36.866542+0000","last_undegraded":"2024-03-04T08:51:36.866542+0000","last_fullsized":"2024-03-04T08:51:36.866542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:19.377354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851463+0000","last_change":"2024-03-04T08:51:36.851463+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851463+0000","last_undegraded":"2024-03-04T08:51:36.851463+0000","last_fullsized":"2024-03-04T08:51:36.851463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865646+0000","last_change":"2024-03-04T08:51:36.862948+0000","last_active":"2024-03-04T08:51:36.865646+0000","last_peered":"2024-03-04T08:51:36.865646+0000","last_clean":"2024-03-04T08:51:36.865646+0000","last_became_active":"2024-03-04T08:51:36.862660+0000","last_became_peered":"2024-03-04T08:51:36.862660+0000","last_unstale":"2024-03-04T08:51:36.865646+0000","last_undegraded":"2024-03-04T08:51:36.865646+0000","last_fullsized":"2024-03-04T08:51:36.865646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:41.411669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.856927+0000","last_change":"2024-03-04T08:51:36.856927+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.856927+0000","last_undegraded":"2024-03-04T08:51:36.856927+0000","last_fullsized":"2024-03-04T08:51:36.856927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871913+0000","last_change":"2024-03-04T08:51:36.868052+0000","last_active":"2024-03-04T08:51:36.871913+0000","last_peered":"2024-03-04T08:51:36.871913+0000","last_clean":"2024-03-04T08:51:36.871913+0000","last_became_active":"2024-03-04T08:51:36.867386+0000","last_became_peered":"2024-03-04T08:51:36.867386+0000","last_unstale":"2024-03-04T08:51:36.871913+0000","last_undegraded":"2024-03-04T08:51:36.871913+0000","last_fullsized":"2024-03-04T08:51:36.871913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:34.678540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872657+0000","last_change":"2024-03-04T08:51:37.874458+0000","last_active":"2024-03-04T08:51:38.872657+0000","last_peered":"2024-03-04T08:51:38.872657+0000","last_clean":"2024-03-04T08:51:38.872657+0000","last_became_active":"2024-03-04T08:51:37.873503+0000","last_became_peered":"2024-03-04T08:51:37.873503+0000","last_unstale":"2024-03-04T08:51:38.872657+0000","last_undegraded":"2024-03-04T08:51:38.872657+0000","last_fullsized":"2024-03-04T08:51:38.872657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392385+0000","last_change":"2024-03-04T08:51:36.862148+0000","last_active":"2024-03-04T08:51:39.392385+0000","last_peered":"2024-03-04T08:51:39.392385+0000","last_clean":"2024-03-04T08:51:39.392385+0000","last_became_active":"2024-03-04T08:51:36.861872+0000","last_became_peered":"2024-03-04T08:51:36.861872+0000","last_unstale":"2024-03-04T08:51:39.392385+0000","last_undegraded":"2024-03-04T08:51:39.392385+0000","last_fullsized":"2024-03-04T08:51:39.392385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850238+0000","last_change":"2024-03-04T08:51:36.850238+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850238+0000","last_undegraded":"2024-03-04T08:51:36.850238+0000","last_fullsized":"2024-03-04T08:51:36.850238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872609+0000","last_change":"2024-03-04T08:51:36.865777+0000","last_active":"2024-03-04T08:51:38.872609+0000","last_peered":"2024-03-04T08:51:38.872609+0000","last_clean":"2024-03-04T08:51:38.872609+0000","last_became_active":"2024-03-04T08:51:36.865481+0000","last_became_peered":"2024-03-04T08:51:36.865481+0000","last_unstale":"2024-03-04T08:51:38.872609+0000","last_undegraded":"2024-03-04T08:51:38.872609+0000","last_fullsized":"2024-03-04T08:51:38.872609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.853446+0000","last_change":"2024-03-04T08:51:36.853446+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.853446+0000","last_undegraded":"2024-03-04T08:51:36.853446+0000","last_fullsized":"2024-03-04T08:51:36.853446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.869295+0000","last_change":"2024-03-04T08:51:36.863744+0000","last_active":"2024-03-04T08:51:36.869295+0000","last_peered":"2024-03-04T08:51:36.869295+0000","last_clean":"2024-03-04T08:51:36.869295+0000","last_became_active":"2024-03-04T08:51:36.863042+0000","last_became_peered":"2024-03-04T08:51:36.863042+0000","last_unstale":"2024-03-04T08:51:36.869295+0000","last_undegraded":"2024-03-04T08:51:36.869295+0000","last_fullsized":"2024-03-04T08:51:36.869295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:00.889514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850605+0000","last_change":"2024-03-04T08:51:36.850605+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850605+0000","last_undegraded":"2024-03-04T08:51:36.850605+0000","last_fullsized":"2024-03-04T08:51:36.850605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871938+0000","last_change":"2024-03-04T08:51:36.868568+0000","last_active":"2024-03-04T08:51:36.871938+0000","last_peered":"2024-03-04T08:51:36.871938+0000","last_clean":"2024-03-04T08:51:36.871938+0000","last_became_active":"2024-03-04T08:51:36.868032+0000","last_became_peered":"2024-03-04T08:51:36.868032+0000","last_unstale":"2024-03-04T08:51:36.871938+0000","last_undegraded":"2024-03-04T08:51:36.871938+0000","last_fullsized":"2024-03-04T08:51:36.871938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:55.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392029+0000","last_change":"2024-03-04T08:51:37.870420+0000","last_active":"2024-03-04T08:51:39.392029+0000","last_peered":"2024-03-04T08:51:39.392029+0000","last_clean":"2024-03-04T08:51:39.392029+0000","last_became_active":"2024-03-04T08:51:37.870140+0000","last_became_peered":"2024-03-04T08:51:37.870140+0000","last_unstale":"2024-03-04T08:51:39.392029+0000","last_undegraded":"2024-03-04T08:51:39.392029+0000","last_fullsized":"2024-03-04T08:51:39.392029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873118+0000","last_change":"2024-03-04T08:51:36.865246+0000","last_active":"2024-03-04T08:51:38.873118+0000","last_peered":"2024-03-04T08:51:38.873118+0000","last_clean":"2024-03-04T08:51:38.873118+0000","last_became_active":"2024-03-04T08:51:36.864608+0000","last_became_peered":"2024-03-04T08:51:36.864608+0000","last_unstale":"2024-03-04T08:51:38.873118+0000","last_undegraded":"2024-03-04T08:51:38.873118+0000","last_fullsized":"2024-03-04T08:51:38.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852871+0000","last_change":"2024-03-04T08:51:36.852871+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852871+0000","last_undegraded":"2024-03-04T08:51:36.852871+0000","last_fullsized":"2024-03-04T08:51:36.852871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392143+0000","last_change":"2024-03-04T08:51:36.857891+0000","last_active":"2024-03-04T08:51:39.392143+0000","last_peered":"2024-03-04T08:51:39.392143+0000","last_clean":"2024-03-04T08:51:39.392143+0000","last_became_active":"2024-03-04T08:51:36.857296+0000","last_became_peered":"2024-03-04T08:51:36.857296+0000","last_unstale":"2024-03-04T08:51:39.392143+0000","last_undegraded":"2024-03-04T08:51:39.392143+0000","last_fullsized":"2024-03-04T08:51:39.392143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872861+0000","last_change":"2024-03-04T08:51:37.874163+0000","last_active":"2024-03-04T08:51:38.872861+0000","last_peered":"2024-03-04T08:51:38.872861+0000","last_clean":"2024-03-04T08:51:38.872861+0000","last_became_active":"2024-03-04T08:51:37.873895+0000","last_became_peered":"2024-03-04T08:51:37.873895+0000","last_unstale":"2024-03-04T08:51:38.872861+0000","last_undegraded":"2024-03-04T08:51:38.872861+0000","last_fullsized":"2024-03-04T08:51:38.872861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391964+0000","last_change":"2024-03-04T08:51:36.857464+0000","last_active":"2024-03-04T08:51:39.391964+0000","last_peered":"2024-03-04T08:51:39.391964+0000","last_clean":"2024-03-04T08:51:39.391964+0000","last_became_active":"2024-03-04T08:51:36.857197+0000","last_became_peered":"2024-03-04T08:51:36.857197+0000","last_unstale":"2024-03-04T08:51:39.391964+0000","last_undegraded":"2024-03-04T08:51:39.391964+0000","last_fullsized":"2024-03-04T08:51:39.391964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848323+0000","last_change":"2024-03-04T08:51:36.848323+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848323+0000","last_undegraded":"2024-03-04T08:51:36.848323+0000","last_fullsized":"2024-03-04T08:51:36.848323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392398+0000","last_change":"2024-03-04T08:51:36.861233+0000","last_active":"2024-03-04T08:51:39.392398+0000","last_peered":"2024-03-04T08:51:39.392398+0000","last_clean":"2024-03-04T08:51:39.392398+0000","last_became_active":"2024-03-04T08:51:36.860828+0000","last_became_peered":"2024-03-04T08:51:36.860828+0000","last_unstale":"2024-03-04T08:51:39.392398+0000","last_undegraded":"2024-03-04T08:51:39.392398+0000","last_fullsized":"2024-03-04T08:51:39.392398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:27.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848414+0000","last_change":"2024-03-04T08:51:36.848414+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848414+0000","last_undegraded":"2024-03-04T08:51:36.848414+0000","last_fullsized":"2024-03-04T08:51:36.848414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871856+0000","last_change":"2024-03-04T08:51:36.868118+0000","last_active":"2024-03-04T08:51:36.871856+0000","last_peered":"2024-03-04T08:51:36.871856+0000","last_clean":"2024-03-04T08:51:36.871856+0000","last_became_active":"2024-03-04T08:51:36.867809+0000","last_became_peered":"2024-03-04T08:51:36.867809+0000","last_unstale":"2024-03-04T08:51:36.871856+0000","last_undegraded":"2024-03-04T08:51:36.871856+0000","last_fullsized":"2024-03-04T08:51:36.871856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848307+0000","last_change":"2024-03-04T08:51:36.848307+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848307+0000","last_undegraded":"2024-03-04T08:51:36.848307+0000","last_fullsized":"2024-03-04T08:51:36.848307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.868481+0000","last_change":"2024-03-04T08:51:36.867341+0000","last_active":"2024-03-04T08:51:36.868481+0000","last_peered":"2024-03-04T08:51:36.868481+0000","last_clean":"2024-03-04T08:51:36.868481+0000","last_became_active":"2024-03-04T08:51:36.867060+0000","last_became_peered":"2024-03-04T08:51:36.867060+0000","last_unstale":"2024-03-04T08:51:36.868481+0000","last_undegraded":"2024-03-04T08:51:36.868481+0000","last_fullsized":"2024-03-04T08:51:36.868481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:53.043511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848681+0000","last_change":"2024-03-04T08:51:36.848681+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848681+0000","last_undegraded":"2024-03-04T08:51:36.848681+0000","last_fullsized":"2024-03-04T08:51:36.848681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392166+0000","last_change":"2024-03-04T08:51:36.864921+0000","last_active":"2024-03-04T08:51:39.392166+0000","last_peered":"2024-03-04T08:51:39.392166+0000","last_clean":"2024-03-04T08:51:39.392166+0000","last_became_active":"2024-03-04T08:51:36.864722+0000","last_became_peered":"2024-03-04T08:51:36.864722+0000","last_unstale":"2024-03-04T08:51:39.392166+0000","last_undegraded":"2024-03-04T08:51:39.392166+0000","last_fullsized":"2024-03-04T08:51:39.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:29.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851736+0000","last_change":"2024-03-04T08:51:36.851736+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851736+0000","last_undegraded":"2024-03-04T08:51:36.851736+0000","last_fullsized":"2024-03-04T08:51:36.851736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.865623+0000","last_change":"2024-03-04T08:51:36.862821+0000","last_active":"2024-03-04T08:51:36.865623+0000","last_peered":"2024-03-04T08:51:36.865623+0000","last_clean":"2024-03-04T08:51:36.865623+0000","last_became_active":"2024-03-04T08:51:36.862503+0000","last_became_peered":"2024-03-04T08:51:36.862503+0000","last_unstale":"2024-03-04T08:51:36.865623+0000","last_undegraded":"2024-03-04T08:51:36.865623+0000","last_fullsized":"2024-03-04T08:51:36.865623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:43.796665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.848160+0000","last_change":"2024-03-04T08:51:36.848160+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.848160+0000","last_undegraded":"2024-03-04T08:51:36.848160+0000","last_fullsized":"2024-03-04T08:51:36.848160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873140+0000","last_change":"2024-03-04T08:51:36.865400+0000","last_active":"2024-03-04T08:51:38.873140+0000","last_peered":"2024-03-04T08:51:38.873140+0000","last_clean":"2024-03-04T08:51:38.873140+0000","last_became_active":"2024-03-04T08:51:36.864934+0000","last_became_peered":"2024-03-04T08:51:36.864934+0000","last_unstale":"2024-03-04T08:51:38.873140+0000","last_undegraded":"2024-03-04T08:51:38.873140+0000","last_fullsized":"2024-03-04T08:51:38.873140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.852471+0000","last_change":"2024-03-04T08:51:36.852471+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.852471+0000","last_undegraded":"2024-03-04T08:51:36.852471+0000","last_fullsized":"2024-03-04T08:51:36.852471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.871826+0000","last_change":"2024-03-04T08:51:36.867678+0000","last_active":"2024-03-04T08:51:36.871826+0000","last_peered":"2024-03-04T08:51:36.871826+0000","last_clean":"2024-03-04T08:51:36.871826+0000","last_became_active":"2024-03-04T08:51:36.867357+0000","last_became_peered":"2024-03-04T08:51:36.867357+0000","last_unstale":"2024-03-04T08:51:36.871826+0000","last_undegraded":"2024-03-04T08:51:36.871826+0000","last_fullsized":"2024-03-04T08:51:36.871826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:25.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850242+0000","last_change":"2024-03-04T08:51:36.850242+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850242+0000","last_undegraded":"2024-03-04T08:51:36.850242+0000","last_fullsized":"2024-03-04T08:51:36.850242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872982+0000","last_change":"2024-03-04T08:51:36.864963+0000","last_active":"2024-03-04T08:51:38.872982+0000","last_peered":"2024-03-04T08:51:38.872982+0000","last_clean":"2024-03-04T08:51:38.872982+0000","last_became_active":"2024-03-04T08:51:36.864629+0000","last_became_peered":"2024-03-04T08:51:36.864629+0000","last_unstale":"2024-03-04T08:51:38.872982+0000","last_undegraded":"2024-03-04T08:51:38.872982+0000","last_fullsized":"2024-03-04T08:51:38.872982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:19.925101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851010+0000","last_change":"2024-03-04T08:51:36.851010+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851010+0000","last_undegraded":"2024-03-04T08:51:36.851010+0000","last_fullsized":"2024-03-04T08:51:36.851010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.863992+0000","last_change":"2024-03-04T08:51:36.859342+0000","last_active":"2024-03-04T08:51:36.863992+0000","last_peered":"2024-03-04T08:51:36.863992+0000","last_clean":"2024-03-04T08:51:36.863992+0000","last_became_active":"2024-03-04T08:51:36.859042+0000","last_became_peered":"2024-03-04T08:51:36.859042+0000","last_unstale":"2024-03-04T08:51:36.863992+0000","last_undegraded":"2024-03-04T08:51:36.863992+0000","last_fullsized":"2024-03-04T08:51:36.863992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:29.387173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850933+0000","last_change":"2024-03-04T08:51:36.850933+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850933+0000","last_undegraded":"2024-03-04T08:51:36.850933+0000","last_fullsized":"2024-03-04T08:51:36.850933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872707+0000","last_change":"2024-03-04T08:51:36.865216+0000","last_active":"2024-03-04T08:51:38.872707+0000","last_peered":"2024-03-04T08:51:38.872707+0000","last_clean":"2024-03-04T08:51:38.872707+0000","last_became_active":"2024-03-04T08:51:36.864887+0000","last_became_peered":"2024-03-04T08:51:36.864887+0000","last_unstale":"2024-03-04T08:51:38.872707+0000","last_undegraded":"2024-03-04T08:51:38.872707+0000","last_fullsized":"2024-03-04T08:51:38.872707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.850453+0000","last_change":"2024-03-04T08:51:36.850453+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.850453+0000","last_undegraded":"2024-03-04T08:51:36.850453+0000","last_fullsized":"2024-03-04T08:51:36.850453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392225+0000","last_change":"2024-03-04T08:51:36.856581+0000","last_active":"2024-03-04T08:51:39.392225+0000","last_peered":"2024-03-04T08:51:39.392225+0000","last_clean":"2024-03-04T08:51:39.392225+0000","last_became_active":"2024-03-04T08:51:36.856288+0000","last_became_peered":"2024-03-04T08:51:36.856288+0000","last_unstale":"2024-03-04T08:51:39.392225+0000","last_undegraded":"2024-03-04T08:51:39.392225+0000","last_fullsized":"2024-03-04T08:51:39.392225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:53.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392092+0000","last_change":"2024-03-04T08:51:37.872745+0000","last_active":"2024-03-04T08:51:39.392092+0000","last_peered":"2024-03-04T08:51:39.392092+0000","last_clean":"2024-03-04T08:51:39.392092+0000","last_became_active":"2024-03-04T08:51:37.872463+0000","last_became_peered":"2024-03-04T08:51:37.872463+0000","last_unstale":"2024-03-04T08:51:39.392092+0000","last_undegraded":"2024-03-04T08:51:39.392092+0000","last_fullsized":"2024-03-04T08:51:39.392092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.866704+0000","last_change":"2024-03-04T08:51:36.863377+0000","last_active":"2024-03-04T08:51:36.866704+0000","last_peered":"2024-03-04T08:51:36.866704+0000","last_clean":"2024-03-04T08:51:36.866704+0000","last_became_active":"2024-03-04T08:51:36.863028+0000","last_became_peered":"2024-03-04T08:51:36.863028+0000","last_unstale":"2024-03-04T08:51:36.866704+0000","last_undegraded":"2024-03-04T08:51:36.866704+0000","last_fullsized":"2024-03-04T08:51:36.866704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:24.983053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-04T08:51:36.851177+0000","last_change":"2024-03-04T08:51:36.851177+0000","last_active":"2024-03-04T08:51:36.840369+0000","last_peered":"2024-03-04T08:51:36.840369+0000","last_clean":"2024-03-04T08:51:36.840369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-04T08:51:36.851177+0000","last_undegraded":"2024-03-04T08:51:36.851177+0000","last_fullsized":"2024-03-04T08:51:36.851177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.862743+0000","last_change":"2024-03-04T08:51:36.861136+0000","last_active":"2024-03-04T08:51:36.862743+0000","last_peered":"2024-03-04T08:51:36.862743+0000","last_clean":"2024-03-04T08:51:36.862743+0000","last_became_active":"2024-03-04T08:51:36.860816+0000","last_became_peered":"2024-03-04T08:51:36.860816+0000","last_unstale":"2024-03-04T08:51:36.862743+0000","last_undegraded":"2024-03-04T08:51:36.862743+0000","last_fullsized":"2024-03-04T08:51:36.862743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:37:05.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-04T08:51:36.854496+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:51:36.854496+0000","last_peered":"2024-03-04T08:51:36.854496+0000","last_clean":"2024-03-04T08:51:36.854496+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:51:36.854496+0000","last_undegraded":"2024-03-04T08:51:36.854496+0000","last_fullsized":"2024-03-04T08:51:36.854496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":135732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":726100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:51:42.829 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-03-04T08:51:42.833+0000 7f1ec288a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:51:44.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:44.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:51:45.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:51:45.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.587+0000 7f239433e640 1 Processor -- start 2024-03-04T08:51:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.587+0000 7f239433e640 1 -- start start 2024-03-04T08:51:45.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f238c15dfe0 0x7f238c0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0cf830 0x7f238c0d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f238c0d27f0 0x7f238c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0d2c50 con 0x7f238c0d27f0 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0b31e0 con 0x7f238c15dfe0 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f239433e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b3d60 con 0x7f238c0cf830 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f238c0d27f0 0x7f238c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f238c0d27f0 0x7f238c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41130/0 (socket says 172.21.15.19:41130) 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 -- 172.21.15.19:0/884503468 learned_addr learned my addr 172.21.15.19:0/884503468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23920da640 1 --2- 172.21.15.19:0/884503468 >> v2:172.21.15.204:3300/0 conn(0x7f238c15dfe0 0x7f238c0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23918d9640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0cf830 0x7f238c0d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 -- 172.21.15.19:0/884503468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0cf830 msgr2=0x7f238c0d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0cf830 0x7f238c0d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 -- 172.21.15.19:0/884503468 >> v2:172.21.15.204:3300/0 conn(0x7f238c15dfe0 msgr2=0x7f238c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 --2- 172.21.15.19:0/884503468 >> v2:172.21.15.204:3300/0 conn(0x7f238c15dfe0 0x7f238c0cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.588+0000 7f23928db640 1 -- 172.21.15.19:0/884503468 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0b3430 con 0x7f238c0d27f0 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.589+0000 7f23928db640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0d27f0 0x7f238c0d0300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f238c067990 tx=0x7f238402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee2c0bd563013fb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.589+0000 7f23910d8640 1 -- 172.21.15.19:0/884503468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238402ca70 con 0x7f238c0d27f0 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.589+0000 7f23910d8640 1 -- 172.21.15.19:0/884503468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238402cc10 con 0x7f238c0d27f0 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.589+0000 7f23910d8640 1 -- 172.21.15.19:0/884503468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840343f0 con 0x7f238c0d27f0 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 -- 172.21.15.19:0/884503468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0d27f0 msgr2=0x7f238c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0d27f0 0x7f238c0d0300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f238c067990 tx=0x7f238402bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 -- 172.21.15.19:0/884503468 shutdown_connections 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0d27f0 0x7f238c0d0300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 --2- 172.21.15.19:0/884503468 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0cf830 0x7f238c0d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 --2- 172.21.15.19:0/884503468 >> v2:172.21.15.204:3300/0 conn(0x7f238c15dfe0 0x7f238c0cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 -- 172.21.15.19:0/884503468 >> 172.21.15.19:0/884503468 conn(0x7f238c0d3cd0 msgr2=0x7f238c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:45.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 -- 172.21.15.19:0/884503468 shutdown_connections 2024-03-04T08:51:45.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.590+0000 7f239433e640 1 -- 172.21.15.19:0/884503468 wait complete. 2024-03-04T08:51:45.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.591+0000 7f239433e640 1 Processor -- start 2024-03-04T08:51:45.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.591+0000 7f239433e640 1 -- start start 2024-03-04T08:51:45.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 0x7f238c0b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 0x7f238c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0d1c70 con 0x7f238c0cf830 2024-03-04T08:51:45.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b39f0 con 0x7f238c15dfe0 2024-03-04T08:51:45.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f239433e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0d1df0 con 0x7f238c0d27f0 2024-03-04T08:51:45.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41136/0 (socket says 172.21.15.19:41136) 2024-03-04T08:51:45.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 -- 172.21.15.19:0/783210999 learned_addr learned my addr 172.21.15.19:0/783210999 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:45.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23918d9640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 0x7f238c0b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23928db640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 0x7f238c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 -- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 msgr2=0x7f238c0b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 0x7f238c0b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 -- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 msgr2=0x7f238c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 0x7f238c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23920da640 1 -- 172.21.15.19:0/783210999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0cc6b0 con 0x7f238c0cf830 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23918d9640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 0x7f238c0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.592+0000 7f23928db640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 0x7f238c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f23920da640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f238800d5f0 tx=0x7f238800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880125f0 con 0x7f238c0cf830 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388019070 con 0x7f238c0cf830 2024-03-04T08:51:45.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c0cc920 con 0x7f238c0cf830 2024-03-04T08:51:45.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880129d0 con 0x7f238c0cf830 2024-03-04T08:51:45.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.593+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c0ccee0 con 0x7f238c0cf830 2024-03-04T08:51:45.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.594+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c04f330 con 0x7f238c0cf830 2024-03-04T08:51:45.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.594+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2388012b70 con 0x7f238c0cf830 2024-03-04T08:51:45.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.595+0000 7f2382ffd640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 0x7f237006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.595+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f238808a5c0 con 0x7f238c0cf830 2024-03-04T08:51:45.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.595+0000 7f23918d9640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 0x7f237006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.596+0000 7f23918d9640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 0x7f237006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f238c06d330 tx=0x7f237c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.599+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2388059440 con 0x7f238c0cf830 2024-03-04T08:51:45.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.778+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f238c0cea10 con 0x7f237006b4d0 2024-03-04T08:51:45.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.784+0000 7f2382ffd640 1 -- 172.21.15.19:0/783210999 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251950 (secure 0 0 0) 0x7f238c0cea10 con 0x7f237006b4d0 2024-03-04T08:51:45.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:45.785 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:51:45.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 msgr2=0x7f237006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 0x7f237006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f238c06d330 tx=0x7f237c008040 comp rx=0 tx=0).stop 2024-03-04T08:51:45.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 msgr2=0x7f238c157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f238800d5f0 tx=0x7f238800dab0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 shutdown_connections 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f237006b4d0 0x7f237006d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f238c15dfe0 0x7f238c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f238c0d27f0 0x7f238c0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 --2- 172.21.15.19:0/783210999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f238c0cf830 0x7f238c157bb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 >> 172.21.15.19:0/783210999 conn(0x7f238c0d3cd0 msgr2=0x7f238c0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 shutdown_connections 2024-03-04T08:51:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.787+0000 7f239433e640 1 -- 172.21.15.19:0/783210999 wait complete. 2024-03-04T08:51:45.794 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-04T08:51:45.151971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224500,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750220,"statfs":{"total":773094113280,"available":772864225280,"internally_reserved":0,"allocated":4268032,"data_stored":2376012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001950"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391331+0000","last_change":"2024-03-04T08:51:37.872374+0000","last_active":"2024-03-04T08:51:39.391331+0000","last_peered":"2024-03-04T08:51:39.391331+0000","last_clean":"2024-03-04T08:51:39.391331+0000","last_became_active":"2024-03-04T08:51:37.872080+0000","last_became_peered":"2024-03-04T08:51:37.872080+0000","last_unstale":"2024-03-04T08:51:39.391331+0000","last_undegraded":"2024-03-04T08:51:39.391331+0000","last_fullsized":"2024-03-04T08:51:39.391331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:34.080605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866644+0000","last_change":"2024-03-04T08:51:37.872881+0000","last_active":"2024-03-04T08:51:38.866644+0000","last_peered":"2024-03-04T08:51:38.866644+0000","last_clean":"2024-03-04T08:51:38.866644+0000","last_became_active":"2024-03-04T08:51:37.872620+0000","last_became_peered":"2024-03-04T08:51:37.872620+0000","last_unstale":"2024-03-04T08:51:38.866644+0000","last_undegraded":"2024-03-04T08:51:38.866644+0000","last_fullsized":"2024-03-04T08:51:38.866644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:31.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391872+0000","last_change":"2024-03-04T08:51:37.874595+0000","last_active":"2024-03-04T08:51:39.391872+0000","last_peered":"2024-03-04T08:51:39.391872+0000","last_clean":"2024-03-04T08:51:39.391872+0000","last_became_active":"2024-03-04T08:51:37.874337+0000","last_became_peered":"2024-03-04T08:51:37.874337+0000","last_unstale":"2024-03-04T08:51:39.391872+0000","last_undegraded":"2024-03-04T08:51:39.391872+0000","last_fullsized":"2024-03-04T08:51:39.391872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:58:45.219925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872827+0000","last_change":"2024-03-04T08:51:37.876460+0000","last_active":"2024-03-04T08:51:38.872827+0000","last_peered":"2024-03-04T08:51:38.872827+0000","last_clean":"2024-03-04T08:51:38.872827+0000","last_became_active":"2024-03-04T08:51:37.876191+0000","last_became_peered":"2024-03-04T08:51:37.876191+0000","last_unstale":"2024-03-04T08:51:38.872827+0000","last_undegraded":"2024-03-04T08:51:38.872827+0000","last_fullsized":"2024-03-04T08:51:38.872827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390188+0000","last_change":"2024-03-04T08:51:37.867949+0000","last_active":"2024-03-04T08:51:39.390188+0000","last_peered":"2024-03-04T08:51:39.390188+0000","last_clean":"2024-03-04T08:51:39.390188+0000","last_became_active":"2024-03-04T08:51:37.867682+0000","last_became_peered":"2024-03-04T08:51:37.867682+0000","last_unstale":"2024-03-04T08:51:39.390188+0000","last_undegraded":"2024-03-04T08:51:39.390188+0000","last_fullsized":"2024-03-04T08:51:39.390188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:26.689751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866268+0000","last_change":"2024-03-04T08:51:37.875385+0000","last_active":"2024-03-04T08:51:38.866268+0000","last_peered":"2024-03-04T08:51:38.866268+0000","last_clean":"2024-03-04T08:51:38.866268+0000","last_became_active":"2024-03-04T08:51:37.874977+0000","last_became_peered":"2024-03-04T08:51:37.874977+0000","last_unstale":"2024-03-04T08:51:38.866268+0000","last_undegraded":"2024-03-04T08:51:38.866268+0000","last_fullsized":"2024-03-04T08:51:38.866268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:50:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869457+0000","last_change":"2024-03-04T08:51:37.869641+0000","last_active":"2024-03-04T08:51:38.869457+0000","last_peered":"2024-03-04T08:51:38.869457+0000","last_clean":"2024-03-04T08:51:38.869457+0000","last_became_active":"2024-03-04T08:51:37.867143+0000","last_became_peered":"2024-03-04T08:51:37.867143+0000","last_unstale":"2024-03-04T08:51:38.869457+0000","last_undegraded":"2024-03-04T08:51:38.869457+0000","last_fullsized":"2024-03-04T08:51:38.869457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:07:42.942517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869029+0000","last_change":"2024-03-04T08:51:37.867240+0000","last_active":"2024-03-04T08:51:38.869029+0000","last_peered":"2024-03-04T08:51:38.869029+0000","last_clean":"2024-03-04T08:51:38.869029+0000","last_became_active":"2024-03-04T08:51:37.866961+0000","last_became_peered":"2024-03-04T08:51:37.866961+0000","last_unstale":"2024-03-04T08:51:38.869029+0000","last_undegraded":"2024-03-04T08:51:38.869029+0000","last_fullsized":"2024-03-04T08:51:38.869029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:31.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392010+0000","last_change":"2024-03-04T08:51:37.871847+0000","last_active":"2024-03-04T08:51:39.392010+0000","last_peered":"2024-03-04T08:51:39.392010+0000","last_clean":"2024-03-04T08:51:39.392010+0000","last_became_active":"2024-03-04T08:51:37.871513+0000","last_became_peered":"2024-03-04T08:51:37.871513+0000","last_unstale":"2024-03-04T08:51:39.392010+0000","last_undegraded":"2024-03-04T08:51:39.392010+0000","last_fullsized":"2024-03-04T08:51:39.392010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872958+0000","last_change":"2024-03-04T08:51:37.881764+0000","last_active":"2024-03-04T08:51:38.872958+0000","last_peered":"2024-03-04T08:51:38.872958+0000","last_clean":"2024-03-04T08:51:38.872958+0000","last_became_active":"2024-03-04T08:51:37.881212+0000","last_became_peered":"2024-03-04T08:51:37.881212+0000","last_unstale":"2024-03-04T08:51:38.872958+0000","last_undegraded":"2024-03-04T08:51:38.872958+0000","last_fullsized":"2024-03-04T08:51:38.872958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869466+0000","last_change":"2024-03-04T08:51:37.869763+0000","last_active":"2024-03-04T08:51:38.869466+0000","last_peered":"2024-03-04T08:51:38.869466+0000","last_clean":"2024-03-04T08:51:38.869466+0000","last_became_active":"2024-03-04T08:51:37.869504+0000","last_became_peered":"2024-03-04T08:51:37.869504+0000","last_unstale":"2024-03-04T08:51:38.869466+0000","last_undegraded":"2024-03-04T08:51:38.869466+0000","last_fullsized":"2024-03-04T08:51:38.869466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:58:45.219925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392031+0000","last_change":"2024-03-04T08:51:37.880925+0000","last_active":"2024-03-04T08:51:39.392031+0000","last_peered":"2024-03-04T08:51:39.392031+0000","last_clean":"2024-03-04T08:51:39.392031+0000","last_became_active":"2024-03-04T08:51:37.880520+0000","last_became_peered":"2024-03-04T08:51:37.880520+0000","last_unstale":"2024-03-04T08:51:39.392031+0000","last_undegraded":"2024-03-04T08:51:39.392031+0000","last_fullsized":"2024-03-04T08:51:39.392031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:30:54.409675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390181+0000","last_change":"2024-03-04T08:51:37.871013+0000","last_active":"2024-03-04T08:51:39.390181+0000","last_peered":"2024-03-04T08:51:39.390181+0000","last_clean":"2024-03-04T08:51:39.390181+0000","last_became_active":"2024-03-04T08:51:37.870732+0000","last_became_peered":"2024-03-04T08:51:37.870732+0000","last_unstale":"2024-03-04T08:51:39.390181+0000","last_undegraded":"2024-03-04T08:51:39.390181+0000","last_fullsized":"2024-03-04T08:51:39.390181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:20.385287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866409+0000","last_change":"2024-03-04T08:51:37.866889+0000","last_active":"2024-03-04T08:51:38.866409+0000","last_peered":"2024-03-04T08:51:38.866409+0000","last_clean":"2024-03-04T08:51:38.866409+0000","last_became_active":"2024-03-04T08:51:37.866543+0000","last_became_peered":"2024-03-04T08:51:37.866543+0000","last_unstale":"2024-03-04T08:51:38.866409+0000","last_undegraded":"2024-03-04T08:51:38.866409+0000","last_fullsized":"2024-03-04T08:51:38.866409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:01.675027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391363+0000","last_change":"2024-03-04T08:51:37.874099+0000","last_active":"2024-03-04T08:51:39.391363+0000","last_peered":"2024-03-04T08:51:39.391363+0000","last_clean":"2024-03-04T08:51:39.391363+0000","last_became_active":"2024-03-04T08:51:37.873847+0000","last_became_peered":"2024-03-04T08:51:37.873847+0000","last_unstale":"2024-03-04T08:51:39.391363+0000","last_undegraded":"2024-03-04T08:51:39.391363+0000","last_fullsized":"2024-03-04T08:51:39.391363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:59.538397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869474+0000","last_change":"2024-03-04T08:51:37.881107+0000","last_active":"2024-03-04T08:51:38.869474+0000","last_peered":"2024-03-04T08:51:38.869474+0000","last_clean":"2024-03-04T08:51:38.869474+0000","last_became_active":"2024-03-04T08:51:37.880827+0000","last_became_peered":"2024-03-04T08:51:37.880827+0000","last_unstale":"2024-03-04T08:51:38.869474+0000","last_undegraded":"2024-03-04T08:51:38.869474+0000","last_fullsized":"2024-03-04T08:51:38.869474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:30:54.409675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869637+0000","last_change":"2024-03-04T08:51:37.868119+0000","last_active":"2024-03-04T08:51:38.869637+0000","last_peered":"2024-03-04T08:51:38.869637+0000","last_clean":"2024-03-04T08:51:38.869637+0000","last_became_active":"2024-03-04T08:51:37.867560+0000","last_became_peered":"2024-03-04T08:51:37.867560+0000","last_unstale":"2024-03-04T08:51:38.869637+0000","last_undegraded":"2024-03-04T08:51:38.869637+0000","last_fullsized":"2024-03-04T08:51:38.869637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:34.370542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866792+0000","last_change":"2024-03-04T08:51:37.878919+0000","last_active":"2024-03-04T08:51:38.866792+0000","last_peered":"2024-03-04T08:51:38.866792+0000","last_clean":"2024-03-04T08:51:38.866792+0000","last_became_active":"2024-03-04T08:51:37.878649+0000","last_became_peered":"2024-03-04T08:51:37.878649+0000","last_unstale":"2024-03-04T08:51:38.866792+0000","last_undegraded":"2024-03-04T08:51:38.866792+0000","last_fullsized":"2024-03-04T08:51:38.866792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:07:42.942517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866416+0000","last_change":"2024-03-04T08:51:37.877356+0000","last_active":"2024-03-04T08:51:38.866416+0000","last_peered":"2024-03-04T08:51:38.866416+0000","last_clean":"2024-03-04T08:51:38.866416+0000","last_became_active":"2024-03-04T08:51:37.877038+0000","last_became_peered":"2024-03-04T08:51:37.877038+0000","last_unstale":"2024-03-04T08:51:38.866416+0000","last_undegraded":"2024-03-04T08:51:38.866416+0000","last_fullsized":"2024-03-04T08:51:38.866416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:06:53.093134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390254+0000","last_change":"2024-03-04T08:51:37.869919+0000","last_active":"2024-03-04T08:51:39.390254+0000","last_peered":"2024-03-04T08:51:39.390254+0000","last_clean":"2024-03-04T08:51:39.390254+0000","last_became_active":"2024-03-04T08:51:37.869658+0000","last_became_peered":"2024-03-04T08:51:37.869658+0000","last_unstale":"2024-03-04T08:51:39.390254+0000","last_undegraded":"2024-03-04T08:51:39.390254+0000","last_fullsized":"2024-03-04T08:51:39.390254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:00.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392188+0000","last_change":"2024-03-04T08:51:37.872571+0000","last_active":"2024-03-04T08:51:39.392188+0000","last_peered":"2024-03-04T08:51:39.392188+0000","last_clean":"2024-03-04T08:51:39.392188+0000","last_became_active":"2024-03-04T08:51:37.871862+0000","last_became_peered":"2024-03-04T08:51:37.871862+0000","last_unstale":"2024-03-04T08:51:39.392188+0000","last_undegraded":"2024-03-04T08:51:39.392188+0000","last_fullsized":"2024-03-04T08:51:39.392188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:17.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391611+0000","last_change":"2024-03-04T08:51:37.873090+0000","last_active":"2024-03-04T08:51:39.391611+0000","last_peered":"2024-03-04T08:51:39.391611+0000","last_clean":"2024-03-04T08:51:39.391611+0000","last_became_active":"2024-03-04T08:51:37.872648+0000","last_became_peered":"2024-03-04T08:51:37.872648+0000","last_unstale":"2024-03-04T08:51:39.391611+0000","last_undegraded":"2024-03-04T08:51:39.391611+0000","last_fullsized":"2024-03-04T08:51:39.391611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866031+0000","last_change":"2024-03-04T08:51:37.873525+0000","last_active":"2024-03-04T08:51:38.866031+0000","last_peered":"2024-03-04T08:51:38.866031+0000","last_clean":"2024-03-04T08:51:38.866031+0000","last_became_active":"2024-03-04T08:51:37.873164+0000","last_became_peered":"2024-03-04T08:51:37.873164+0000","last_unstale":"2024-03-04T08:51:38.866031+0000","last_undegraded":"2024-03-04T08:51:38.866031+0000","last_fullsized":"2024-03-04T08:51:38.866031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:59.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390809+0000","last_change":"2024-03-04T08:51:37.871655+0000","last_active":"2024-03-04T08:51:39.390809+0000","last_peered":"2024-03-04T08:51:39.390809+0000","last_clean":"2024-03-04T08:51:39.390809+0000","last_became_active":"2024-03-04T08:51:37.871400+0000","last_became_peered":"2024-03-04T08:51:37.871400+0000","last_unstale":"2024-03-04T08:51:39.390809+0000","last_undegraded":"2024-03-04T08:51:39.390809+0000","last_fullsized":"2024-03-04T08:51:39.390809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:31.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873039+0000","last_change":"2024-03-04T08:51:37.873138+0000","last_active":"2024-03-04T08:51:38.873039+0000","last_peered":"2024-03-04T08:51:38.873039+0000","last_clean":"2024-03-04T08:51:38.873039+0000","last_became_active":"2024-03-04T08:51:37.872797+0000","last_became_peered":"2024-03-04T08:51:37.872797+0000","last_unstale":"2024-03-04T08:51:38.873039+0000","last_undegraded":"2024-03-04T08:51:38.873039+0000","last_fullsized":"2024-03-04T08:51:38.873039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.867028+0000","last_change":"2024-03-04T08:51:37.876486+0000","last_active":"2024-03-04T08:51:38.867028+0000","last_peered":"2024-03-04T08:51:38.867028+0000","last_clean":"2024-03-04T08:51:38.867028+0000","last_became_active":"2024-03-04T08:51:37.876231+0000","last_became_peered":"2024-03-04T08:51:37.876231+0000","last_unstale":"2024-03-04T08:51:38.867028+0000","last_undegraded":"2024-03-04T08:51:38.867028+0000","last_fullsized":"2024-03-04T08:51:38.867028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:06.265199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873131+0000","last_change":"2024-03-04T08:51:37.874965+0000","last_active":"2024-03-04T08:51:38.873131+0000","last_peered":"2024-03-04T08:51:38.873131+0000","last_clean":"2024-03-04T08:51:38.873131+0000","last_became_active":"2024-03-04T08:51:37.874674+0000","last_became_peered":"2024-03-04T08:51:37.874674+0000","last_unstale":"2024-03-04T08:51:38.873131+0000","last_undegraded":"2024-03-04T08:51:38.873131+0000","last_fullsized":"2024-03-04T08:51:38.873131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:42.266540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392174+0000","last_change":"2024-03-04T08:51:37.869448+0000","last_active":"2024-03-04T08:51:39.392174+0000","last_peered":"2024-03-04T08:51:39.392174+0000","last_clean":"2024-03-04T08:51:39.392174+0000","last_became_active":"2024-03-04T08:51:37.869152+0000","last_became_peered":"2024-03-04T08:51:37.869152+0000","last_unstale":"2024-03-04T08:51:39.392174+0000","last_undegraded":"2024-03-04T08:51:39.392174+0000","last_fullsized":"2024-03-04T08:51:39.392174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:34.370542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392332+0000","last_change":"2024-03-04T08:51:37.870986+0000","last_active":"2024-03-04T08:51:39.392332+0000","last_peered":"2024-03-04T08:51:39.392332+0000","last_clean":"2024-03-04T08:51:39.392332+0000","last_became_active":"2024-03-04T08:51:37.870677+0000","last_became_peered":"2024-03-04T08:51:37.870677+0000","last_unstale":"2024-03-04T08:51:39.392332+0000","last_undegraded":"2024-03-04T08:51:39.392332+0000","last_fullsized":"2024-03-04T08:51:39.392332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:34:20.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869280+0000","last_change":"2024-03-04T08:51:37.867432+0000","last_active":"2024-03-04T08:51:38.869280+0000","last_peered":"2024-03-04T08:51:38.869280+0000","last_clean":"2024-03-04T08:51:38.869280+0000","last_became_active":"2024-03-04T08:51:37.866945+0000","last_became_peered":"2024-03-04T08:51:37.866945+0000","last_unstale":"2024-03-04T08:51:38.869280+0000","last_undegraded":"2024-03-04T08:51:38.869280+0000","last_fullsized":"2024-03-04T08:51:38.869280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:06:53.093134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391198+0000","last_change":"2024-03-04T08:51:37.866755+0000","last_active":"2024-03-04T08:51:39.391198+0000","last_peered":"2024-03-04T08:51:39.391198+0000","last_clean":"2024-03-04T08:51:39.391198+0000","last_became_active":"2024-03-04T08:51:37.866469+0000","last_became_peered":"2024-03-04T08:51:37.866469+0000","last_unstale":"2024-03-04T08:51:39.391198+0000","last_undegraded":"2024-03-04T08:51:39.391198+0000","last_fullsized":"2024-03-04T08:51:39.391198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:42.419602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869023+0000","last_change":"2024-03-04T08:51:37.875975+0000","last_active":"2024-03-04T08:51:38.869023+0000","last_peered":"2024-03-04T08:51:38.869023+0000","last_clean":"2024-03-04T08:51:38.869023+0000","last_became_active":"2024-03-04T08:51:37.875713+0000","last_became_peered":"2024-03-04T08:51:37.875713+0000","last_unstale":"2024-03-04T08:51:38.869023+0000","last_undegraded":"2024-03-04T08:51:38.869023+0000","last_fullsized":"2024-03-04T08:51:38.869023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:32.057835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.867136+0000","last_change":"2024-03-04T08:51:37.871373+0000","last_active":"2024-03-04T08:51:38.867136+0000","last_peered":"2024-03-04T08:51:38.867136+0000","last_clean":"2024-03-04T08:51:38.867136+0000","last_became_active":"2024-03-04T08:51:37.871029+0000","last_became_peered":"2024-03-04T08:51:37.871029+0000","last_unstale":"2024-03-04T08:51:38.867136+0000","last_undegraded":"2024-03-04T08:51:38.867136+0000","last_fullsized":"2024-03-04T08:51:38.867136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:52.015555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391349+0000","last_change":"2024-03-04T08:51:36.861353+0000","last_active":"2024-03-04T08:51:39.391349+0000","last_peered":"2024-03-04T08:51:39.391349+0000","last_clean":"2024-03-04T08:51:39.391349+0000","last_became_active":"2024-03-04T08:51:36.861087+0000","last_became_peered":"2024-03-04T08:51:36.861087+0000","last_unstale":"2024-03-04T08:51:39.391349+0000","last_undegraded":"2024-03-04T08:51:39.391349+0000","last_fullsized":"2024-03-04T08:51:39.391349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:59.042417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391246+0000","last_change":"2024-03-04T08:51:37.870824+0000","last_active":"2024-03-04T08:51:39.391246+0000","last_peered":"2024-03-04T08:51:39.391246+0000","last_clean":"2024-03-04T08:51:39.391246+0000","last_became_active":"2024-03-04T08:51:37.870538+0000","last_became_peered":"2024-03-04T08:51:37.870538+0000","last_unstale":"2024-03-04T08:51:39.391246+0000","last_undegraded":"2024-03-04T08:51:39.391246+0000","last_fullsized":"2024-03-04T08:51:39.391246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:38.467049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.867078+0000","last_change":"2024-03-04T08:51:36.862187+0000","last_active":"2024-03-04T08:51:38.867078+0000","last_peered":"2024-03-04T08:51:38.867078+0000","last_clean":"2024-03-04T08:51:38.867078+0000","last_became_active":"2024-03-04T08:51:36.861833+0000","last_became_peered":"2024-03-04T08:51:36.861833+0000","last_unstale":"2024-03-04T08:51:38.867078+0000","last_undegraded":"2024-03-04T08:51:38.867078+0000","last_fullsized":"2024-03-04T08:51:38.867078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:09.770388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392416+0000","last_change":"2024-03-04T08:51:37.880138+0000","last_active":"2024-03-04T08:51:39.392416+0000","last_peered":"2024-03-04T08:51:39.392416+0000","last_clean":"2024-03-04T08:51:39.392416+0000","last_became_active":"2024-03-04T08:51:37.879016+0000","last_became_peered":"2024-03-04T08:51:37.879016+0000","last_unstale":"2024-03-04T08:51:39.392416+0000","last_undegraded":"2024-03-04T08:51:39.392416+0000","last_fullsized":"2024-03-04T08:51:39.392416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866378+0000","last_change":"2024-03-04T08:51:36.867819+0000","last_active":"2024-03-04T08:51:38.866378+0000","last_peered":"2024-03-04T08:51:38.866378+0000","last_clean":"2024-03-04T08:51:38.866378+0000","last_became_active":"2024-03-04T08:51:36.867496+0000","last_became_peered":"2024-03-04T08:51:36.867496+0000","last_unstale":"2024-03-04T08:51:38.866378+0000","last_undegraded":"2024-03-04T08:51:38.866378+0000","last_fullsized":"2024-03-04T08:51:38.866378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:58.743760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873129+0000","last_change":"2024-03-04T08:51:37.873799+0000","last_active":"2024-03-04T08:51:38.873129+0000","last_peered":"2024-03-04T08:51:38.873129+0000","last_clean":"2024-03-04T08:51:38.873129+0000","last_became_active":"2024-03-04T08:51:37.873368+0000","last_became_peered":"2024-03-04T08:51:37.873368+0000","last_unstale":"2024-03-04T08:51:38.873129+0000","last_undegraded":"2024-03-04T08:51:38.873129+0000","last_fullsized":"2024-03-04T08:51:38.873129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:31.241171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390342+0000","last_change":"2024-03-04T08:51:36.865647+0000","last_active":"2024-03-04T08:51:39.390342+0000","last_peered":"2024-03-04T08:51:39.390342+0000","last_clean":"2024-03-04T08:51:39.390342+0000","last_became_active":"2024-03-04T08:51:36.865371+0000","last_became_peered":"2024-03-04T08:51:36.865371+0000","last_unstale":"2024-03-04T08:51:39.390342+0000","last_undegraded":"2024-03-04T08:51:39.390342+0000","last_fullsized":"2024-03-04T08:51:39.390342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:02.771517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869215+0000","last_change":"2024-03-04T08:51:37.875700+0000","last_active":"2024-03-04T08:51:38.869215+0000","last_peered":"2024-03-04T08:51:38.869215+0000","last_clean":"2024-03-04T08:51:38.869215+0000","last_became_active":"2024-03-04T08:51:37.875405+0000","last_became_peered":"2024-03-04T08:51:37.875405+0000","last_unstale":"2024-03-04T08:51:38.869215+0000","last_undegraded":"2024-03-04T08:51:38.869215+0000","last_fullsized":"2024-03-04T08:51:38.869215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:01.675027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392295+0000","last_change":"2024-03-04T08:51:36.859075+0000","last_active":"2024-03-04T08:51:39.392295+0000","last_peered":"2024-03-04T08:51:39.392295+0000","last_clean":"2024-03-04T08:51:39.392295+0000","last_became_active":"2024-03-04T08:51:36.858824+0000","last_became_peered":"2024-03-04T08:51:36.858824+0000","last_unstale":"2024-03-04T08:51:39.392295+0000","last_undegraded":"2024-03-04T08:51:39.392295+0000","last_fullsized":"2024-03-04T08:51:39.392295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:07.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391770+0000","last_change":"2024-03-04T08:51:37.870892+0000","last_active":"2024-03-04T08:51:39.391770+0000","last_peered":"2024-03-04T08:51:39.391770+0000","last_clean":"2024-03-04T08:51:39.391770+0000","last_became_active":"2024-03-04T08:51:37.870334+0000","last_became_peered":"2024-03-04T08:51:37.870334+0000","last_unstale":"2024-03-04T08:51:39.391770+0000","last_undegraded":"2024-03-04T08:51:39.391770+0000","last_fullsized":"2024-03-04T08:51:39.391770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:06:53.093134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391740+0000","last_change":"2024-03-04T08:51:36.859719+0000","last_active":"2024-03-04T08:51:39.391740+0000","last_peered":"2024-03-04T08:51:39.391740+0000","last_clean":"2024-03-04T08:51:39.391740+0000","last_became_active":"2024-03-04T08:51:36.859453+0000","last_became_peered":"2024-03-04T08:51:36.859453+0000","last_unstale":"2024-03-04T08:51:39.391740+0000","last_undegraded":"2024-03-04T08:51:39.391740+0000","last_fullsized":"2024-03-04T08:51:39.391740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391315+0000","last_change":"2024-03-04T08:51:37.864891+0000","last_active":"2024-03-04T08:51:39.391315+0000","last_peered":"2024-03-04T08:51:39.391315+0000","last_clean":"2024-03-04T08:51:39.391315+0000","last_became_active":"2024-03-04T08:51:37.864575+0000","last_became_peered":"2024-03-04T08:51:37.864575+0000","last_unstale":"2024-03-04T08:51:39.391315+0000","last_undegraded":"2024-03-04T08:51:39.391315+0000","last_fullsized":"2024-03-04T08:51:39.391315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:41.263175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866636+0000","last_change":"2024-03-04T08:51:36.862686+0000","last_active":"2024-03-04T08:51:38.866636+0000","last_peered":"2024-03-04T08:51:38.866636+0000","last_clean":"2024-03-04T08:51:38.866636+0000","last_became_active":"2024-03-04T08:51:36.862384+0000","last_became_peered":"2024-03-04T08:51:36.862384+0000","last_unstale":"2024-03-04T08:51:38.866636+0000","last_undegraded":"2024-03-04T08:51:38.866636+0000","last_fullsized":"2024-03-04T08:51:38.866636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:43.796665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872573+0000","last_change":"2024-03-04T08:51:37.870071+0000","last_active":"2024-03-04T08:51:38.872573+0000","last_peered":"2024-03-04T08:51:38.872573+0000","last_clean":"2024-03-04T08:51:38.872573+0000","last_became_active":"2024-03-04T08:51:37.869797+0000","last_became_peered":"2024-03-04T08:51:37.869797+0000","last_unstale":"2024-03-04T08:51:38.872573+0000","last_undegraded":"2024-03-04T08:51:38.872573+0000","last_fullsized":"2024-03-04T08:51:38.872573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:59:48.132112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391413+0000","last_change":"2024-03-04T08:51:36.862238+0000","last_active":"2024-03-04T08:51:39.391413+0000","last_peered":"2024-03-04T08:51:39.391413+0000","last_clean":"2024-03-04T08:51:39.391413+0000","last_became_active":"2024-03-04T08:51:36.861973+0000","last_became_peered":"2024-03-04T08:51:36.861973+0000","last_unstale":"2024-03-04T08:51:39.391413+0000","last_undegraded":"2024-03-04T08:51:39.391413+0000","last_fullsized":"2024-03-04T08:51:39.391413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391512+0000","last_change":"2024-03-04T08:51:37.880714+0000","last_active":"2024-03-04T08:51:39.391512+0000","last_peered":"2024-03-04T08:51:39.391512+0000","last_clean":"2024-03-04T08:51:39.391512+0000","last_became_active":"2024-03-04T08:51:37.880422+0000","last_became_peered":"2024-03-04T08:51:37.880422+0000","last_unstale":"2024-03-04T08:51:39.391512+0000","last_undegraded":"2024-03-04T08:51:39.391512+0000","last_fullsized":"2024-03-04T08:51:39.391512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:50:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866866+0000","last_change":"2024-03-04T08:51:36.863469+0000","last_active":"2024-03-04T08:51:38.866866+0000","last_peered":"2024-03-04T08:51:38.866866+0000","last_clean":"2024-03-04T08:51:38.866866+0000","last_became_active":"2024-03-04T08:51:36.863185+0000","last_became_peered":"2024-03-04T08:51:36.863185+0000","last_unstale":"2024-03-04T08:51:38.866866+0000","last_undegraded":"2024-03-04T08:51:38.866866+0000","last_fullsized":"2024-03-04T08:51:38.866866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:37.459116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866803+0000","last_change":"2024-03-04T08:51:37.879031+0000","last_active":"2024-03-04T08:51:38.866803+0000","last_peered":"2024-03-04T08:51:38.866803+0000","last_clean":"2024-03-04T08:51:38.866803+0000","last_became_active":"2024-03-04T08:51:37.878761+0000","last_became_peered":"2024-03-04T08:51:37.878761+0000","last_unstale":"2024-03-04T08:51:38.866803+0000","last_undegraded":"2024-03-04T08:51:38.866803+0000","last_fullsized":"2024-03-04T08:51:38.866803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:30:54.409675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.867234+0000","last_change":"2024-03-04T08:51:36.864814+0000","last_active":"2024-03-04T08:51:38.867234+0000","last_peered":"2024-03-04T08:51:38.867234+0000","last_clean":"2024-03-04T08:51:38.867234+0000","last_became_active":"2024-03-04T08:51:36.864469+0000","last_became_peered":"2024-03-04T08:51:36.864469+0000","last_unstale":"2024-03-04T08:51:38.867234+0000","last_undegraded":"2024-03-04T08:51:38.867234+0000","last_fullsized":"2024-03-04T08:51:38.867234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:55.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866797+0000","last_change":"2024-03-04T08:51:37.887275+0000","last_active":"2024-03-04T08:51:38.866797+0000","last_peered":"2024-03-04T08:51:38.866797+0000","last_clean":"2024-03-04T08:51:38.866797+0000","last_became_active":"2024-03-04T08:51:37.886947+0000","last_became_peered":"2024-03-04T08:51:37.886947+0000","last_unstale":"2024-03-04T08:51:38.866797+0000","last_undegraded":"2024-03-04T08:51:38.866797+0000","last_fullsized":"2024-03-04T08:51:38.866797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:34.370542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391984+0000","last_change":"2024-03-04T08:51:36.862948+0000","last_active":"2024-03-04T08:51:39.391984+0000","last_peered":"2024-03-04T08:51:39.391984+0000","last_clean":"2024-03-04T08:51:39.391984+0000","last_became_active":"2024-03-04T08:51:36.862660+0000","last_became_peered":"2024-03-04T08:51:36.862660+0000","last_unstale":"2024-03-04T08:51:39.391984+0000","last_undegraded":"2024-03-04T08:51:39.391984+0000","last_fullsized":"2024-03-04T08:51:39.391984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:07.297239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391534+0000","last_change":"2024-03-04T08:51:37.874548+0000","last_active":"2024-03-04T08:51:39.391534+0000","last_peered":"2024-03-04T08:51:39.391534+0000","last_clean":"2024-03-04T08:51:39.391534+0000","last_became_active":"2024-03-04T08:51:37.874251+0000","last_became_peered":"2024-03-04T08:51:37.874251+0000","last_unstale":"2024-03-04T08:51:39.391534+0000","last_undegraded":"2024-03-04T08:51:39.391534+0000","last_fullsized":"2024-03-04T08:51:39.391534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:01.675027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866980+0000","last_change":"2024-03-04T08:51:36.868052+0000","last_active":"2024-03-04T08:51:38.866980+0000","last_peered":"2024-03-04T08:51:38.866980+0000","last_clean":"2024-03-04T08:51:38.866980+0000","last_became_active":"2024-03-04T08:51:36.867386+0000","last_became_peered":"2024-03-04T08:51:36.867386+0000","last_unstale":"2024-03-04T08:51:38.866980+0000","last_undegraded":"2024-03-04T08:51:38.866980+0000","last_fullsized":"2024-03-04T08:51:38.866980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:51.601723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872657+0000","last_change":"2024-03-04T08:51:37.874458+0000","last_active":"2024-03-04T08:51:38.872657+0000","last_peered":"2024-03-04T08:51:38.872657+0000","last_clean":"2024-03-04T08:51:38.872657+0000","last_became_active":"2024-03-04T08:51:37.873503+0000","last_became_peered":"2024-03-04T08:51:37.873503+0000","last_unstale":"2024-03-04T08:51:38.872657+0000","last_undegraded":"2024-03-04T08:51:38.872657+0000","last_fullsized":"2024-03-04T08:51:38.872657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:04.903492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392385+0000","last_change":"2024-03-04T08:51:36.862148+0000","last_active":"2024-03-04T08:51:39.392385+0000","last_peered":"2024-03-04T08:51:39.392385+0000","last_clean":"2024-03-04T08:51:39.392385+0000","last_became_active":"2024-03-04T08:51:36.861872+0000","last_became_peered":"2024-03-04T08:51:36.861872+0000","last_unstale":"2024-03-04T08:51:39.392385+0000","last_undegraded":"2024-03-04T08:51:39.392385+0000","last_fullsized":"2024-03-04T08:51:39.392385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866584+0000","last_change":"2024-03-04T08:51:37.871344+0000","last_active":"2024-03-04T08:51:38.866584+0000","last_peered":"2024-03-04T08:51:38.866584+0000","last_clean":"2024-03-04T08:51:38.866584+0000","last_became_active":"2024-03-04T08:51:37.871077+0000","last_became_peered":"2024-03-04T08:51:37.871077+0000","last_unstale":"2024-03-04T08:51:38.866584+0000","last_undegraded":"2024-03-04T08:51:38.866584+0000","last_fullsized":"2024-03-04T08:51:38.866584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:58:45.219925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872609+0000","last_change":"2024-03-04T08:51:36.865777+0000","last_active":"2024-03-04T08:51:38.872609+0000","last_peered":"2024-03-04T08:51:38.872609+0000","last_clean":"2024-03-04T08:51:38.872609+0000","last_became_active":"2024-03-04T08:51:36.865481+0000","last_became_peered":"2024-03-04T08:51:36.865481+0000","last_unstale":"2024-03-04T08:51:38.872609+0000","last_undegraded":"2024-03-04T08:51:38.872609+0000","last_fullsized":"2024-03-04T08:51:38.872609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:00.257468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869204+0000","last_change":"2024-03-04T08:51:37.876668+0000","last_active":"2024-03-04T08:51:38.869204+0000","last_peered":"2024-03-04T08:51:38.869204+0000","last_clean":"2024-03-04T08:51:38.869204+0000","last_became_active":"2024-03-04T08:51:37.876366+0000","last_became_peered":"2024-03-04T08:51:37.876366+0000","last_unstale":"2024-03-04T08:51:38.869204+0000","last_undegraded":"2024-03-04T08:51:38.869204+0000","last_fullsized":"2024-03-04T08:51:38.869204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:50:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866728+0000","last_change":"2024-03-04T08:51:36.863744+0000","last_active":"2024-03-04T08:51:38.866728+0000","last_peered":"2024-03-04T08:51:38.866728+0000","last_clean":"2024-03-04T08:51:38.866728+0000","last_became_active":"2024-03-04T08:51:36.863042+0000","last_became_peered":"2024-03-04T08:51:36.863042+0000","last_unstale":"2024-03-04T08:51:38.866728+0000","last_undegraded":"2024-03-04T08:51:38.866728+0000","last_fullsized":"2024-03-04T08:51:38.866728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:41.411669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391075+0000","last_change":"2024-03-04T08:51:37.864928+0000","last_active":"2024-03-04T08:51:39.391075+0000","last_peered":"2024-03-04T08:51:39.391075+0000","last_clean":"2024-03-04T08:51:39.391075+0000","last_became_active":"2024-03-04T08:51:37.864663+0000","last_became_peered":"2024-03-04T08:51:37.864663+0000","last_unstale":"2024-03-04T08:51:39.391075+0000","last_undegraded":"2024-03-04T08:51:39.391075+0000","last_fullsized":"2024-03-04T08:51:39.391075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:44.804598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866829+0000","last_change":"2024-03-04T08:51:36.868568+0000","last_active":"2024-03-04T08:51:38.866829+0000","last_peered":"2024-03-04T08:51:38.866829+0000","last_clean":"2024-03-04T08:51:38.866829+0000","last_became_active":"2024-03-04T08:51:36.868032+0000","last_became_peered":"2024-03-04T08:51:36.868032+0000","last_unstale":"2024-03-04T08:51:38.866829+0000","last_undegraded":"2024-03-04T08:51:38.866829+0000","last_fullsized":"2024-03-04T08:51:38.866829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:33.072672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392029+0000","last_change":"2024-03-04T08:51:37.870420+0000","last_active":"2024-03-04T08:51:39.392029+0000","last_peered":"2024-03-04T08:51:39.392029+0000","last_clean":"2024-03-04T08:51:39.392029+0000","last_became_active":"2024-03-04T08:51:37.870140+0000","last_became_peered":"2024-03-04T08:51:37.870140+0000","last_unstale":"2024-03-04T08:51:39.392029+0000","last_undegraded":"2024-03-04T08:51:39.392029+0000","last_fullsized":"2024-03-04T08:51:39.392029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:34.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873118+0000","last_change":"2024-03-04T08:51:36.865246+0000","last_active":"2024-03-04T08:51:38.873118+0000","last_peered":"2024-03-04T08:51:38.873118+0000","last_clean":"2024-03-04T08:51:38.873118+0000","last_became_active":"2024-03-04T08:51:36.864608+0000","last_became_peered":"2024-03-04T08:51:36.864608+0000","last_unstale":"2024-03-04T08:51:38.873118+0000","last_undegraded":"2024-03-04T08:51:38.873118+0000","last_fullsized":"2024-03-04T08:51:38.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:33.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391790+0000","last_change":"2024-03-04T08:51:37.873691+0000","last_active":"2024-03-04T08:51:39.391790+0000","last_peered":"2024-03-04T08:51:39.391790+0000","last_clean":"2024-03-04T08:51:39.391790+0000","last_became_active":"2024-03-04T08:51:37.873425+0000","last_became_peered":"2024-03-04T08:51:37.873425+0000","last_unstale":"2024-03-04T08:51:39.391790+0000","last_undegraded":"2024-03-04T08:51:39.391790+0000","last_fullsized":"2024-03-04T08:51:39.391790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:31.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392143+0000","last_change":"2024-03-04T08:51:36.857891+0000","last_active":"2024-03-04T08:51:39.392143+0000","last_peered":"2024-03-04T08:51:39.392143+0000","last_clean":"2024-03-04T08:51:39.392143+0000","last_became_active":"2024-03-04T08:51:36.857296+0000","last_became_peered":"2024-03-04T08:51:36.857296+0000","last_unstale":"2024-03-04T08:51:39.392143+0000","last_undegraded":"2024-03-04T08:51:39.392143+0000","last_fullsized":"2024-03-04T08:51:39.392143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872861+0000","last_change":"2024-03-04T08:51:37.874163+0000","last_active":"2024-03-04T08:51:38.872861+0000","last_peered":"2024-03-04T08:51:38.872861+0000","last_clean":"2024-03-04T08:51:38.872861+0000","last_became_active":"2024-03-04T08:51:37.873895+0000","last_became_peered":"2024-03-04T08:51:37.873895+0000","last_unstale":"2024-03-04T08:51:38.872861+0000","last_undegraded":"2024-03-04T08:51:38.872861+0000","last_fullsized":"2024-03-04T08:51:38.872861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391964+0000","last_change":"2024-03-04T08:51:36.857464+0000","last_active":"2024-03-04T08:51:39.391964+0000","last_peered":"2024-03-04T08:51:39.391964+0000","last_clean":"2024-03-04T08:51:39.391964+0000","last_became_active":"2024-03-04T08:51:36.857197+0000","last_became_peered":"2024-03-04T08:51:36.857197+0000","last_unstale":"2024-03-04T08:51:39.391964+0000","last_undegraded":"2024-03-04T08:51:39.391964+0000","last_fullsized":"2024-03-04T08:51:39.391964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:39.020520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390274+0000","last_change":"2024-03-04T08:51:37.868540+0000","last_active":"2024-03-04T08:51:39.390274+0000","last_peered":"2024-03-04T08:51:39.390274+0000","last_clean":"2024-03-04T08:51:39.390274+0000","last_became_active":"2024-03-04T08:51:37.868252+0000","last_became_peered":"2024-03-04T08:51:37.868252+0000","last_unstale":"2024-03-04T08:51:39.390274+0000","last_undegraded":"2024-03-04T08:51:39.390274+0000","last_fullsized":"2024-03-04T08:51:39.390274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:26:25.990986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392398+0000","last_change":"2024-03-04T08:51:36.861233+0000","last_active":"2024-03-04T08:51:39.392398+0000","last_peered":"2024-03-04T08:51:39.392398+0000","last_clean":"2024-03-04T08:51:39.392398+0000","last_became_active":"2024-03-04T08:51:36.860828+0000","last_became_peered":"2024-03-04T08:51:36.860828+0000","last_unstale":"2024-03-04T08:51:39.392398+0000","last_undegraded":"2024-03-04T08:51:39.392398+0000","last_fullsized":"2024-03-04T08:51:39.392398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:27.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390095+0000","last_change":"2024-03-04T08:51:37.861783+0000","last_active":"2024-03-04T08:51:39.390095+0000","last_peered":"2024-03-04T08:51:39.390095+0000","last_clean":"2024-03-04T08:51:39.390095+0000","last_became_active":"2024-03-04T08:51:37.861361+0000","last_became_peered":"2024-03-04T08:51:37.861361+0000","last_unstale":"2024-03-04T08:51:39.390095+0000","last_undegraded":"2024-03-04T08:51:39.390095+0000","last_fullsized":"2024-03-04T08:51:39.390095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:30.395106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866732+0000","last_change":"2024-03-04T08:51:36.868118+0000","last_active":"2024-03-04T08:51:38.866732+0000","last_peered":"2024-03-04T08:51:38.866732+0000","last_clean":"2024-03-04T08:51:38.866732+0000","last_became_active":"2024-03-04T08:51:36.867809+0000","last_became_peered":"2024-03-04T08:51:36.867809+0000","last_unstale":"2024-03-04T08:51:38.866732+0000","last_undegraded":"2024-03-04T08:51:38.866732+0000","last_fullsized":"2024-03-04T08:51:38.866732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:59.155097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390332+0000","last_change":"2024-03-04T08:51:37.867303+0000","last_active":"2024-03-04T08:51:39.390332+0000","last_peered":"2024-03-04T08:51:39.390332+0000","last_clean":"2024-03-04T08:51:39.390332+0000","last_became_active":"2024-03-04T08:51:37.867017+0000","last_became_peered":"2024-03-04T08:51:37.867017+0000","last_unstale":"2024-03-04T08:51:39.390332+0000","last_undegraded":"2024-03-04T08:51:39.390332+0000","last_fullsized":"2024-03-04T08:51:39.390332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:01.897447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391095+0000","last_change":"2024-03-04T08:51:36.867341+0000","last_active":"2024-03-04T08:51:39.391095+0000","last_peered":"2024-03-04T08:51:39.391095+0000","last_clean":"2024-03-04T08:51:39.391095+0000","last_became_active":"2024-03-04T08:51:36.867060+0000","last_became_peered":"2024-03-04T08:51:36.867060+0000","last_unstale":"2024-03-04T08:51:39.391095+0000","last_undegraded":"2024-03-04T08:51:39.391095+0000","last_fullsized":"2024-03-04T08:51:39.391095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:52:25.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390111+0000","last_change":"2024-03-04T08:51:37.871830+0000","last_active":"2024-03-04T08:51:39.390111+0000","last_peered":"2024-03-04T08:51:39.390111+0000","last_clean":"2024-03-04T08:51:39.390111+0000","last_became_active":"2024-03-04T08:51:37.871585+0000","last_became_peered":"2024-03-04T08:51:37.871585+0000","last_unstale":"2024-03-04T08:51:39.390111+0000","last_undegraded":"2024-03-04T08:51:39.390111+0000","last_fullsized":"2024-03-04T08:51:39.390111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:24:54.051444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392166+0000","last_change":"2024-03-04T08:51:36.864921+0000","last_active":"2024-03-04T08:51:39.392166+0000","last_peered":"2024-03-04T08:51:39.392166+0000","last_clean":"2024-03-04T08:51:39.392166+0000","last_became_active":"2024-03-04T08:51:36.864722+0000","last_became_peered":"2024-03-04T08:51:36.864722+0000","last_unstale":"2024-03-04T08:51:39.392166+0000","last_undegraded":"2024-03-04T08:51:39.392166+0000","last_fullsized":"2024-03-04T08:51:39.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:29.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869045+0000","last_change":"2024-03-04T08:51:37.866877+0000","last_active":"2024-03-04T08:51:38.869045+0000","last_peered":"2024-03-04T08:51:38.869045+0000","last_clean":"2024-03-04T08:51:38.869045+0000","last_became_active":"2024-03-04T08:51:37.866597+0000","last_became_peered":"2024-03-04T08:51:37.866597+0000","last_unstale":"2024-03-04T08:51:38.869045+0000","last_undegraded":"2024-03-04T08:51:38.869045+0000","last_fullsized":"2024-03-04T08:51:38.869045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:59.538397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391079+0000","last_change":"2024-03-04T08:51:36.862821+0000","last_active":"2024-03-04T08:51:39.391079+0000","last_peered":"2024-03-04T08:51:39.391079+0000","last_clean":"2024-03-04T08:51:39.391079+0000","last_became_active":"2024-03-04T08:51:36.862503+0000","last_became_peered":"2024-03-04T08:51:36.862503+0000","last_unstale":"2024-03-04T08:51:39.391079+0000","last_undegraded":"2024-03-04T08:51:39.391079+0000","last_fullsized":"2024-03-04T08:51:39.391079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:33.072672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390270+0000","last_change":"2024-03-04T08:51:37.869213+0000","last_active":"2024-03-04T08:51:39.390270+0000","last_peered":"2024-03-04T08:51:39.390270+0000","last_clean":"2024-03-04T08:51:39.390270+0000","last_became_active":"2024-03-04T08:51:37.868953+0000","last_became_peered":"2024-03-04T08:51:37.868953+0000","last_unstale":"2024-03-04T08:51:39.390270+0000","last_undegraded":"2024-03-04T08:51:39.390270+0000","last_fullsized":"2024-03-04T08:51:39.390270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:00.163030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.873140+0000","last_change":"2024-03-04T08:51:36.865400+0000","last_active":"2024-03-04T08:51:38.873140+0000","last_peered":"2024-03-04T08:51:38.873140+0000","last_clean":"2024-03-04T08:51:38.873140+0000","last_became_active":"2024-03-04T08:51:36.864934+0000","last_became_peered":"2024-03-04T08:51:36.864934+0000","last_unstale":"2024-03-04T08:51:38.873140+0000","last_undegraded":"2024-03-04T08:51:38.873140+0000","last_fullsized":"2024-03-04T08:51:38.873140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:57.304490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391962+0000","last_change":"2024-03-04T08:51:37.874767+0000","last_active":"2024-03-04T08:51:39.391962+0000","last_peered":"2024-03-04T08:51:39.391962+0000","last_clean":"2024-03-04T08:51:39.391962+0000","last_became_active":"2024-03-04T08:51:37.873357+0000","last_became_peered":"2024-03-04T08:51:37.873357+0000","last_unstale":"2024-03-04T08:51:39.391962+0000","last_undegraded":"2024-03-04T08:51:39.391962+0000","last_fullsized":"2024-03-04T08:51:39.391962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:07:42.942517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.867256+0000","last_change":"2024-03-04T08:51:36.867678+0000","last_active":"2024-03-04T08:51:38.867256+0000","last_peered":"2024-03-04T08:51:38.867256+0000","last_clean":"2024-03-04T08:51:38.867256+0000","last_became_active":"2024-03-04T08:51:36.867357+0000","last_became_peered":"2024-03-04T08:51:36.867357+0000","last_unstale":"2024-03-04T08:51:38.867256+0000","last_undegraded":"2024-03-04T08:51:38.867256+0000","last_fullsized":"2024-03-04T08:51:38.867256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:34.678540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866289+0000","last_change":"2024-03-04T08:51:37.871830+0000","last_active":"2024-03-04T08:51:38.866289+0000","last_peered":"2024-03-04T08:51:38.866289+0000","last_clean":"2024-03-04T08:51:38.866289+0000","last_became_active":"2024-03-04T08:51:37.871555+0000","last_became_peered":"2024-03-04T08:51:37.871555+0000","last_unstale":"2024-03-04T08:51:38.866289+0000","last_undegraded":"2024-03-04T08:51:38.866289+0000","last_fullsized":"2024-03-04T08:51:38.866289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:47:52.609656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872982+0000","last_change":"2024-03-04T08:51:36.864963+0000","last_active":"2024-03-04T08:51:38.872982+0000","last_peered":"2024-03-04T08:51:38.872982+0000","last_clean":"2024-03-04T08:51:38.872982+0000","last_became_active":"2024-03-04T08:51:36.864629+0000","last_became_peered":"2024-03-04T08:51:36.864629+0000","last_unstale":"2024-03-04T08:51:38.872982+0000","last_undegraded":"2024-03-04T08:51:38.872982+0000","last_fullsized":"2024-03-04T08:51:38.872982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:19.925101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.391044+0000","last_change":"2024-03-04T08:51:37.868325+0000","last_active":"2024-03-04T08:51:39.391044+0000","last_peered":"2024-03-04T08:51:39.391044+0000","last_clean":"2024-03-04T08:51:39.391044+0000","last_became_active":"2024-03-04T08:51:37.868029+0000","last_became_peered":"2024-03-04T08:51:37.868029+0000","last_unstale":"2024-03-04T08:51:39.391044+0000","last_undegraded":"2024-03-04T08:51:39.391044+0000","last_fullsized":"2024-03-04T08:51:39.391044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:40:56.462415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866901+0000","last_change":"2024-03-04T08:51:36.859342+0000","last_active":"2024-03-04T08:51:38.866901+0000","last_peered":"2024-03-04T08:51:38.866901+0000","last_clean":"2024-03-04T08:51:38.866901+0000","last_became_active":"2024-03-04T08:51:36.859042+0000","last_became_peered":"2024-03-04T08:51:36.859042+0000","last_unstale":"2024-03-04T08:51:38.866901+0000","last_undegraded":"2024-03-04T08:51:38.866901+0000","last_fullsized":"2024-03-04T08:51:38.866901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:00.889514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866646+0000","last_change":"2024-03-04T08:51:37.869320+0000","last_active":"2024-03-04T08:51:38.866646+0000","last_peered":"2024-03-04T08:51:38.866646+0000","last_clean":"2024-03-04T08:51:38.866646+0000","last_became_active":"2024-03-04T08:51:37.869015+0000","last_became_peered":"2024-03-04T08:51:37.869015+0000","last_unstale":"2024-03-04T08:51:38.866646+0000","last_undegraded":"2024-03-04T08:51:38.866646+0000","last_fullsized":"2024-03-04T08:51:38.866646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:25.510837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.872707+0000","last_change":"2024-03-04T08:51:36.865216+0000","last_active":"2024-03-04T08:51:38.872707+0000","last_peered":"2024-03-04T08:51:38.872707+0000","last_clean":"2024-03-04T08:51:38.872707+0000","last_became_active":"2024-03-04T08:51:36.864887+0000","last_became_peered":"2024-03-04T08:51:36.864887+0000","last_unstale":"2024-03-04T08:51:38.872707+0000","last_undegraded":"2024-03-04T08:51:38.872707+0000","last_fullsized":"2024-03-04T08:51:38.872707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:47.361355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866260+0000","last_change":"2024-03-04T08:51:37.877336+0000","last_active":"2024-03-04T08:51:38.866260+0000","last_peered":"2024-03-04T08:51:38.866260+0000","last_clean":"2024-03-04T08:51:38.866260+0000","last_became_active":"2024-03-04T08:51:37.877066+0000","last_became_peered":"2024-03-04T08:51:37.877066+0000","last_unstale":"2024-03-04T08:51:38.866260+0000","last_undegraded":"2024-03-04T08:51:38.866260+0000","last_fullsized":"2024-03-04T08:51:38.866260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:59.538397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392225+0000","last_change":"2024-03-04T08:51:36.856581+0000","last_active":"2024-03-04T08:51:39.392225+0000","last_peered":"2024-03-04T08:51:39.392225+0000","last_clean":"2024-03-04T08:51:39.392225+0000","last_became_active":"2024-03-04T08:51:36.856288+0000","last_became_peered":"2024-03-04T08:51:36.856288+0000","last_unstale":"2024-03-04T08:51:39.392225+0000","last_undegraded":"2024-03-04T08:51:39.392225+0000","last_fullsized":"2024-03-04T08:51:39.392225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:53.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.392092+0000","last_change":"2024-03-04T08:51:37.872745+0000","last_active":"2024-03-04T08:51:39.392092+0000","last_peered":"2024-03-04T08:51:39.392092+0000","last_clean":"2024-03-04T08:51:39.392092+0000","last_became_active":"2024-03-04T08:51:37.872463+0000","last_became_peered":"2024-03-04T08:51:37.872463+0000","last_unstale":"2024-03-04T08:51:39.392092+0000","last_undegraded":"2024-03-04T08:51:39.392092+0000","last_fullsized":"2024-03-04T08:51:39.392092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:53.563479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.866870+0000","last_change":"2024-03-04T08:51:36.863377+0000","last_active":"2024-03-04T08:51:38.866870+0000","last_peered":"2024-03-04T08:51:38.866870+0000","last_clean":"2024-03-04T08:51:38.866870+0000","last_became_active":"2024-03-04T08:51:36.863028+0000","last_became_peered":"2024-03-04T08:51:36.863028+0000","last_unstale":"2024-03-04T08:51:38.866870+0000","last_undegraded":"2024-03-04T08:51:38.866870+0000","last_fullsized":"2024-03-04T08:51:38.866870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:07.297239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869318+0000","last_change":"2024-03-04T08:51:37.869243+0000","last_active":"2024-03-04T08:51:38.869318+0000","last_peered":"2024-03-04T08:51:38.869318+0000","last_clean":"2024-03-04T08:51:38.869318+0000","last_became_active":"2024-03-04T08:51:37.867057+0000","last_became_peered":"2024-03-04T08:51:37.867057+0000","last_unstale":"2024-03-04T08:51:38.869318+0000","last_undegraded":"2024-03-04T08:51:38.869318+0000","last_fullsized":"2024-03-04T08:51:38.869318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:36.840369+0000","last_clean_scrub_stamp":"2024-03-04T08:51:36.840369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:31.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:39.390811+0000","last_change":"2024-03-04T08:51:36.861136+0000","last_active":"2024-03-04T08:51:39.390811+0000","last_peered":"2024-03-04T08:51:39.390811+0000","last_clean":"2024-03-04T08:51:39.390811+0000","last_became_active":"2024-03-04T08:51:36.860816+0000","last_became_peered":"2024-03-04T08:51:36.860816+0000","last_unstale":"2024-03-04T08:51:39.390811+0000","last_undegraded":"2024-03-04T08:51:39.390811+0000","last_fullsized":"2024-03-04T08:51:39.390811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:51:35.832436+0000","last_clean_scrub_stamp":"2024-03-04T08:51:35.832436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:19.377354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-04T08:51:38.869384+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:51:38.869384+0000","last_peered":"2024-03-04T08:51:38.869384+0000","last_clean":"2024-03-04T08:51:38.869384+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:51:38.869384+0000","last_undegraded":"2024-03-04T08:51:38.869384+0000","last_fullsized":"2024-03-04T08:51:38.869384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":739265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":149423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":149479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":150441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":148877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":739175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:51:45.798 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T08:51:45.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-04T08:51:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 Processor -- start 2024-03-04T08:51:45.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 -- start start 2024-03-04T08:51:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 0x7f38700d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38700b0e30 0x7f38700b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38701618b0 con 0x7f38701614d0 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38700d4cf0 con 0x7f38700b0e30 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.954+0000 7f38763c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38700cf400 con 0x7f38700d4860 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38700b0e30 0x7f38700b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38700b0e30 0x7f38700b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41150/0 (socket says 172.21.15.19:41150) 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 -- 172.21.15.19:0/537755939 learned_addr learned my addr 172.21.15.19:0/537755939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f386ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38701614d0 0x7f38700d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41498/0 (socket says 172.21.15.19:41498) 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f386f7fe640 1 --2- 172.21.15.19:0/537755939 >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 0x7f38700d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 -- 172.21.15.19:0/537755939 >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 msgr2=0x7f38700d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 --2- 172.21.15.19:0/537755939 >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 0x7f38700d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 -- 172.21.15.19:0/537755939 >> v1:172.21.15.19:6789/0 conn(0x7f38701614d0 legacy=0x7f38700d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f3874966640 1 -- 172.21.15.19:0/537755939 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700cf6a0 con 0x7f38700b0e30 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f386effd640 1 -- 172.21.15.19:0/537755939 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37894984 0 0) 0x7f38701618b0 con 0x7f38701614d0 2024-03-04T08:51:45.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.955+0000 7f386f7fe640 1 --2- 172.21.15.19:0/537755939 >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 0x7f38700d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f3874966640 1 --2- 172.21.15.19:0/537755939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700b1260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38700ce550 tx=0x7f386802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733afab9fd5b6635 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f386effd640 1 -- 172.21.15.19:0/537755939 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386802cb20 con 0x7f38700b0e30 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f386effd640 1 -- 172.21.15.19:0/537755939 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386802ccc0 con 0x7f38700b0e30 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f386effd640 1 -- 172.21.15.19:0/537755939 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868034610 con 0x7f38700b0e30 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 -- 172.21.15.19:0/537755939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 msgr2=0x7f38700b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 --2- 172.21.15.19:0/537755939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700b1260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38700ce550 tx=0x7f386802bf80 comp rx=0 tx=0).stop 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 -- 172.21.15.19:0/537755939 shutdown_connections 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 --2- 172.21.15.19:0/537755939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700b1260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 --2- 172.21.15.19:0/537755939 >> v2:172.21.15.204:3300/0 conn(0x7f38700d4860 0x7f38700d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 -- 172.21.15.19:0/537755939 >> 172.21.15.19:0/537755939 conn(0x7f38700d3d40 msgr2=0x7f38700d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 -- 172.21.15.19:0/537755939 shutdown_connections 2024-03-04T08:51:45.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.956+0000 7f38763c9640 1 -- 172.21.15.19:0/537755939 wait complete. 2024-03-04T08:51:45.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.957+0000 7f38763c9640 1 Processor -- start 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 -- start start 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38700d4860 0x7f38701f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38701614d0 0x7f38700cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700b0910 con 0x7f38700b0e30 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38700cfc60 con 0x7f38700d4860 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f38763c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38700d2560 con 0x7f38701614d0 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f386ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.958+0000 7f386ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41152/0 (socket says 172.21.15.19:41152) 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 -- 172.21.15.19:0/1706782033 learned_addr learned my addr 172.21.15.19:0/1706782033 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f3874966640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38701614d0 0x7f38700cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386f7fe640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38700d4860 0x7f38701f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 -- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38701614d0 msgr2=0x7f38700cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38701614d0 0x7f38700cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 -- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38700d4860 msgr2=0x7f38701f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38700d4860 0x7f38701f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 -- 172.21.15.19:0/1706782033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700c89f0 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386ffff640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f386000c410 tx=0x7f386000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600074e0 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3860007680 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860004a00 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38700c8cd0 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.959+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38700c9290 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.960+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38700b7850 con 0x7f38700b0e30 2024-03-04T08:51:45.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.961+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f386001a020 con 0x7f38700b0e30 2024-03-04T08:51:45.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.961+0000 7f386cff9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:45.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.961+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38600899a0 con 0x7f38700b0e30 2024-03-04T08:51:45.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.961+0000 7f386f7fe640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:45.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.962+0000 7f386f7fe640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 0x7f385c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38700cbfd0 tx=0x7f3864008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:45.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:45.966+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3860010300 con 0x7f38700b0e30 2024-03-04T08:51:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.216+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3870068ff0 con 0x7f38700b0e30 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.218+0000 7f386cff9640 1 -- 172.21.15.19:0/1706782033 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f38600588b0 con 0x7f38700b0e30 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:51:46.214 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-04T08:51:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:51:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 msgr2=0x7f385c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 0x7f385c06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38700cbfd0 tx=0x7f3864008040 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 msgr2=0x7f38700c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f386000c410 tx=0x7f386000c8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 shutdown_connections 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f38701614d0 0x7f38700cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f38700d4860 0x7f38701f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 --2- 172.21.15.19:0/1706782033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38700b0e30 0x7f38700c8280 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 >> 172.21.15.19:0/1706782033 conn(0x7f38700d3d40 msgr2=0x7f38700d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 shutdown_connections 2024-03-04T08:51:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.220+0000 7f38763c9640 1 -- 172.21.15.19:0/1706782033 wait complete. 2024-03-04T08:51:46.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 Processor -- start 2024-03-04T08:51:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 -- start start 2024-03-04T08:51:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c0cf830 0x7fa41c0d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa41c0d27f0 0x7fa41c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0d2c50 con 0x7fa41c15dfe0 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0b31e0 con 0x7fa41c0d27f0 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa421c2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0b3d60 con 0x7fa41c0cf830 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.333+0000 7fa41b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41168/0 (socket says 172.21.15.19:41168) 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 -- 172.21.15.19:0/2063743371 learned_addr learned my addr 172.21.15.19:0/2063743371 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41bfff640 1 --2- 172.21.15.19:0/2063743371 >> v2:172.21.15.204:3300/0 conn(0x7fa41c0d27f0 0x7fa41c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41affd640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c0cf830 0x7fa41c0d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 -- 172.21.15.19:0/2063743371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c0cf830 msgr2=0x7fa41c0d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c0cf830 0x7fa41c0d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 -- 172.21.15.19:0/2063743371 >> v2:172.21.15.204:3300/0 conn(0x7fa41c0d27f0 msgr2=0x7fa41c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/2063743371 >> v2:172.21.15.204:3300/0 conn(0x7fa41c0d27f0 0x7fa41c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.334+0000 7fa41b7fe640 1 -- 172.21.15.19:0/2063743371 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0b3430 con 0x7fa41c15dfe0 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa41c067ad0 tx=0x7fa40c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5af9b394172113 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa41a7fc640 1 -- 172.21.15.19:0/2063743371 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c02ca70 con 0x7fa41c15dfe0 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa41a7fc640 1 -- 172.21.15.19:0/2063743371 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c02cc10 con 0x7fa41c15dfe0 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa41a7fc640 1 -- 172.21.15.19:0/2063743371 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0343f0 con 0x7fa41c15dfe0 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa421c2a640 1 -- 172.21.15.19:0/2063743371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c15dfe0 msgr2=0x7fa41c0cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.335+0000 7fa421c2a640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa41c067ad0 tx=0x7fa40c02bed0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 -- 172.21.15.19:0/2063743371 shutdown_connections 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 --2- 172.21.15.19:0/2063743371 >> v2:172.21.15.204:3300/0 conn(0x7fa41c0d27f0 0x7fa41c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c0cf830 0x7fa41c0d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 --2- 172.21.15.19:0/2063743371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c15dfe0 0x7fa41c0cf2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 -- 172.21.15.19:0/2063743371 >> 172.21.15.19:0/2063743371 conn(0x7fa41c0d3cd0 msgr2=0x7fa41c0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 -- 172.21.15.19:0/2063743371 shutdown_connections 2024-03-04T08:51:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.336+0000 7fa421c2a640 1 -- 172.21.15.19:0/2063743371 wait complete. 2024-03-04T08:51:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.337+0000 7fa421c2a640 1 Processor -- start 2024-03-04T08:51:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.337+0000 7fa421c2a640 1 -- start start 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 0x7fa41c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c15dfe0 0x7fa41c0b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0d1c70 con 0x7fa41c0d27f0 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0b39f0 con 0x7fa41c0cf830 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0d1df0 con 0x7fa41c15dfe0 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41180/0 (socket says 172.21.15.19:41180) 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 -- 172.21.15.19:0/989260789 learned_addr learned my addr 172.21.15.19:0/989260789 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 0x7fa41c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41bfff640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c15dfe0 0x7fa41c0b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 -- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c15dfe0 msgr2=0x7fa41c0b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c15dfe0 0x7fa41c0b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 -- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 msgr2=0x7fa41c15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 0x7fa41c15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 -- 172.21.15.19:0/989260789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0b6d20 con 0x7fa41c0d27f0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 0x7fa41c15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa41affd640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e860 tx=0x7fa41000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410017070 con 0x7fa41c0d27f0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000c940 con 0x7fa41c0d27f0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c0b7000 con 0x7fa41c0d27f0 2024-03-04T08:51:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000cd10 con 0x7fa41c0d27f0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.338+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0b75c0 con 0x7fa41c0d27f0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.339+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c04f330 con 0x7fa41c0d27f0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.340+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa41001a070 con 0x7fa41c0d27f0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.340+0000 7fa403fff640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.340+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa41008a220 con 0x7fa41c0d27f0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.341+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.341+0000 7fa41b7fe640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 0x7fa40806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa40c035000 tx=0x7fa40c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:46.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.345+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa4100590a0 con 0x7fa41c0d27f0 2024-03-04T08:51:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.564+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa41c0ce9a0 con 0x7fa41c0d27f0 2024-03-04T08:51:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.564+0000 7fa403fff640 1 -- 172.21.15.19:0/989260789 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4979 (secure 0 0 0) 0x7fa4100589a0 con 0x7fa41c0d27f0 2024-03-04T08:51:46.561 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:46.561 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:39.223178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:51:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 msgr2=0x7fa40806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 0x7fa40806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa40c035000 tx=0x7fa40c030000 comp rx=0 tx=0).stop 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 msgr2=0x7fa41c15f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e860 tx=0x7fa41000ed20 comp rx=0 tx=0).stop 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 shutdown_connections 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa41c15dfe0 0x7fa41c0b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa41c0d27f0 0x7fa41c15f4a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa40806b4d0 0x7fa40806d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 --2- 172.21.15.19:0/989260789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa41c0cf830 0x7fa41c15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 >> 172.21.15.19:0/989260789 conn(0x7fa41c0d3cd0 msgr2=0x7fa41c0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 shutdown_connections 2024-03-04T08:51:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:46.566+0000 7fa421c2a640 1 -- 172.21.15.19:0/989260789 wait complete. 2024-03-04T08:51:46.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T08:51:37.211729+0000', 'modified': '2024-03-04T08:51:39.223178+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/2471090824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6833', 'nonce': 2471090824}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 2471090824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5256, 'qdb_cluster': [5256]} 2024-03-04T08:51:46.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-04T08:51:46.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.083+0000 7f228c916640 1 Processor -- start 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.083+0000 7f228c916640 1 -- start start 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228c916640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f228806d3c0 0x7f22880b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228c916640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880af4b0 con 0x7f22881614a0 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228c916640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880af790 con 0x7f22880b1850 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228c916640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880afa70 con 0x7f228806d3c0 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22881614a0 0x7f22880b0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41500/0 (socket says 172.21.15.19:41500) 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f228659c640 1 -- 172.21.15.19:0/704695240 learned_addr learned my addr 172.21.15.19:0/704695240 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f227dd9b640 1 --2- 172.21.15.19:0/704695240 >> v2:172.21.15.204:3300/0 conn(0x7f228806d3c0 0x7f22880b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382635172 0 0) 0x7f22880af4b0 con 0x7f22881614a0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.084+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2274003520 con 0x7f22881614a0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943949249 0 0) 0x7f2274003520 con 0x7f22881614a0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 >> v2:172.21.15.204:3300/0 conn(0x7f228806d3c0 msgr2=0x7f22880b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 --2- 172.21.15.19:0/704695240 >> v2:172.21.15.204:3300/0 conn(0x7f228806d3c0 0x7f22880b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 >> v1:172.21.15.204:6789/0 conn(0x7f22880b1850 legacy=0x7f22880b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880afd50 con 0x7f22881614a0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f2278001670 con 0x7f22881614a0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 >> v1:172.21.15.19:6789/0 conn(0x7f22881614a0 legacy=0x7f22880b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2274003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880afa70 con 0x7f22740039b0 2024-03-04T08:51:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227400c010 con 0x7f2274004800 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227400c210 con 0x7f22740051c0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2274003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f227dd9b640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2286d9d640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 -- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22740051c0 msgr2=0x7f227400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 -- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2274004800 msgr2=0x7f2274004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f228659c640 1 -- 172.21.15.19:0/704695240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274003520 con 0x7f22740039b0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.085+0000 7f2286d9d640 1 -- 172.21.15.19:0/704695240 reap_dead start 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.086+0000 7f228659c640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2274003d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f227800c160 tx=0x7f2274005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a048420f510f20 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.086+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278007c80 con 0x7f22740039b0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.086+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278030070 con 0x7f22740039b0 2024-03-04T08:51:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.086+0000 7f2285d9b640 1 -- 172.21.15.19:0/704695240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278005d70 con 0x7f22740039b0 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 -- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 msgr2=0x7f2274003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2274003d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f227800c160 tx=0x7f2274005830 comp rx=0 tx=0).stop 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 -- 172.21.15.19:0/704695240 shutdown_connections 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 --2- 172.21.15.19:0/704695240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2274003d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 -- 172.21.15.19:0/704695240 >> 172.21.15.19:0/704695240 conn(0x7f228809a9f0 msgr2=0x7f228809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 -- 172.21.15.19:0/704695240 shutdown_connections 2024-03-04T08:51:47.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.087+0000 7f228c916640 1 -- 172.21.15.19:0/704695240 wait complete. 2024-03-04T08:51:47.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.088+0000 7f228c916640 1 Processor -- start 2024-03-04T08:51:47.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.088+0000 7f228c916640 1 -- start start 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22880b0170 0x7f22880d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22880b05f0 0x7f22880d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b1db0 con 0x7f22740039b0 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b1c30 con 0x7f22880b0170 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228c916640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b1f30 con 0x7f22880b05f0 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41192/0 (socket says 172.21.15.19:41192) 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 -- 172.21.15.19:0/1246118220 learned_addr learned my addr 172.21.15.19:0/1246118220 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f227dd9b640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22880b0170 0x7f22880d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f2286d9d640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22880b05f0 0x7f22880d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 -- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22880b05f0 msgr2=0x7f22880d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22880b05f0 0x7f22880d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 -- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22880b0170 msgr2=0x7f22880d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22880b0170 0x7f22880d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.089+0000 7f228659c640 1 -- 172.21.15.19:0/1246118220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228809c740 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f228659c640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f227800c160 tx=0x7f227802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f227f7fe640 1 -- 172.21.15.19:0/1246118220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278045070 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f227f7fe640 1 -- 172.21.15.19:0/1246118220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278000ed0 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f227f7fe640 1 -- 172.21.15.19:0/1246118220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278004e10 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228809c9e0 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.090+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228809cfa0 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.091+0000 7f227f7fe640 1 -- 172.21.15.19:0/1246118220 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2278007070 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.092+0000 7f227f7fe640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 0x7f226806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.092+0000 7f227f7fe640 1 -- 172.21.15.19:0/1246118220 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22780aafd0 con 0x7f22740039b0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.092+0000 7f227dd9b640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 0x7f226806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.093+0000 7f227dd9b640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 0x7f226806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2288070b70 tx=0x7f2270008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.093+0000 7f228f5d0740 1 Processor -- start 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.093+0000 7f228f5d0740 1 -- start start 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 0x55bec6087360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60b1600 0x55bec60b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec5feb6b0 con 0x55bec6081870 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec5f94a60 con 0x55bec60b1600 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bec5fe7750 con 0x55bec60858c0 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41204/0 (socket says 172.21.15.19:41204) 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 -- 172.21.15.19:0/3020450873 learned_addr learned my addr 172.21.15.19:0/3020450873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f2286d9d640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60b1600 0x55bec60b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f227dd9b640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 0x55bec6087360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 -- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 msgr2=0x55bec6087360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 0x55bec6087360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 -- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60b1600 msgr2=0x55bec60b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60b1600 0x55bec60b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 -- 172.21.15.19:0/3020450873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bec5fb2f30 con 0x55bec6081870 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f227dd9b640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 0x55bec6087360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f228659c640 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f22780a95b0 tx=0x7f227807a020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a262b21371c0faa server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f2267fff640 1 -- 172.21.15.19:0/3020450873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278081ef0 con 0x55bec6081870 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f2267fff640 1 -- 172.21.15.19:0/3020450873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278030040 con 0x55bec6081870 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.094+0000 7f2267fff640 1 -- 172.21.15.19:0/3020450873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278007c60 con 0x55bec6081870 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 -- 172.21.15.19:0/3020450873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 msgr2=0x55bec6081c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f22780a95b0 tx=0x7f227807a020 comp rx=0 tx=0).stop 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 -- 172.21.15.19:0/3020450873 shutdown_connections 2024-03-04T08:51:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60b1600 0x55bec60b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60858c0 0x55bec6087360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3020450873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec6081870 0x55bec6081c50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 -- 172.21.15.19:0/3020450873 >> 172.21.15.19:0/3020450873 conn(0x55bec60838f0 msgr2=0x55bec60851b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 -- 172.21.15.19:0/3020450873 shutdown_connections 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.095+0000 7f228f5d0740 1 -- 172.21.15.19:0/3020450873 wait complete. 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.096+0000 7f228f5d0740 1 -- start start 2024-03-04T08:51:47.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.096+0000 7f228f5d0740 1 Processor -- start 2024-03-04T08:51:47.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60b1600 0x55bec60ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec60ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec5f94a60 con 0x55bec60a63d0 2024-03-04T08:51:47.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec5fa7ea0 con 0x55bec60a5f00 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bec5feb6b0 con 0x55bec60b1600 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228f5d0740 10 client.0 _ll_register_callbacks cb 0x55bec5fa7870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41210/0 (socket says 172.21.15.19:41210) 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 -- 172.21.15.19:0/4247184149 learned_addr learned my addr 172.21.15.19:0/4247184149 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f227dd9b640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec60ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f228659c640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60b1600 0x55bec60ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 -- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60b1600 msgr2=0x55bec60ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60b1600 0x55bec60ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 -- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 msgr2=0x55bec60ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec60ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 -- 172.21.15.19:0/4247184149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bec5fa8270 con 0x55bec60a63d0 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f227dd9b640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec60ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:47.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f2286d9d640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2280005810 tx=0x7f2280001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22872def27953acd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.097+0000 7f22657fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001a020 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2280016660 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2278030040 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2280016860 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 10 client.5460 fetch_fsmap learned FSMap version 13 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55bec5d002d0 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278030040 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 13) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f2280027080 con 0x55bec60a63d0 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 10 client.5460 fetch_fsmap finished waiting for FSMap version 13 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 10 client.5460 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 20 client.5460 populate_metadata read hostname 'smithi019' 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60a7cf0 0x55bec60eb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 4 client.5460 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 --> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bec5ff8bf0 con 0x55bec60a7cf0 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228659c640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60a7cf0 0x55bec60eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f22657fa640 10 client.5460 ms_handle_connect on v2:172.21.15.19:6833/2471090824 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.098+0000 7f228659c640 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60a7cf0 0x55bec60eb710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5ebdd550873e57d server_cookie=584a54630eac6ec7 in_seq=0 out_seq=0 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f22657fa640 1 -- 172.21.15.19:0/4247184149 <== mds.0 v2:172.21.15.19:6833/2471090824 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bec5ff8bf0 con 0x55bec60a7cf0 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f22657fa640 10 client.5460 handle_command_reply: tid=0 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 client.5460 shutdown 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 msgr2=0x55bec60b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2280005810 tx=0x7f2280001a80 comp rx=0 tx=0).stop 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 shutdown_connections 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60a7cf0 0x55bec60eb710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60a63d0 0x55bec60b2770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec60ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f22657fa640 0 client.5460 ms_handle_reset on v2:172.21.15.19:6833/2471090824 2024-03-04T08:51:47.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 --2- 172.21.15.19:0/4247184149 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60b1600 0x55bec60ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 >> 172.21.15.19:0/4247184149 conn(0x55bec6081870 msgr2=0x55bec60af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 shutdown_connections 2024-03-04T08:51:47.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.099+0000 7f228f5d0740 1 -- 172.21.15.19:0/4247184149 wait complete. 2024-03-04T08:51:47.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.100+0000 7f228f5d0740 20 client.5460 trim_cache size 0 max 16384 2024-03-04T08:51:47.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.116+0000 7f228f5d0740 1 Processor -- start 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.116+0000 7f228f5d0740 1 -- start start 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec607cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a63d0 0x55bec60b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881ff8b0 con 0x55bec60b1600 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228809e6a0 con 0x55bec60a5f00 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22881ff2b0 con 0x55bec60a63d0 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41216/0 (socket says 172.21.15.19:41216) 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 -- 172.21.15.19:0/1829605251 learned_addr learned my addr 172.21.15.19:0/1829605251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f227dd9b640 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a63d0 0x55bec60b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f228659c640 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec607cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 -- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a63d0 msgr2=0x55bec60b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a63d0 0x55bec60b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 -- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 msgr2=0x55bec607cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec607cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.117+0000 7f2286d9d640 1 -- 172.21.15.19:0/1829605251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bec5dca6b0 con 0x55bec60b1600 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f2286d9d640 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2280016a60 tx=0x7f2280010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e9aee5820cb556 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f22677fe640 1 -- 172.21.15.19:0/1829605251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001a040 con 0x55bec60b1600 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f22677fe640 1 -- 172.21.15.19:0/1829605251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280016c60 con 0x55bec60b1600 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f22677fe640 1 -- 172.21.15.19:0/1829605251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001f610 con 0x55bec60b1600 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 -- 172.21.15.19:0/1829605251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 msgr2=0x55bec60b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2280016a60 tx=0x7f2280010000 comp rx=0 tx=0).stop 2024-03-04T08:51:47.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 -- 172.21.15.19:0/1829605251 shutdown_connections 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60b1f20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a63d0 0x55bec60b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 --2- 172.21.15.19:0/1829605251 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a5f00 0x55bec607cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 -- 172.21.15.19:0/1829605251 >> 172.21.15.19:0/1829605251 conn(0x55bec6081870 msgr2=0x55bec60ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 -- 172.21.15.19:0/1829605251 shutdown_connections 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.118+0000 7f228f5d0740 1 -- 172.21.15.19:0/1829605251 wait complete. 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.119+0000 7f228f5d0740 1 -- start start 2024-03-04T08:51:47.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.119+0000 7f228f5d0740 1 Processor -- start 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a5f00 0x55bec60a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a63d0 0x55bec60ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec60a8490 con 0x55bec60b1600 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec60b4a00 con 0x55bec60a63d0 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bec60b34e0 con 0x55bec60a5f00 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228f5d0740 10 client.0 _ll_register_callbacks cb 0x7f2280005360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41218/0 (socket says 172.21.15.19:41218) 2024-03-04T08:51:47.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 -- 172.21.15.19:0/3870616117 learned_addr learned my addr 172.21.15.19:0/3870616117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f228659c640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a5f00 0x55bec60a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f227dd9b640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a63d0 0x55bec60ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 -- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a5f00 msgr2=0x55bec60a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a5f00 0x55bec60a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 -- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a63d0 msgr2=0x55bec60ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a63d0 0x55bec60ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 -- 172.21.15.19:0/3870616117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bec6087fd0 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f2286d9d640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2280002230 tx=0x7f22800015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421474ac119f0819 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.120+0000 7f22657fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001a040 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2280031720 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2280016c60 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2280031980 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 10 client.5466 fetch_fsmap learned FSMap version 13 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55bec60a5290 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280016c60 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 13) v1 ==== 3314+0+0 (secure 0 0 0) 0x7f2280027050 con 0x55bec60b1600 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 10 client.5466 fetch_fsmap finished waiting for FSMap version 13 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 10 client.5466 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 20 client.5466 populate_metadata read hostname 'smithi019' 2024-03-04T08:51:47.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60efd30 0x55bec60b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 4 client.5466 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 --> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bec5ff2f40 con 0x55bec60efd30 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.121+0000 7f228659c640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60efd30 0x55bec60b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228659c640 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60efd30 0x55bec60b0250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19890ab20216894c server_cookie=be9ed661e1a0ef0c in_seq=0 out_seq=0 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f22657fa640 10 client.5466 ms_handle_connect on v2:172.21.15.19:6833/2471090824 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f22657fa640 1 -- 172.21.15.19:0/3870616117 <== mds.0 v2:172.21.15.19:6833/2471090824 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55bec5ff2f40 con 0x55bec60efd30 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f22657fa640 10 client.5466 handle_command_reply: tid=0 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 client.5466 shutdown 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 msgr2=0x55bec60ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2280002230 tx=0x7f22800015b0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 shutdown_connections 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:6833/2471090824,v1:172.21.15.19:6835/2471090824] conn(0x55bec60efd30 0x55bec60b0250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bec60b1600 0x55bec60ef730 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55bec60a63d0 0x55bec60ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f22657fa640 0 client.5466 ms_handle_reset on v2:172.21.15.19:6833/2471090824 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 --2- 172.21.15.19:0/3870616117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55bec60a5f00 0x55bec60a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 >> 172.21.15.19:0/3870616117 conn(0x55bec6081870 msgr2=0x55bec6086ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 shutdown_connections 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 1 -- 172.21.15.19:0/3870616117 wait complete. 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.122+0000 7f228f5d0740 20 client.5466 trim_cache size 0 max 16384 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:51:47.127 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "385c227e-6109-4019-8b7b-25dec95ce12d", 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5256, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.2629090860000005, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 13, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 34, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 34, 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 16.150681188 2024-03-04T08:51:47.128 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 msgr2=0x7f226806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 0x7f226806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2288070b70 tx=0x7f2270008040 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 msgr2=0x7f2288154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f227800c160 tx=0x7f227802e070 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 shutdown_connections 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f22880b05f0 0x7f22880d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f226806b4d0 0x7f226806d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f22880b0170 0x7f22880d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 --2- 172.21.15.19:0/1246118220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22740039b0 0x7f2288154b70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 >> 172.21.15.19:0/1246118220 conn(0x7f228809a9f0 msgr2=0x7f22880b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 shutdown_connections 2024-03-04T08:51:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.123+0000 7f228c916640 1 -- 172.21.15.19:0/1246118220 wait complete. 2024-03-04T08:51:47.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:51:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.235+0000 7f4d2e81c640 1 Processor -- start 2024-03-04T08:51:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.235+0000 7f4d2e81c640 1 -- start start 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2e81c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d2815fa10 0x7f4d280ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2e81c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 0x7f4d280d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2e81c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d280cebe0 con 0x7f4d2815bdd0 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2e81c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280ceec0 con 0x7f4d2815fa10 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2e81c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280cf1a0 con 0x7f4d280d16e0 2024-03-04T08:51:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d2815fa10 0x7f4d280ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d2815fa10 0x7f4d280ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41230/0 (socket says 172.21.15.19:41230) 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 -- 172.21.15.19:0/2640826225 learned_addr learned my addr 172.21.15.19:0/2640826225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2cdb9640 1 --2- 172.21.15.19:0/2640826225 >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 0x7f4d280d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 -- 172.21.15.19:0/2640826225 >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 msgr2=0x7f4d280d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 --2- 172.21.15.19:0/2640826225 >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 0x7f4d280d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 -- 172.21.15.19:0/2640826225 >> v1:172.21.15.204:6789/0 conn(0x7f4d2815bdd0 legacy=0x7f4d280c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d277fe640 1 -- 172.21.15.19:0/2640826225 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d280cc8e0 con 0x7f4d2815fa10 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.236+0000 7f4d2cdb9640 1 --2- 172.21.15.19:0/2640826225 >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 0x7f4d280d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.237+0000 7f4d277fe640 1 --2- 172.21.15.19:0/2640826225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2815fa10 0x7f4d280ce270 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4d280cdfd0 tx=0x7f4d1c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4ee3ac415193b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.237+0000 7f4d26ffd640 1 -- 172.21.15.19:0/2640826225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0317c0 con 0x7f4d2815fa10 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.237+0000 7f4d26ffd640 1 -- 172.21.15.19:0/2640826225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d2815fa10 2024-03-04T08:51:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.237+0000 7f4d26ffd640 1 -- 172.21.15.19:0/2640826225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c031b80 con 0x7f4d2815fa10 2024-03-04T08:51:47.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 -- 172.21.15.19:0/2640826225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2815fa10 msgr2=0x7f4d280ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/2640826225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2815fa10 0x7f4d280ce270 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4d280cdfd0 tx=0x7f4d1c02b860 comp rx=0 tx=0).stop 2024-03-04T08:51:47.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 -- 172.21.15.19:0/2640826225 shutdown_connections 2024-03-04T08:51:47.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/2640826225 >> v2:172.21.15.204:3300/0 conn(0x7f4d280d16e0 0x7f4d280d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/2640826225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2815fa10 0x7f4d280ce270 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 -- 172.21.15.19:0/2640826225 >> 172.21.15.19:0/2640826225 conn(0x7f4d2809a9f0 msgr2=0x7f4d2809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 -- 172.21.15.19:0/2640826225 shutdown_connections 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.238+0000 7f4d2e81c640 1 -- 172.21.15.19:0/2640826225 wait complete. 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.239+0000 7f4d2e81c640 1 Processor -- start 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.239+0000 7f4d2e81c640 1 -- start start 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d2815bdd0 0x7f4d281f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 0x7f4d2815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280d2030 con 0x7f4d280d16e0 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2815c1b0 con 0x7f4d2815bdd0 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2e81c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280ce7b0 con 0x7f4d2815fa10 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41242/0 (socket says 172.21.15.19:41242) 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 -- 172.21.15.19:0/672121702 learned_addr learned my addr 172.21.15.19:0/672121702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d277fe640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d2815bdd0 0x7f4d281f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2cdb9640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 0x7f4d2815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 -- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 msgr2=0x7f4d2815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 0x7f4d2815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 -- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d2815bdd0 msgr2=0x7f4d281f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d2815bdd0 0x7f4d281f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 -- 172.21.15.19:0/672121702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2815d7a0 con 0x7f4d280d16e0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d2cdb9640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 0x7f4d2815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d27fff640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c430 tx=0x7f4d1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011790 con 0x7f4d280d16e0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.240+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18017070 con 0x7f4d280d16e0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.241+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2815da80 con 0x7f4d280d16e0 2024-03-04T08:51:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.241+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011bb0 con 0x7f4d280d16e0 2024-03-04T08:51:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.241+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2815e040 con 0x7f4d280d16e0 2024-03-04T08:51:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.242+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2804f330 con 0x7f4d280d16e0 2024-03-04T08:51:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.242+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d1801c460 con 0x7f4d280d16e0 2024-03-04T08:51:47.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.242+0000 7f4d24ff9640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 0x7f4d1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:47.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.243+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d1808a060 con 0x7f4d280d16e0 2024-03-04T08:51:47.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.243+0000 7f4d277fe640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 0x7f4d1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:47.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.243+0000 7f4d277fe640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 0x7f4d1406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c036000 tx=0x7f4d1c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:47.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.251+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4d18058f70 con 0x7f4d280d16e0 2024-03-04T08:51:47.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.490+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d280b7a40 con 0x7f4d280d16e0 2024-03-04T08:51:47.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.491+0000 7f4d24ff9640 1 -- 172.21.15.19:0/672121702 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d18058870 con 0x7f4d280d16e0 2024-03-04T08:51:47.487 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 msgr2=0x7f4d1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 0x7f4d1406d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c036000 tx=0x7f4d1c03d040 comp rx=0 tx=0).stop 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 msgr2=0x7f4d2815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c430 tx=0x7f4d1800c8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 shutdown_connections 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4d2815fa10 0x7f4d2815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4d1406b4d0 0x7f4d1406d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4d2815bdd0 0x7f4d281f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 --2- 172.21.15.19:0/672121702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d280d16e0 0x7f4d2815efc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 >> 172.21.15.19:0/672121702 conn(0x7f4d2809a9f0 msgr2=0x7f4d2809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 shutdown_connections 2024-03-04T08:51:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:47.493+0000 7f4d2e81c640 1 -- 172.21.15.19:0/672121702 wait complete. 2024-03-04T08:51:47.500 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:51:47.500 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:51:47.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:51:47.500 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:51:47.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:47.501 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:51:47.501 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:51:47.501 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:51:47.501 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:47.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.501 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:47.517 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:51:47.518 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:47.519 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:47.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.520 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:51:47.584 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:51:47.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.586 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:51:47.641 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:51:47.641 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:51:47.641 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:51:47.641 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:51:47.641 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:51:47.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:51:47.642 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:51:47.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.737 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:51:47.752 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:51:47.752 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:51:47.752 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:47.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:47.752 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:51:47.819 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:51:47.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:47.819 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:47.874 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:47.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:47.874 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:47.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:51:48.000 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:51:48.055 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:51:48.056 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:48.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:48.058 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:51:48.110 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:51:48.110 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:51:48.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:51:48.181 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:51:48.238 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:48.239 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:48.240 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:48.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:48.241 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:51:48.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:51:48.244+0000 7f474764b480 -1 init, newargv = 0x55e9559535d0 newargc=15 2024-03-04T08:51:48.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[52092]: starting ceph client 2024-03-04T08:51:48.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[52092]: starting fuse 2024-03-04T08:51:48.256 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:51:48.256 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:51:48.257 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:51:48.258 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:51:48.377 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.52092.asok 2024-03-04T08:51:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:51:48.388 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52092.asok 2024-03-04T08:51:48.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:48.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52092.asok status 2024-03-04T08:51:48.524 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "52092", 2024-03-04T08:51:48.525 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5481, 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 5481 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:51:48.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4179645885 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4179645885 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.5481 192.168.0.1:0/4179645885", 2024-03-04T08:51:48.527 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/4179645885", 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 13, 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 34, 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:51:48.528 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:51:48.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:48.534 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:51:48.534 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:48.549 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:51:48.549 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:48.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:48.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:48.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-03-04T08:51:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.768+0000 7fbca890c640 1 Processor -- start 2024-03-04T08:51:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.768+0000 7fbca890c640 1 -- start start 2024-03-04T08:51:48.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca890c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbca406b6c0 0x7fbca4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca890c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca4072430 con 0x7fbca4145580 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca890c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca4072710 con 0x7fbca40719e0 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca890c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40b45c0 con 0x7fbca406b6c0 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbca4145580 0x7fbca415c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60874/0 (socket says 172.21.15.19:60874) 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca259c640 1 -- 172.21.15.19:0/1363670701 learned_addr learned my addr 172.21.15.19:0/1363670701 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895338869 0 0) 0x7fbca4072430 con 0x7fbca4145580 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc90003520 con 0x7fbca4145580 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.769+0000 7fbca2d9d640 1 --2- 172.21.15.19:0/1363670701 >> v2:172.21.15.204:3300/0 conn(0x7fbca406b6c0 0x7fbca4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479410726 0 0) 0x7fbc90003520 con 0x7fbca4145580 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 >> v2:172.21.15.204:3300/0 conn(0x7fbca406b6c0 msgr2=0x7fbca4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:48.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 --2- 172.21.15.19:0/1363670701 >> v2:172.21.15.204:3300/0 conn(0x7fbca406b6c0 0x7fbca4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 >> v1:172.21.15.204:6789/0 conn(0x7fbca40719e0 legacy=0x7fbca406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40729f0 con 0x7fbca4145580 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fbc9c0019f0 con 0x7fbca4145580 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 >> v1:172.21.15.19:6789/0 conn(0x7fbca4145580 legacy=0x7fbca415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc900051c0 0x7fbc9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9000c040 con 0x7fbc90004800 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9000c1f0 con 0x7fbc900039b0 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9000c3f0 con 0x7fbc900051c0 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca259c640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca2d9d640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc900051c0 0x7fbc9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 -- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc900051c0 msgr2=0x7fbc9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbc900051c0 0x7fbc9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 -- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc900039b0 msgr2=0x7fbc90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca2d9d640 1 -- 172.21.15.19:0/1363670701 reap_dead start 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.770+0000 7fbca1d9b640 1 -- 172.21.15.19:0/1363670701 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90003520 con 0x7fbc90004800 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.771+0000 7fbca1d9b640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c001750 tx=0x7fbc90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806045c65f8acc75 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:48.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.771+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c001370 con 0x7fbc90004800 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.771+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0052d0 con 0x7fbc90004800 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.771+0000 7fbca159a640 1 -- 172.21.15.19:0/1363670701 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c003830 con 0x7fbc90004800 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 -- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 msgr2=0x7fbc90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c001750 tx=0x7fbc90005830 comp rx=0 tx=0).stop 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 -- 172.21.15.19:0/1363670701 shutdown_connections 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 --2- 172.21.15.19:0/1363670701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 -- 172.21.15.19:0/1363670701 >> 172.21.15.19:0/1363670701 conn(0x7fbca40d09b0 msgr2=0x7fbca40d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 -- 172.21.15.19:0/1363670701 shutdown_connections 2024-03-04T08:51:48.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.772+0000 7fbca890c640 1 -- 172.21.15.19:0/1363670701 wait complete. 2024-03-04T08:51:48.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.773+0000 7fbca890c640 1 Processor -- start 2024-03-04T08:51:48.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.773+0000 7fbca890c640 1 -- start start 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 0x7fbca413c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbca415e560 0x7fbca415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b4880 con 0x7fbca415e9c0 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4072cd0 con 0x7fbc90004800 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca890c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4071e20 con 0x7fbca415e560 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53400/0 (socket says 172.21.15.19:53400) 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 -- 172.21.15.19:0/4049770142 learned_addr learned my addr 172.21.15.19:0/4049770142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 -- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbca415e560 msgr2=0x7fbca415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:48.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca259c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 0x7fbca413c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbca415e560 0x7fbca415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 -- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 msgr2=0x7fbca413c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 0x7fbca413c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 -- 172.21.15.19:0/4049770142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca413b1a0 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca259c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 0x7fbca413c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.774+0000 7fbca2d9d640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbca40d1a90 tx=0x7fbc94011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.775+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94019070 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.775+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94004030 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.775+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94004400 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.775+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca41e56f0 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.775+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca41e5cb0 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.776+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca41e5eb0 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.776+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc9401c070 con 0x7fbca415e9c0 2024-03-04T08:51:48.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.777+0000 7fbc9affd640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 0x7fbc8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:48.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.777+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc9408a4e0 con 0x7fbca415e9c0 2024-03-04T08:51:48.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.777+0000 7fbca259c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 0x7fbc8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:48.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.777+0000 7fbca259c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 0x7fbc8406d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbca40686a0 tx=0x7fbc9c006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:48.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.781+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbca41e5eb0 con 0x7fbca415e9c0 2024-03-04T08:51:48.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:48.965+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fbca404f330 con 0x7fbca415e9c0 2024-03-04T08:51:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.035+0000 7fbc9affd640 1 -- 172.21.15.19:0/4049770142 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v35) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbc940593f0 con 0x7fbca415e9c0 2024-03-04T08:51:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'data_new' created 2024-03-04T08:51:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 msgr2=0x7fbc8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 0x7fbc8406d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbca40686a0 tx=0x7fbc9c006040 comp rx=0 tx=0).stop 2024-03-04T08:51:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 msgr2=0x7fbca415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbca40d1a90 tx=0x7fbc94011cf0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 shutdown_connections 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca415e9c0 0x7fbca415aa80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbca415e560 0x7fbca415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbc8406b500 0x7fbc8406d9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 --2- 172.21.15.19:0/4049770142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbc90004800 0x7fbca413c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.039+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 >> 172.21.15.19:0/4049770142 conn(0x7fbca40d09b0 msgr2=0x7fbca40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.040+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 shutdown_connections 2024-03-04T08:51:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.041+0000 7fbca890c640 1 -- 172.21.15.19:0/4049770142 wait complete. 2024-03-04T08:51:49.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-03-04T08:51:49.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.163+0000 7f3dfafbc640 1 Processor -- start 2024-03-04T08:51:49.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.163+0000 7f3dfafbc640 1 -- start start 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3dfafbc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df40d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3dfafbc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 0x7f3df40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3dfafbc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df40d4cb0 con 0x7f3df40d4480 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3dfafbc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df40cf420 con 0x7f3df40c79c0 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3dfafbc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40d49d0 con 0x7f3df4161440 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3df9559640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 0x7f3df40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3df8d58640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df40d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3df3fff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f3df40d4480 0x7f3df40d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51648/0 (socket says 172.21.15.19:51648) 2024-03-04T08:51:49.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.164+0000 7f3df3fff640 1 -- 172.21.15.19:0/3913396567 learned_addr learned my addr 172.21.15.19:0/3913396567 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df37fe640 1 -- 172.21.15.19:0/3913396567 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949370671 0 0) 0x7f3df40d4cb0 con 0x7f3df40d4480 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df8d58640 1 -- 172.21.15.19:0/3913396567 >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 msgr2=0x7f3df40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df8d58640 1 --2- 172.21.15.19:0/3913396567 >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 0x7f3df40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df8d58640 1 -- 172.21.15.19:0/3913396567 >> v1:172.21.15.204:6789/0 conn(0x7f3df40d4480 legacy=0x7f3df40d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df8d58640 1 -- 172.21.15.19:0/3913396567 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40cf6c0 con 0x7f3df4161440 2024-03-04T08:51:49.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df9559640 1 --2- 172.21.15.19:0/3913396567 >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 0x7f3df40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.165+0000 7f3df8d58640 1 --2- 172.21.15.19:0/3913396567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df40d1df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d90 tx=0x7f3dec02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1442845be4f5ad07 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3df37fe640 1 -- 172.21.15.19:0/3913396567 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec039070 con 0x7f3df4161440 2024-03-04T08:51:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3df37fe640 1 -- 172.21.15.19:0/3913396567 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec02cb30 con 0x7f3df4161440 2024-03-04T08:51:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3df37fe640 1 -- 172.21.15.19:0/3913396567 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec034440 con 0x7f3df4161440 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3913396567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 msgr2=0x7f3df40d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3913396567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df40d1df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d90 tx=0x7f3dec02bd80 comp rx=0 tx=0).stop 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3913396567 shutdown_connections 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3913396567 >> v2:172.21.15.204:3300/0 conn(0x7f3df40c79c0 0x7f3df40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3913396567 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df40d1df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3913396567 >> 172.21.15.19:0/3913396567 conn(0x7f3df409d030 msgr2=0x7f3df40d3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3913396567 shutdown_connections 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.166+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3913396567 wait complete. 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.167+0000 7f3dfafbc640 1 Processor -- start 2024-03-04T08:51:49.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.167+0000 7f3dfafbc640 1 -- start start 2024-03-04T08:51:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3df40c79c0 0x7f3df40a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df406c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4161820 con 0x7f3df40d4480 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40d2a40 con 0x7f3df40c79c0 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3dfafbc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41619a0 con 0x7f3df4161440 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53410/0 (socket says 172.21.15.19:53410) 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 -- 172.21.15.19:0/3796295927 learned_addr learned my addr 172.21.15.19:0/3796295927 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df9559640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df8d58640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3df40c79c0 0x7f3df40a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 -- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 msgr2=0x7f3df406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df406c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 -- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3df40c79c0 msgr2=0x7f3df40a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3df40c79c0 0x7f3df40a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 -- 172.21.15.19:0/3796295927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40caee0 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df9559640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df3fff640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c430 tx=0x7f3de400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.169+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40074e0 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.170+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de40047e0 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.170+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df40cb1c0 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.170+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4004bd0 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.170+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df40cba60 con 0x7f3df40d4480 2024-03-04T08:51:49.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.171+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df404f330 con 0x7f3df40d4480 2024-03-04T08:51:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.171+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3de4011070 con 0x7f3df40d4480 2024-03-04T08:51:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.171+0000 7f3df17fa640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 0x7f3dd406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.172+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f3de4089e70 con 0x7f3df40d4480 2024-03-04T08:51:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.172+0000 7f3df8d58640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 0x7f3dd406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:49.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.172+0000 7f3df8d58640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 0x7f3dd406d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3dec036000 tx=0x7f3dec030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:49.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.176+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3de4058b80 con 0x7f3df40d4480 2024-03-04T08:51:49.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:49.450+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f3df40cb390 con 0x7f3df40d4480 2024-03-04T08:51:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.049+0000 7f3df17fa640 1 -- 172.21.15.19:0/3796295927 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v14) v1 ==== 131+0+0 (secure 0 0 0) 0x7f3de4058480 con 0x7f3df40d4480 2024-03-04T08:51:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:added data pool 6 to fsmap 2024-03-04T08:51:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.052+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 msgr2=0x7f3dd406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.052+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 0x7f3dd406d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3dec036000 tx=0x7f3dec030000 comp rx=0 tx=0).stop 2024-03-04T08:51:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.052+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 msgr2=0x7f3df40ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.052+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c430 tx=0x7f3de400c830 comp rx=0 tx=0).stop 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 shutdown_connections 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3df4161440 0x7f3df406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3df40d4480 0x7f3df40ccf40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3dd406b4d0 0x7f3dd406d990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 --2- 172.21.15.19:0/3796295927 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3df40c79c0 0x7f3df40a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.053+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 >> 172.21.15.19:0/3796295927 conn(0x7f3df409d030 msgr2=0x7f3df41605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.054+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 shutdown_connections 2024-03-04T08:51:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.054+0000 7f3dfafbc640 1 -- 172.21.15.19:0/3796295927 wait complete. 2024-03-04T08:51:50.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:51:50.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.169+0000 7fa23fa55640 1 Processor -- start 2024-03-04T08:51:50.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.169+0000 7fa23fa55640 1 -- start start 2024-03-04T08:51:50.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23fa55640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa238166af0 0x7fa238168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23fa55640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23815e380 con 0x7fa2380cf850 2024-03-04T08:51:50.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23fa55640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380cdc10 con 0x7fa2380d00c0 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23fa55640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23806ca90 con 0x7fa238166af0 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23cff0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa2380cf850 0x7fa2380cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60886/0 (socket says 172.21.15.19:60886) 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23cff0640 1 -- 172.21.15.19:0/2102817878 learned_addr learned my addr 172.21.15.19:0/2102817878 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.170+0000 7fa23dff2640 1 --2- 172.21.15.19:0/2102817878 >> v2:172.21.15.204:3300/0 conn(0x7fa238166af0 0x7fa238168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044944394 0 0) 0x7fa23815e380 con 0x7fa2380cf850 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa220003520 con 0x7fa2380cf850 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931653741 0 0) 0x7fa220003520 con 0x7fa2380cf850 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 >> v2:172.21.15.204:3300/0 conn(0x7fa238166af0 msgr2=0x7fa238168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 --2- 172.21.15.19:0/2102817878 >> v2:172.21.15.204:3300/0 conn(0x7fa238166af0 0x7fa238168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 >> v1:172.21.15.204:6789/0 conn(0x7fa2380d00c0 legacy=0x7fa2380d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23806c160 con 0x7fa2380cf850 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fa22c001670 con 0x7fa2380cf850 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 >> v1:172.21.15.19:6789/0 conn(0x7fa2380cf850 legacy=0x7fa2380cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200039b0 0x7fa220003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 0x7fa220004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa220005080 0x7fa22000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23806ca90 con 0x7fa2200043b0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22000bfe0 con 0x7fa2200039b0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22000c1e0 con 0x7fa220005080 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 0x7fa220004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23d7f1640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200039b0 0x7fa220003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23dff2640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa220005080 0x7fa22000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 -- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa220005080 msgr2=0x7fa22000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa220005080 0x7fa22000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 -- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200039b0 msgr2=0x7fa220003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200039b0 0x7fa220003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23cff0640 1 -- 172.21.15.19:0/2102817878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220003520 con 0x7fa2200043b0 2024-03-04T08:51:50.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23dff2640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa220005080 0x7fa22000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.171+0000 7fa23dff2640 1 -- 172.21.15.19:0/2102817878 reap_dead start 2024-03-04T08:51:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.172+0000 7fa23cff0640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 0x7fa220004880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c290 tx=0x7fa220005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fe08c523ed3b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.172+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c007d50 con 0x7fa2200043b0 2024-03-04T08:51:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.172+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c030070 con 0x7fa2200043b0 2024-03-04T08:51:50.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.172+0000 7fa237fff640 1 -- 172.21.15.19:0/2102817878 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c005d70 con 0x7fa2200043b0 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 -- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 msgr2=0x7fa220004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 0x7fa220004880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c290 tx=0x7fa220005830 comp rx=0 tx=0).stop 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 -- 172.21.15.19:0/2102817878 shutdown_connections 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 --2- 172.21.15.19:0/2102817878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2200043b0 0x7fa220004880 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 -- 172.21.15.19:0/2102817878 >> 172.21.15.19:0/2102817878 conn(0x7fa2380b35a0 msgr2=0x7fa2380b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 -- 172.21.15.19:0/2102817878 shutdown_connections 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.173+0000 7fa23fa55640 1 -- 172.21.15.19:0/2102817878 wait complete. 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.175+0000 7fa23fa55640 1 Processor -- start 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.175+0000 7fa23fa55640 1 -- start start 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200043b0 0x7fa238152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2381533e0 0x7fa2380c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380b1030 con 0x7fa238156110 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23806c720 con 0x7fa2200043b0 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23fa55640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380c6d10 con 0x7fa2381533e0 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23cff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23cff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53424/0 (socket says 172.21.15.19:53424) 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23cff0640 1 -- 172.21.15.19:0/4202303606 learned_addr learned my addr 172.21.15.19:0/4202303606 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.176+0000 7fa23d7f1640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200043b0 0x7fa238152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23dff2640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2381533e0 0x7fa2380c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 -- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2381533e0 msgr2=0x7fa2380c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2381533e0 0x7fa2380c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 -- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200043b0 msgr2=0x7fa238152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200043b0 0x7fa238152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 -- 172.21.15.19:0/4202303606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa238152c50 con 0x7fa238156110 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23cff0640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3b0 tx=0x7fa22c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c046070 con 0x7fa238156110 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c004c10 con 0x7fa238156110 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c007d50 con 0x7fa238156110 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa238155070 con 0x7fa238156110 2024-03-04T08:51:50.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.177+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238155630 con 0x7fa238156110 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.178+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23804f330 con 0x7fa238156110 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.179+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa22c007070 con 0x7fa238156110 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.179+0000 7fa235ffb640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 0x7fa22406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.180+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa22c0ab700 con 0x7fa238156110 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.180+0000 7fa23d7f1640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 0x7fa22406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.180+0000 7fa23d7f1640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 0x7fa22406d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa230003fa0 tx=0x7fa230009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.184+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa22c079d10 con 0x7fa238156110 2024-03-04T08:51:50.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.403+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2380b2620 con 0x7fa238156110 2024-03-04T08:51:50.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.403+0000 7fa235ffb640 1 -- 172.21.15.19:0/4202303606 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4981 (secure 0 0 0) 0x7fa22c07ddb0 con 0x7fa238156110 2024-03-04T08:51:50.400 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:50.400 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:49.451927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:51:50.400 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 msgr2=0x7fa22406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 0x7fa22406d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa230003fa0 tx=0x7fa230009040 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 msgr2=0x7fa238152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3b0 tx=0x7fa22c02e070 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 shutdown_connections 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2381533e0 0x7fa2380c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa238156110 0x7fa238152ea0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa22406b4d0 0x7fa22406d990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 --2- 172.21.15.19:0/4202303606 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2200043b0 0x7fa238152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 >> 172.21.15.19:0/4202303606 conn(0x7fa2380b35a0 msgr2=0x7fa23806fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 shutdown_connections 2024-03-04T08:51:50.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.405+0000 7fa23fa55640 1 -- 172.21.15.19:0/4202303606 wait complete. 2024-03-04T08:51:50.412 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:50.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.517+0000 7fe6a7d32640 1 Processor -- start 2024-03-04T08:51:50.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.517+0000 7fe6a7d32640 1 -- start start 2024-03-04T08:51:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.518+0000 7fe6a7d32640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.518+0000 7fe6a7d32640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.518+0000 7fe6a7d32640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a00b3430 con 0x7fe6a015dfe0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.518+0000 7fe6a7d32640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a00d2c50 con 0x7fe6a00d22b0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.518+0000 7fe6a7d32640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00b31e0 con 0x7fe6a00b41f0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a52cd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a52cd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:60576/0 (socket says 172.21.15.19:60576) 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:60684/0 (socket says 172.21.15.19:60684) 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a52cd640 1 -- 172.21.15.19:0/2517302516 learned_addr learned my addr 172.21.15.19:0/2517302516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a5ace640 1 --1- 172.21.15.19:0/2517302516 >> v1:172.21.15.204:6789/0 conn(0x7fe6a015dfe0 0x7fe6a00cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51672/0 (socket says 172.21.15.19:51672) 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 -- 172.21.15.19:0/2517302516 >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 msgr2=0x7fe6a00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 --2- 172.21.15.19:0/2517302516 >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 -- 172.21.15.19:0/2517302516 >> v1:172.21.15.204:6789/0 conn(0x7fe6a015dfe0 legacy=0x7fe6a00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a62cf640 1 -- 172.21.15.19:0/2517302516 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00b3710 con 0x7fe6a00b41f0 2024-03-04T08:51:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a4acc640 1 -- 172.21.15.19:0/2517302516 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683687422 0 0) 0x7fe6a00b3430 con 0x7fe6a015dfe0 2024-03-04T08:51:50.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.519+0000 7fe6a52cd640 1 --2- 172.21.15.19:0/2517302516 >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.520+0000 7fe6a62cf640 1 --2- 172.21.15.19:0/2517302516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe698009d90 tx=0x7fe69802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94d912d01b96d65 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.520+0000 7fe6a4acc640 1 -- 172.21.15.19:0/2517302516 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698039070 con 0x7fe6a00b41f0 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.520+0000 7fe6a4acc640 1 -- 172.21.15.19:0/2517302516 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69802cc50 con 0x7fe6a00b41f0 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.520+0000 7fe6a4acc640 1 -- 172.21.15.19:0/2517302516 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698034440 con 0x7fe6a00b41f0 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 -- 172.21.15.19:0/2517302516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 msgr2=0x7fe6a00b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/2517302516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe698009d90 tx=0x7fe69802bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 -- 172.21.15.19:0/2517302516 shutdown_connections 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/2517302516 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00b41f0 0x7fe6a00b4680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/2517302516 >> v2:172.21.15.204:3300/0 conn(0x7fe6a00d22b0 0x7fe6a00d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 -- 172.21.15.19:0/2517302516 >> 172.21.15.19:0/2517302516 conn(0x7fe6a00d3cd0 msgr2=0x7fe6a00d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 -- 172.21.15.19:0/2517302516 shutdown_connections 2024-03-04T08:51:50.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.521+0000 7fe6a7d32640 1 -- 172.21.15.19:0/2517302516 wait complete. 2024-03-04T08:51:50.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.523+0000 7fe6a7d32640 1 Processor -- start 2024-03-04T08:51:50.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.523+0000 7fe6a7d32640 1 -- start start 2024-03-04T08:51:50.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6a00b41f0 0x7fe6a0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00d22b0 0x7fe6a00cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00cfa00 con 0x7fe6a015dfe0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00b3d60 con 0x7fe6a00b41f0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a7d32640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00d1c70 con 0x7fe6a00d22b0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a62cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a62cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53440/0 (socket says 172.21.15.19:53440) 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a62cf640 1 -- 172.21.15.19:0/3001606230 learned_addr learned my addr 172.21.15.19:0/3001606230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a5ace640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6a00b41f0 0x7fe6a0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.524+0000 7fe6a52cd640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00d22b0 0x7fe6a00cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 -- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00d22b0 msgr2=0x7fe6a00cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00d22b0 0x7fe6a00cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 -- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6a00b41f0 msgr2=0x7fe6a0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6a00b41f0 0x7fe6a0152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 -- 172.21.15.19:0/3001606230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00ccea0 con 0x7fe6a015dfe0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a62cf640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe698037040 tx=0x7fe698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698044020 con 0x7fe6a015dfe0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69803a040 con 0x7fe6a015dfe0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a00cd180 con 0x7fe6a015dfe0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698039050 con 0x7fe6a015dfe0 2024-03-04T08:51:50.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.525+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a00cd740 con 0x7fe6a015dfe0 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.526+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a00d37a0 con 0x7fe6a015dfe0 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.527+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe698003990 con 0x7fe6a015dfe0 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.527+0000 7fe6967fc640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 0x7fe68406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.527+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fe6980ac7b0 con 0x7fe6a015dfe0 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.528+0000 7fe6a5ace640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 0x7fe68406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:50.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.528+0000 7fe6a5ace640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 0x7fe68406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe690000f60 tx=0x7fe690007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.532+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe6a00d37a0 con 0x7fe6a015dfe0 2024-03-04T08:51:50.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.833+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6a004f330 con 0x7fe6a015dfe0 2024-03-04T08:51:50.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.835+0000 7fe6967fc640 1 -- 172.21.15.19:0/3001606230 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18482 (secure 0 0 0) 0x7fe69804e060 con 0x7fe6a015dfe0 2024-03-04T08:51:50.831 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:49.451691+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 msgr2=0x7fe68406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 0x7fe68406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe690000f60 tx=0x7fe690007c00 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 msgr2=0x7fe6a00b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe698037040 tx=0x7fe698004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 shutdown_connections 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a015dfe0 0x7fe6a00b6b70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe6a00d22b0 0x7fe6a00cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe68406b4d0 0x7fe68406d990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 --2- 172.21.15.19:0/3001606230 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe6a00b41f0 0x7fe6a0152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 >> 172.21.15.19:0/3001606230 conn(0x7fe6a00d3cd0 msgr2=0x7fe6a006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 shutdown_connections 2024-03-04T08:51:50.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:50.837+0000 7fe6a7d32640 1 -- 172.21.15.19:0/3001606230 wait complete. 2024-03-04T08:51:50.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:50.848 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-03-04T08:51:50.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:50.869 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-03-04T08:51:50.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-03-04T08:51:51.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.084+0000 7f16910c9640 1 Processor -- start 2024-03-04T08:51:51.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.084+0000 7f16910c9640 1 -- start start 2024-03-04T08:51:51.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.085+0000 7f16910c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f168c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.085+0000 7f16910c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f168c0d0af0 0x7f168c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.085+0000 7f16910c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0cd4b0 con 0x7f168c06fb40 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.085+0000 7f16910c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c06ff80 con 0x7f168c0d0af0 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.085+0000 7f16910c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0cd790 con 0x7f168c15c050 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f168c06fb40 0x7f168c0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60900/0 (socket says 172.21.15.19:60900) 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168a59c640 1 -- 172.21.15.19:0/2634440387 learned_addr learned my addr 172.21.15.19:0/2634440387 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168b59e640 1 --2- 172.21.15.19:0/2634440387 >> v2:172.21.15.204:3300/0 conn(0x7f168c0d0af0 0x7f168c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f168c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756210639 0 0) 0x7f168c0cd4b0 con 0x7f168c06fb40 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1678003520 con 0x7f168c06fb40 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924210213 0 0) 0x7f1678003520 con 0x7f168c06fb40 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 msgr2=0x7f168c06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f168c06f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 >> v2:172.21.15.204:3300/0 conn(0x7f168c0d0af0 msgr2=0x7f168c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 --2- 172.21.15.19:0/2634440387 >> v2:172.21.15.204:3300/0 conn(0x7f168c0d0af0 0x7f168c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0cda70 con 0x7f168c06fb40 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f1674001670 con 0x7f168c06fb40 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 >> v1:172.21.15.19:6789/0 conn(0x7f168c06fb40 legacy=0x7f168c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f1678004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1678004d40 0x7f16780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06ff80 con 0x7f1678004d40 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0cd790 con 0x7f16780039b0 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167800b9c0 con 0x7f168c15c050 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168b59e640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1678004d40 0x7f16780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.086+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168a59c640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f1678004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168b59e640 1 -- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 msgr2=0x7f1678004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168b59e640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f1678004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168b59e640 1 -- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16780039b0 msgr2=0x7f1678003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168b59e640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16780039b0 0x7f1678003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168b59e640 1 -- 172.21.15.19:0/2634440387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678003520 con 0x7f1678004d40 2024-03-04T08:51:51.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.087+0000 7f168a59c640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c15c050 0x7f1678004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:51.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.088+0000 7f168b59e640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1678004d40 0x7f16780051c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f167c009f90 tx=0x7f1678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ba198350db6663 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.088+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c039070 con 0x7f1678004d40 2024-03-04T08:51:51.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.088+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c02cc20 con 0x7f1678004d40 2024-03-04T08:51:51.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.088+0000 7f1689d9b640 1 -- 172.21.15.19:0/2634440387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c009c10 con 0x7f1678004d40 2024-03-04T08:51:51.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 -- 172.21.15.19:0/2634440387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1678004d40 msgr2=0x7f16780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 --2- 172.21.15.19:0/2634440387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1678004d40 0x7f16780051c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f167c009f90 tx=0x7f1678005830 comp rx=0 tx=0).stop 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f168b59e640 1 -- 172.21.15.19:0/2634440387 reap_dead start 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 -- 172.21.15.19:0/2634440387 shutdown_connections 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 -- 172.21.15.19:0/2634440387 >> 172.21.15.19:0/2634440387 conn(0x7f168c0b3800 msgr2=0x7f168c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 -- 172.21.15.19:0/2634440387 shutdown_connections 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.089+0000 7f16910c9640 1 -- 172.21.15.19:0/2634440387 wait complete. 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.091+0000 7f16910c9640 1 Processor -- start 2024-03-04T08:51:51.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.091+0000 7f16910c9640 1 -- start start 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 0x7f168c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 0x7f168c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06f780 con 0x7f168c09bbf0 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06f600 con 0x7f1678004d40 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f16910c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06f900 con 0x7f168c0b01e0 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f168a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f168a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53456/0 (socket says 172.21.15.19:53456) 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f168a59c640 1 -- 172.21.15.19:0/2337886407 learned_addr learned my addr 172.21.15.19:0/2337886407 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f168b59e640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 0x7f168c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.092+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 0x7f168c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 -- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 msgr2=0x7f168c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 0x7f168c0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 -- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 msgr2=0x7f168c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 0x7f168c0b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 -- 172.21.15.19:0/2337886407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c09c7d0 con 0x7f168c09bbf0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168b59e640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 0x7f168c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 0x7f168c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f168a59c640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1674000fb0 tx=0x7f167400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167400c8d0 con 0x7f168c09bbf0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674018070 con 0x7f168c09bbf0 2024-03-04T08:51:51.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c09cab0 con 0x7f168c09bbf0 2024-03-04T08:51:51.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167400cc70 con 0x7f168c09bbf0 2024-03-04T08:51:51.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.093+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c09d070 con 0x7f168c09bbf0 2024-03-04T08:51:51.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.094+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c09fe60 con 0x7f168c09bbf0 2024-03-04T08:51:51.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.094+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f167401d460 con 0x7f168c09bbf0 2024-03-04T08:51:51.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.095+0000 7f16837fe640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 0x7f166c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.095+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f167408a3a0 con 0x7f168c09bbf0 2024-03-04T08:51:51.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.095+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 0x7f166c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.096+0000 7f168ad9d640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 0x7f166c06d9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1684009b40 tx=0x7f1684008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.103+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1674059090 con 0x7f168c09bbf0 2024-03-04T08:51:51.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.414+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f168c09e290 con 0x7f168c09bbf0 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.418+0000 7f16837fe640 1 -- 172.21.15.19:0/2337886407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+167 (secure 0 0 0) 0x7f1674058990 con 0x7f168c09bbf0 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow rw" 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-03-04T08:51:51.414 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 msgr2=0x7f166c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 0x7f166c06d9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1684009b40 tx=0x7f1684008040 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 msgr2=0x7f168c09c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1674000fb0 tx=0x7f167400ed50 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 shutdown_connections 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f168c0b01e0 0x7f168c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f168c09bbf0 0x7f168c09c070 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f166c06b500 0x7f166c06d9c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 --2- 172.21.15.19:0/2337886407 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1678004d40 0x7f168c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.420+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 >> 172.21.15.19:0/2337886407 conn(0x7f168c0b3800 msgr2=0x7f168c0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:51.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.421+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 shutdown_connections 2024-03-04T08:51:51.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.421+0000 7f16910c9640 1 -- 172.21.15.19:0/2337886407 wait complete. 2024-03-04T08:51:51.430 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:51.430 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:51.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.594+0000 7f990129d640 1 Processor -- start 2024-03-04T08:51:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 -- start start 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98fc0d00c0 0x7f98fc0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc06cf20 0x7f98fc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc0d09e0 con 0x7f98fc0cf850 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc06ca90 con 0x7f98fc0d00c0 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f990129d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc15e380 con 0x7f98fc06cf20 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f98faffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98fc0d00c0 0x7f98fc0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f98f27fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f98fc0cf850 0x7f98fc0cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60908/0 (socket says 172.21.15.19:60908) 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.595+0000 7f98f27fc640 1 -- 172.21.15.19:0/2783232380 learned_addr learned my addr 172.21.15.19:0/2783232380 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98faffd640 1 -- 172.21.15.19:0/2783232380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc06cf20 msgr2=0x7f98fc06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98fb7fe640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc06cf20 0x7f98fc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98faffd640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc06cf20 0x7f98fc06d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98faffd640 1 -- 172.21.15.19:0/2783232380 >> v1:172.21.15.19:6789/0 conn(0x7f98fc0cf850 legacy=0x7f98fc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98fa7fc640 1 -- 172.21.15.19:0/2783232380 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50113573 0 0) 0x7f98fc0d09e0 con 0x7f98fc0cf850 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.596+0000 7f98faffd640 1 -- 172.21.15.19:0/2783232380 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0cdc10 con 0x7f98fc0d00c0 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f98faffd640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0d04a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0097a0 tx=0x7f98ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da3101aa260e945 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f98fa7fc640 1 -- 172.21.15.19:0/2783232380 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec035020 con 0x7f98fc0d00c0 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f98fa7fc640 1 -- 172.21.15.19:0/2783232380 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec031830 con 0x7f98fc0d00c0 2024-03-04T08:51:51.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f98fa7fc640 1 -- 172.21.15.19:0/2783232380 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec031c00 con 0x7f98fc0d00c0 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 -- 172.21.15.19:0/2783232380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 msgr2=0x7f98fc0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0d04a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0097a0 tx=0x7f98ec02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 -- 172.21.15.19:0/2783232380 shutdown_connections 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc06cf20 0x7f98fc06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 --2- 172.21.15.19:0/2783232380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0d04a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 -- 172.21.15.19:0/2783232380 >> 172.21.15.19:0/2783232380 conn(0x7f98fc0b35a0 msgr2=0x7f98fc0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 -- 172.21.15.19:0/2783232380 shutdown_connections 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.597+0000 7f990129d640 1 -- 172.21.15.19:0/2783232380 wait complete. 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 Processor -- start 2024-03-04T08:51:51.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 -- start start 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98fc06cf20 0x7f98fc160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 0x7f98fc0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc06c720 con 0x7f98fc0d00c0 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc06c440 con 0x7f98fc06cf20 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.599+0000 7f990129d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b1030 con 0x7f98fc0cf850 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53470/0 (socket says 172.21.15.19:53470) 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 -- 172.21.15.19:0/1503060799 learned_addr learned my addr 172.21.15.19:0/1503060799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98faffd640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98fc06cf20 0x7f98fc160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98f27fc640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 0x7f98fc0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 -- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 msgr2=0x7f98fc0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 0x7f98fc0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 -- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98fc06cf20 msgr2=0x7f98fc160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98fc06cf20 0x7f98fc160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 -- 172.21.15.19:0/1503060799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc1f4a20 con 0x7f98fc0d00c0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98f27fc640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 0x7f98fc0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98fb7fe640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98f400cc30 tx=0x7f98f400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f400ce40 con 0x7f98fc0d00c0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4003990 con 0x7f98fc0d00c0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc1f4740 con 0x7f98fc0d00c0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4003d40 con 0x7f98fc0d00c0 2024-03-04T08:51:51.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.600+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc0c69e0 con 0x7f98fc0d00c0 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.601+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc04f330 con 0x7f98fc0d00c0 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.602+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98f4004000 con 0x7f98fc0d00c0 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.602+0000 7f98f3fff640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 0x7f98dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.602+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f98f408a830 con 0x7f98fc0d00c0 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.602+0000 7f98faffd640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 0x7f98dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.603+0000 7f98faffd640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 0x7f98dc06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f98ec036000 tx=0x7f98ec008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.607+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f98f4014030 con 0x7f98fc0d00c0 2024-03-04T08:51:51.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.787+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98fc0b3b20 con 0x7f98fc0d00c0 2024-03-04T08:51:51.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.788+0000 7f98f3fff640 1 -- 172.21.15.19:0/1503060799 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f98f4059520 con 0x7f98fc0d00c0 2024-03-04T08:51:51.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:51.784 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 msgr2=0x7f98dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 0x7f98dc06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f98ec036000 tx=0x7f98ec008030 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 msgr2=0x7f98fc0cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98f400cc30 tx=0x7f98f400a5c0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 shutdown_connections 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98fc0d00c0 0x7f98fc0cde10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f98fc0cf850 0x7f98fc0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f98dc06b4d0 0x7f98dc06d990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 --2- 172.21.15.19:0/1503060799 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f98fc06cf20 0x7f98fc160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 >> 172.21.15.19:0/1503060799 conn(0x7f98fc0b35a0 msgr2=0x7f98fc06f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 shutdown_connections 2024-03-04T08:51:51.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.790+0000 7f990129d640 1 -- 172.21.15.19:0/1503060799 wait complete. 2024-03-04T08:51:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:51.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:51.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.905+0000 7f1b08c15640 1 Processor -- start 2024-03-04T08:51:51.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.905+0000 7f1b08c15640 1 -- start start 2024-03-04T08:51:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b040d10c0 0x7f1b040d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1b040d14a0 0x7f1b0415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 0x7f1b040cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0415c050 con 0x7f1b040d10c0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040d0060 con 0x7f1b040d14a0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b08c15640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040cfa50 con 0x7f1b0415eb00 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b0259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b040d10c0 0x7f1b040d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.906+0000 7f1b0259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b040d10c0 0x7f1b040d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53474/0 (socket says 172.21.15.19:53474) 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 -- 172.21.15.19:0/3806996284 learned_addr learned my addr 172.21.15.19:0/3806996284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b02d9d640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 0x7f1b040cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b01d9b640 1 --2- 172.21.15.19:0/3806996284 >> v2:172.21.15.204:3300/0 conn(0x7f1b040d14a0 0x7f1b0415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 -- 172.21.15.19:0/3806996284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 msgr2=0x7f1b040cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 0x7f1b040cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 -- 172.21.15.19:0/3806996284 >> v2:172.21.15.204:3300/0 conn(0x7f1b040d14a0 msgr2=0x7f1b0415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 --2- 172.21.15.19:0/3806996284 >> v2:172.21.15.204:3300/0 conn(0x7f1b040d14a0 0x7f1b0415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b0259c640 1 -- 172.21.15.19:0/3806996284 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040d0a30 con 0x7f1b040d10c0 2024-03-04T08:51:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.907+0000 7f1b02d9d640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 0x7f1b040cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.908+0000 7f1b0259c640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040d04f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b0406f920 tx=0x7f1af402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbc744c47fd863d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.908+0000 7f1b0159a640 1 -- 172.21.15.19:0/3806996284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4035020 con 0x7f1b040d10c0 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.908+0000 7f1b0159a640 1 -- 172.21.15.19:0/3806996284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4031870 con 0x7f1b040d10c0 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.908+0000 7f1b0159a640 1 -- 172.21.15.19:0/3806996284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4031c40 con 0x7f1b040d10c0 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 -- 172.21.15.19:0/3806996284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 msgr2=0x7f1b040d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040d04f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b0406f920 tx=0x7f1af402b910 comp rx=0 tx=0).stop 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 -- 172.21.15.19:0/3806996284 shutdown_connections 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b0415eb00 0x7f1b040cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 --2- 172.21.15.19:0/3806996284 >> v2:172.21.15.204:3300/0 conn(0x7f1b040d14a0 0x7f1b0415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 --2- 172.21.15.19:0/3806996284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040d04f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 -- 172.21.15.19:0/3806996284 >> 172.21.15.19:0/3806996284 conn(0x7f1b040b3800 msgr2=0x7f1b040b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 -- 172.21.15.19:0/3806996284 shutdown_connections 2024-03-04T08:51:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.909+0000 7f1b08c15640 1 -- 172.21.15.19:0/3806996284 wait complete. 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.910+0000 7f1b08c15640 1 Processor -- start 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.910+0000 7f1b08c15640 1 -- start start 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 0x7f1b041f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 0x7f1b0414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0415f440 con 0x7f1b040d10c0 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0415f160 con 0x7f1b0415eb00 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b08c15640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040cfcf0 con 0x7f1b040d14a0 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53476/0 (socket says 172.21.15.19:53476) 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 -- 172.21.15.19:0/1599215896 learned_addr learned my addr 172.21.15.19:0/1599215896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b01d9b640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 0x7f1b041f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b02d9d640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 0x7f1b0414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 -- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 msgr2=0x7f1b041f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 0x7f1b041f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 -- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 msgr2=0x7f1b0414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 0x7f1b0414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 -- 172.21.15.19:0/1599215896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b041f5040 con 0x7f1b040d10c0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b01d9b640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 0x7f1b041f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b02d9d640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 0x7f1b0414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.911+0000 7f1b0259c640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1af402b950 tx=0x7f1af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.912+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4040070 con 0x7f1b040d10c0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.912+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4030d00 con 0x7f1b040d10c0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.912+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b040b4eb0 con 0x7f1b040d10c0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.912+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4035040 con 0x7f1b040d10c0 2024-03-04T08:51:51.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.912+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040b5470 con 0x7f1b040d10c0 2024-03-04T08:51:51.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.913+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0409fe60 con 0x7f1b040d10c0 2024-03-04T08:51:51.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.913+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1af404b060 con 0x7f1b040d10c0 2024-03-04T08:51:51.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.913+0000 7f1af2ffd640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:51.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.913+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f1af40abfd0 con 0x7f1b040d10c0 2024-03-04T08:51:51.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.914+0000 7f1b01d9b640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:51.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.914+0000 7f1b01d9b640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 0x7f1ae406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b0415bb20 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:51.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:51.918+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1b041f5040 con 0x7f1b040d10c0 2024-03-04T08:51:52.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.098+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b040d0c30 con 0x7f1b040d10c0 2024-03-04T08:51:52.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.099+0000 7f1af2ffd640 1 -- 172.21.15.19:0/1599215896 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1af407ad50 con 0x7f1b040d10c0 2024-03-04T08:51:52.095 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 msgr2=0x7f1ae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 0x7f1ae406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b0415bb20 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 msgr2=0x7f1b040cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1af402b950 tx=0x7f1af40046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 shutdown_connections 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1b0415eb00 0x7f1b0414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1b040d14a0 0x7f1b041f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 --2- 172.21.15.19:0/1599215896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b040d10c0 0x7f1b040cc180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 >> 172.21.15.19:0/1599215896 conn(0x7f1b040b3800 msgr2=0x7f1b0415cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 shutdown_connections 2024-03-04T08:51:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.101+0000 7f1b08c15640 1 -- 172.21.15.19:0/1599215896 wait complete. 2024-03-04T08:51:52.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:52.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.220+0000 7f20f093a640 1 Processor -- start 2024-03-04T08:51:52.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.220+0000 7f20f093a640 1 -- start start 2024-03-04T08:51:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.221+0000 7f20f093a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f20ec0d10c0 0x7f20ec0d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.221+0000 7f20f093a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0cfa50 con 0x7f20ec0d14a0 2024-03-04T08:51:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.221+0000 7f20f093a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0d0a30 con 0x7f20ec15ecd0 2024-03-04T08:51:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.221+0000 7f20f093a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec15c050 con 0x7f20ec0d10c0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f20ec0d14a0 0x7f20ec15e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60916/0 (socket says 172.21.15.19:60916) 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e3fff640 1 -- 172.21.15.19:0/1566480051 learned_addr learned my addr 172.21.15.19:0/1566480051 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> v2:172.21.15.204:3300/0 conn(0x7f20ec0d10c0 0x7f20ec0d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357007816 0 0) 0x7f20ec0cfa50 con 0x7f20ec0d14a0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d8003520 con 0x7f20ec0d14a0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 615034715 0 0) 0x7f20d8003520 con 0x7f20ec0d14a0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 >> v2:172.21.15.204:3300/0 conn(0x7f20ec0d10c0 msgr2=0x7f20ec0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 --2- 172.21.15.19:0/1566480051 >> v2:172.21.15.204:3300/0 conn(0x7f20ec0d10c0 0x7f20ec0d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 >> v1:172.21.15.204:6789/0 conn(0x7f20ec15ecd0 legacy=0x7f20ec0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0b45c0 con 0x7f20ec0d14a0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f20d4001670 con 0x7f20ec0d14a0 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> v2:172.21.15.204:3300/0 conn(0x7f20ec0d10c0 0x7f20ec0d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 >> v1:172.21.15.19:6789/0 conn(0x7f20ec0d14a0 legacy=0x7f20ec15e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 0x7f20d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20d8004800 0x7f20d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80051c0 0x7f20d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d800c030 con 0x7f20d80039b0 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d800c1e0 con 0x7f20d80051c0 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d800c3e0 con 0x7f20d8004800 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 0x7f20d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.222+0000 7f20ead9d640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80051c0 0x7f20d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20e3fff640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20d8004800 0x7f20d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ea59c640 1 -- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20d8004800 msgr2=0x7f20d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20d8004800 0x7f20d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ea59c640 1 -- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80051c0 msgr2=0x7f20d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80051c0 0x7f20d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ead9d640 1 -- 172.21.15.19:0/1566480051 reap_dead start 2024-03-04T08:51:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.223+0000 7f20ea59c640 1 -- 172.21.15.19:0/1566480051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8003520 con 0x7f20d80039b0 2024-03-04T08:51:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20ea59c640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 0x7f20d8003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009c90 tx=0x7f20d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bbe50c1a8611d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc039070 con 0x7f20d80039b0 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc02c8f0 con 0x7f20d80039b0 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20e9d9b640 1 -- 172.21.15.19:0/1566480051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc009860 con 0x7f20d80039b0 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 -- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 msgr2=0x7f20d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 0x7f20d8003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009c90 tx=0x7f20d8005830 comp rx=0 tx=0).stop 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 -- 172.21.15.19:0/1566480051 shutdown_connections 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 --2- 172.21.15.19:0/1566480051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d80039b0 0x7f20d8003dd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 -- 172.21.15.19:0/1566480051 >> 172.21.15.19:0/1566480051 conn(0x7f20ec0b3800 msgr2=0x7f20ec0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 -- 172.21.15.19:0/1566480051 shutdown_connections 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.224+0000 7f20f093a640 1 -- 172.21.15.19:0/1566480051 wait complete. 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 Processor -- start 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 -- start start 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 0x7f20ec156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20ec1f78b0 0x7f20ec15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec15f440 con 0x7f20ec159dd0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0d0060 con 0x7f20d80039b0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.226+0000 7f20f093a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cfcf0 con 0x7f20ec1f78b0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53498/0 (socket says 172.21.15.19:53498) 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 -- 172.21.15.19:0/293639276 learned_addr learned my addr 172.21.15.19:0/293639276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20ea59c640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 0x7f20ec156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20ead9d640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20ec1f78b0 0x7f20ec15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 -- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20ec1f78b0 msgr2=0x7f20ec15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20ec1f78b0 0x7f20ec15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 -- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 msgr2=0x7f20ec156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 0x7f20ec156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 -- 172.21.15.19:0/293639276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0b4a90 con 0x7f20ec159dd0 2024-03-04T08:51:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20ea59c640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 0x7f20ec156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e3fff640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e730 tx=0x7f20d400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400ee40 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4018070 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0b4d70 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400caf0 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.227+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0b5330 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.228+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec09fe60 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.229+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20d400cc90 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.229+0000 7f20e2ffd640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 0x7f20cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.229+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f20d408a190 con 0x7f20ec159dd0 2024-03-04T08:51:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.229+0000 7f20ea59c640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 0x7f20cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.230+0000 7f20ea59c640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 0x7f20cc06d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20dc036000 tx=0x7f20dc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.234+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f20d4058f10 con 0x7f20ec159dd0 2024-03-04T08:51:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.415+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20ec0b5500 con 0x7f20ec159dd0 2024-03-04T08:51:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.415+0000 7f20e2ffd640 1 -- 172.21.15.19:0/293639276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20d4058810 con 0x7f20ec159dd0 2024-03-04T08:51:52.412 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 msgr2=0x7f20cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 0x7f20cc06d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20dc036000 tx=0x7f20dc030000 comp rx=0 tx=0).stop 2024-03-04T08:51:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 msgr2=0x7f20ec1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e730 tx=0x7f20d400ebf0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 shutdown_connections 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f20ec1f78b0 0x7f20ec15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20ec159dd0 0x7f20ec1588c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f20cc06b500 0x7f20cc06d9c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 --2- 172.21.15.19:0/293639276 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d80039b0 0x7f20ec156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 >> 172.21.15.19:0/293639276 conn(0x7f20ec0b3800 msgr2=0x7f20ec0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 shutdown_connections 2024-03-04T08:51:52.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.417+0000 7f20f093a640 1 -- 172.21.15.19:0/293639276 wait complete. 2024-03-04T08:51:52.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.532+0000 7f66da15e640 1 Processor -- start 2024-03-04T08:51:52.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66da15e640 1 -- start start 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66da15e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f66d40d4860 0x7f66d40d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66da15e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d41618b0 con 0x7f66d40b0e30 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66da15e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d40cf400 con 0x7f66d41614d0 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66da15e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d40d4cf0 con 0x7f66d40d4860 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.533+0000 7f66d3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f66d40b0e30 0x7f66d40b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60928/0 (socket says 172.21.15.19:60928) 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d3fff640 1 -- 172.21.15.19:0/3349679954 learned_addr learned my addr 172.21.15.19:0/3349679954 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/3349679954 >> v2:172.21.15.204:3300/0 conn(0x7f66d40d4860 0x7f66d40d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410900470 0 0) 0x7f66d41618b0 con 0x7f66d40b0e30 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66bc003520 con 0x7f66d40b0e30 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852644926 0 0) 0x7f66bc003520 con 0x7f66d40b0e30 2024-03-04T08:51:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 >> v2:172.21.15.204:3300/0 conn(0x7f66d40d4860 msgr2=0x7f66d40d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 --2- 172.21.15.19:0/3349679954 >> v2:172.21.15.204:3300/0 conn(0x7f66d40d4860 0x7f66d40d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 >> v1:172.21.15.204:6789/0 conn(0x7f66d41614d0 legacy=0x7f66d40d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40cf6a0 con 0x7f66d40b0e30 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f66cc001a10 con 0x7f66d40b0e30 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/3349679954 >> v2:172.21.15.204:3300/0 conn(0x7f66d40d4860 0x7f66d40d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 >> v1:172.21.15.19:6789/0 conn(0x7f66d40b0e30 legacy=0x7f66d40b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0039b0 0x7f66bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66bc004800 0x7f66bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 0x7f66bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40d4cf0 con 0x7f66bc0051c0 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00c060 con 0x7f66bc004800 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc00c260 con 0x7f66bc0039b0 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d3fff640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 0x7f66bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66bc004800 0x7f66bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.534+0000 7f66d37fe640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0039b0 0x7f66bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 -- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0039b0 msgr2=0x7f66bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0039b0 0x7f66bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 -- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66bc004800 msgr2=0x7f66bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66bc004800 0x7f66bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 -- 172.21.15.19:0/3349679954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc003520 con 0x7f66bc0051c0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 -- 172.21.15.19:0/3349679954 reap_dead start 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d3fff640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 0x7f66bc00b9c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00a8f0 tx=0x7f66bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5b6dd32fa47e9f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00a4c0 con 0x7f66bc0051c0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.535+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc034650 con 0x7f66bc0051c0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66d27fc640 1 -- 172.21.15.19:0/3349679954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc034a40 con 0x7f66bc0051c0 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 -- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 msgr2=0x7f66bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 0x7f66bc00b9c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00a8f0 tx=0x7f66bc005830 comp rx=0 tx=0).stop 2024-03-04T08:51:52.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 -- 172.21.15.19:0/3349679954 shutdown_connections 2024-03-04T08:51:52.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 --2- 172.21.15.19:0/3349679954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66bc0051c0 0x7f66bc00b9c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 -- 172.21.15.19:0/3349679954 >> 172.21.15.19:0/3349679954 conn(0x7f66d40d3d40 msgr2=0x7f66d40d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 -- 172.21.15.19:0/3349679954 shutdown_connections 2024-03-04T08:51:52.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.536+0000 7f66da15e640 1 -- 172.21.15.19:0/3349679954 wait complete. 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.537+0000 7f66da15e640 1 Processor -- start 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 -- start start 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0051c0 0x7f66d41f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 0x7f66d406c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40b0910 con 0x7f66d40c81d0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40cfc60 con 0x7f66d40c8650 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66da15e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40d1910 con 0x7f66bc0051c0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66d2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66d2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53504/0 (socket says 172.21.15.19:53504) 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.538+0000 7f66d2ffd640 1 -- 172.21.15.19:0/4110917707 learned_addr learned my addr 172.21.15.19:0/4110917707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d3fff640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 0x7f66d406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d37fe640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0051c0 0x7f66d41f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 -- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0051c0 msgr2=0x7f66d41f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0051c0 0x7f66d41f1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 -- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 msgr2=0x7f66d406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 0x7f66d406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 -- 172.21.15.19:0/4110917707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40c79f0 con 0x7f66d40c81d0 2024-03-04T08:51:52.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d3fff640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 0x7f66d406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66d2ffd640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c4011a90 tx=0x7f66c4011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400fc10 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400fdb0 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d41f1560 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4004260 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.539+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d41f4900 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.540+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d4068ff0 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.541+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66c4012040 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.541+0000 7f66bbfff640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 0x7f66c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.541+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f66c408a860 con 0x7f66d40c81d0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.541+0000 7f66d37fe640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 0x7f66c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.542+0000 7f66d37fe640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 0x7f66c006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66c8000c00 tx=0x7f66c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.545+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f66c4019030 con 0x7f66d40c81d0 2024-03-04T08:51:52.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.728+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66d41f4ad0 con 0x7f66d40c81d0 2024-03-04T08:51:52.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.728+0000 7f66bbfff640 1 -- 172.21.15.19:0/4110917707 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66c4059550 con 0x7f66d40c81d0 2024-03-04T08:51:52.724 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:52.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 msgr2=0x7f66c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 0x7f66c006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66c8000c00 tx=0x7f66c8009040 comp rx=0 tx=0).stop 2024-03-04T08:51:52.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 msgr2=0x7f66d41f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c4011a90 tx=0x7f66c4011f50 comp rx=0 tx=0).stop 2024-03-04T08:51:52.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 shutdown_connections 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f66c006b4d0 0x7f66c006d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f66d40c8650 0x7f66d406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66d40c81d0 0x7f66d41f3b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 --2- 172.21.15.19:0/4110917707 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f66bc0051c0 0x7f66d41f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 >> 172.21.15.19:0/4110917707 conn(0x7f66d40d3d40 msgr2=0x7f66d40b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 shutdown_connections 2024-03-04T08:51:52.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.731+0000 7f66da15e640 1 -- 172.21.15.19:0/4110917707 wait complete. 2024-03-04T08:51:52.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:51:52.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.849+0000 7f08f77d0640 1 Processor -- start 2024-03-04T08:51:52.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.849+0000 7f08f77d0640 1 -- start start 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f77d0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f08f00d10c0 0x7f08f00d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f77d0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08f00d14a0 0x7f08f015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f77d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00cfa50 con 0x7f08f015eb00 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f77d0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f015c050 con 0x7f08f00d14a0 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f77d0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00d0060 con 0x7f08f00d10c0 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f4d6b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08f00d14a0 0x7f08f015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f4d6b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08f00d14a0 0x7f08f015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53512/0 (socket says 172.21.15.19:53512) 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f5d6d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f08f015eb00 0x7f08f00cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60936/0 (socket says 172.21.15.19:60936) 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f4d6b640 1 -- 172.21.15.19:0/4221867125 learned_addr learned my addr 172.21.15.19:0/4221867125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.850+0000 7f08f556c640 1 --2- 172.21.15.19:0/4221867125 >> v2:172.21.15.204:3300/0 conn(0x7f08f00d10c0 0x7f08f00d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08f4d6b640 1 -- 172.21.15.19:0/4221867125 >> v2:172.21.15.204:3300/0 conn(0x7f08f00d10c0 msgr2=0x7f08f00d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:52.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08f4d6b640 1 --2- 172.21.15.19:0/4221867125 >> v2:172.21.15.204:3300/0 conn(0x7f08f00d10c0 0x7f08f00d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08f4d6b640 1 -- 172.21.15.19:0/4221867125 >> v1:172.21.15.19:6789/0 conn(0x7f08f015eb00 legacy=0x7f08f00cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08f4d6b640 1 -- 172.21.15.19:0/4221867125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00d0a30 con 0x7f08f00d14a0 2024-03-04T08:51:52.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08e7fff640 1 -- 172.21.15.19:0/4221867125 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205751760 0 0) 0x7f08f00cfa50 con 0x7f08f015eb00 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08f4d6b640 1 --2- 172.21.15.19:0/4221867125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f015e5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f08f00718d0 tx=0x7f08e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5794af8066f5b06 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08e7fff640 1 -- 172.21.15.19:0/4221867125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0034070 con 0x7f08f00d14a0 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08e7fff640 1 -- 172.21.15.19:0/4221867125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0030860 con 0x7f08f00d14a0 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.851+0000 7f08e7fff640 1 -- 172.21.15.19:0/4221867125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0030c30 con 0x7f08f00d14a0 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 -- 172.21.15.19:0/4221867125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 msgr2=0x7f08f015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 --2- 172.21.15.19:0/4221867125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f015e5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f08f00718d0 tx=0x7f08e002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 -- 172.21.15.19:0/4221867125 shutdown_connections 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 --2- 172.21.15.19:0/4221867125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f015e5c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 --2- 172.21.15.19:0/4221867125 >> v2:172.21.15.204:3300/0 conn(0x7f08f00d10c0 0x7f08f00d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 -- 172.21.15.19:0/4221867125 >> 172.21.15.19:0/4221867125 conn(0x7f08f00b3800 msgr2=0x7f08f00b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 -- 172.21.15.19:0/4221867125 shutdown_connections 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.852+0000 7f08f77d0640 1 -- 172.21.15.19:0/4221867125 wait complete. 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.854+0000 7f08f77d0640 1 Processor -- start 2024-03-04T08:51:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.854+0000 7f08f77d0640 1 -- start start 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08f00d10c0 0x7f08f014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08f015eb00 0x7f08f00cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f015f440 con 0x7f08f00d14a0 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f015f160 con 0x7f08f00d10c0 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f77d0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00cfcf0 con 0x7f08f015eb00 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f4d6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.855+0000 7f08f4d6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53522/0 (socket says 172.21.15.19:53522) 2024-03-04T08:51:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 -- 172.21.15.19:0/489244737 learned_addr learned my addr 172.21.15.19:0/489244737 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f556c640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08f00d10c0 0x7f08f014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f5d6d640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08f015eb00 0x7f08f00cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 -- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08f015eb00 msgr2=0x7f08f00cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08f015eb00 0x7f08f00cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 -- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08f00d10c0 msgr2=0x7f08f014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08f00d10c0 0x7f08f014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 -- 172.21.15.19:0/489244737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00b55b0 con 0x7f08f00d14a0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f4d6b640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f08e00090b0 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0034040 con 0x7f08f00d14a0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e003ab90 con 0x7f08f00d14a0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f00cc3d0 con 0x7f08f00d14a0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0004030 con 0x7f08f00d14a0 2024-03-04T08:51:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.856+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f014aaa0 con 0x7f08f00d14a0 2024-03-04T08:51:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.857+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f009fe60 con 0x7f08f00d14a0 2024-03-04T08:51:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.858+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08e004b060 con 0x7f08f00d14a0 2024-03-04T08:51:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.859+0000 7f08e5ffb640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 0x7f08d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.859+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f08e00ac140 con 0x7f08f00d14a0 2024-03-04T08:51:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.859+0000 7f08f556c640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 0x7f08d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.859+0000 7f08f556c640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 0x7f08d406d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08f00cc030 tx=0x7f08ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:52.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:52.863+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f08e003f070 con 0x7f08f00d14a0 2024-03-04T08:51:53.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.044+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f08f00d0c30 con 0x7f08f00d14a0 2024-03-04T08:51:53.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.045+0000 7f08e5ffb640 1 -- 172.21.15.19:0/489244737 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7f08e007a870 con 0x7f08f00d14a0 2024-03-04T08:51:53.041 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 msgr2=0x7f08d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 0x7f08d406d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08f00cc030 tx=0x7f08ec008040 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 msgr2=0x7f08f014e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f08e00090b0 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 shutdown_connections 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08f015eb00 0x7f08f00cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08f00d14a0 0x7f08f014e290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08d406b4d0 0x7f08d406d990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 --2- 172.21.15.19:0/489244737 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08f00d10c0 0x7f08f014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 >> 172.21.15.19:0/489244737 conn(0x7f08f00b3800 msgr2=0x7f08f006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 shutdown_connections 2024-03-04T08:51:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.047+0000 7f08f77d0640 1 -- 172.21.15.19:0/489244737 wait complete. 2024-03-04T08:51:53.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:53.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.161+0000 7f6c59bd0640 1 Processor -- start 2024-03-04T08:51:53.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.161+0000 7f6c59bd0640 1 -- start start 2024-03-04T08:51:53.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c59bd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c540b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c59bd0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540af4b0 con 0x7f6c541614a0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c59bd0640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540af790 con 0x7f6c540b1850 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c59bd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406d800 con 0x7f6c5406d3c0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c537fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6c541614a0 0x7f6c540b0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60946/0 (socket says 172.21.15.19:60946) 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c537fe640 1 -- 172.21.15.19:0/3154184713 learned_addr learned my addr 172.21.15.19:0/3154184713 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c52ffd640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c540b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502547577 0 0) 0x7f6c540af4b0 con 0x7f6c541614a0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c3c003520 con 0x7f6c541614a0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 611548108 0 0) 0x7f6c3c003520 con 0x7f6c541614a0 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 msgr2=0x7f6c540b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c540b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 >> v1:172.21.15.204:6789/0 conn(0x7f6c540b1850 legacy=0x7f6c540b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540afa70 con 0x7f6c541614a0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f6c44001670 con 0x7f6c541614a0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 >> v1:172.21.15.19:6789/0 conn(0x7f6c541614a0 legacy=0x7f6c540b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3c0039e0 0x7f6c3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c004800 0x7f6c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c00ba70 con 0x7f6c3c0039e0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c00bc20 con 0x7f6c3c004800 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c00be20 con 0x7f6c5406d3c0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.162+0000 7f6c537fe640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3c0039e0 0x7f6c3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c52ffd640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c004800 0x7f6c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c53fff640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c537fe640 1 -- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 msgr2=0x7f6c3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c537fe640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406d3c0 0x7f6c3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c537fe640 1 -- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c004800 msgr2=0x7f6c3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c537fe640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c004800 0x7f6c3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.163+0000 7f6c537fe640 1 -- 172.21.15.19:0/3154184713 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c003520 con 0x7f6c3c0039e0 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c537fe640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3c0039e0 0x7f6c3c003e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001eb0 tx=0x7f6c3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbeb8130756b378 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44007d30 con 0x7f6c3c0039e0 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44030070 con 0x7f6c3c0039e0 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c527fc640 1 -- 172.21.15.19:0/3154184713 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44005d30 con 0x7f6c3c0039e0 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 -- 172.21.15.19:0/3154184713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3c0039e0 msgr2=0x7f6c3c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/3154184713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c3c0039e0 0x7f6c3c003e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001eb0 tx=0x7f6c3c005830 comp rx=0 tx=0).stop 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c53fff640 1 -- 172.21.15.19:0/3154184713 reap_dead start 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 -- 172.21.15.19:0/3154184713 shutdown_connections 2024-03-04T08:51:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 -- 172.21.15.19:0/3154184713 >> 172.21.15.19:0/3154184713 conn(0x7f6c5409a9f0 msgr2=0x7f6c5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 -- 172.21.15.19:0/3154184713 shutdown_connections 2024-03-04T08:51:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.164+0000 7f6c59bd0640 1 -- 172.21.15.19:0/3154184713 wait complete. 2024-03-04T08:51:53.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.165+0000 7f6c59bd0640 1 Processor -- start 2024-03-04T08:51:53.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 -- start start 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c0039e0 0x7f6c540cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406ef20 0x7f6c5406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b1c80 con 0x7f6c541571c0 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54161880 con 0x7f6c3c0039e0 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c59bd0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b1e00 con 0x7f6c5406ef20 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c52ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c52ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53546/0 (socket says 172.21.15.19:53546) 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.166+0000 7f6c52ffd640 1 -- 172.21.15.19:0/2232902298 learned_addr learned my addr 172.21.15.19:0/2232902298 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c53fff640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406ef20 0x7f6c5406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c537fe640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c0039e0 0x7f6c540cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 -- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406ef20 msgr2=0x7f6c5406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406ef20 0x7f6c5406f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 -- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c0039e0 msgr2=0x7f6c540cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c0039e0 0x7f6c540cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 -- 172.21.15.19:0/2232902298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540d1820 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c52ffd640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c48011a00 tx=0x7f6c48011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800faf0 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800fc90 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540d1b00 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48014440 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.167+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54154f70 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.168+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540b5b00 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.169+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c48012040 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.169+0000 7f6c3bfff640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 0x7f6c4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.169+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f6c4808a900 con 0x7f6c541571c0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.169+0000 7f6c537fe640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 0x7f6c4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.170+0000 7f6c537fe640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 0x7f6c4006d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6c44034000 tx=0x7f6c44009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.173+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6c540b5b00 con 0x7f6c541571c0 2024-03-04T08:51:53.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.372+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c5404f330 con 0x7f6c541571c0 2024-03-04T08:51:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.372+0000 7f6c3bfff640 1 -- 172.21.15.19:0/2232902298 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c48019030 con 0x7f6c541571c0 2024-03-04T08:51:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.375+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 msgr2=0x7f6c4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.375+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 0x7f6c4006d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6c44034000 tx=0x7f6c44009030 comp rx=0 tx=0).stop 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.375+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 msgr2=0x7f6c540d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.375+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c48011a00 tx=0x7f6c48011ec0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 shutdown_connections 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6c5406ef20 0x7f6c5406f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c541571c0 0x7f6c540d0f20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6c4006b4d0 0x7f6c4006d990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 --2- 172.21.15.19:0/2232902298 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6c3c0039e0 0x7f6c540cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 >> 172.21.15.19:0/2232902298 conn(0x7f6c5409a9f0 msgr2=0x7f6c540b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 shutdown_connections 2024-03-04T08:51:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.376+0000 7f6c59bd0640 1 -- 172.21.15.19:0/2232902298 wait complete. 2024-03-04T08:51:53.382 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:53.383 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:53.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.542+0000 7ff92bf3e640 1 Processor -- start 2024-03-04T08:51:53.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.543+0000 7ff92bf3e640 1 -- start start 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.543+0000 7ff92bf3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9240d04a0 0x7ff9240ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.543+0000 7ff92bf3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff924161980 con 0x7ff92415bb20 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.543+0000 7ff92bf3e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff924161c60 con 0x7ff9240cfff0 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.543+0000 7ff92bf3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240d2500 con 0x7ff9240d04a0 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9240d04a0 0x7ff9240ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9240d04a0 0x7ff9240ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53552/0 (socket says 172.21.15.19:53552) 2024-03-04T08:51:53.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 -- 172.21.15.19:0/621615317 learned_addr learned my addr 172.21.15.19:0/621615317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff929cda640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff92415bb20 0x7ff9240d1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60960/0 (socket says 172.21.15.19:60960) 2024-03-04T08:51:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 -- 172.21.15.19:0/621615317 >> v1:172.21.15.204:6789/0 conn(0x7ff9240cfff0 legacy=0x7ff9240cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 -- 172.21.15.19:0/621615317 >> v1:172.21.15.19:6789/0 conn(0x7ff92415bb20 legacy=0x7ff9240d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff928cd8640 1 -- 172.21.15.19:0/621615317 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383127806 0 0) 0x7ff924161980 con 0x7ff92415bb20 2024-03-04T08:51:53.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.544+0000 7ff92a4db640 1 -- 172.21.15.19:0/621615317 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924161f40 con 0x7ff9240d04a0 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92a4db640 1 --2- 172.21.15.19:0/621615317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9240d04a0 0x7ff9240ccfc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0036a9d808f21f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff928cd8640 1 -- 172.21.15.19:0/621615317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c02cbb0 con 0x7ff9240d04a0 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff928cd8640 1 -- 172.21.15.19:0/621615317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c02cd50 con 0x7ff9240d04a0 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff928cd8640 1 -- 172.21.15.19:0/621615317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c034610 con 0x7ff9240d04a0 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 -- 172.21.15.19:0/621615317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9240d04a0 msgr2=0x7ff9240ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/621615317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9240d04a0 0x7ff9240ccfc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c02c010 comp rx=0 tx=0).stop 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 -- 172.21.15.19:0/621615317 shutdown_connections 2024-03-04T08:51:53.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/621615317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9240d04a0 0x7ff9240ccfc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 -- 172.21.15.19:0/621615317 >> 172.21.15.19:0/621615317 conn(0x7ff92409a9f0 msgr2=0x7ff92409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.545+0000 7ff92bf3e640 1 -- 172.21.15.19:0/621615317 shutdown_connections 2024-03-04T08:51:53.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.546+0000 7ff92bf3e640 1 -- 172.21.15.19:0/621615317 wait complete. 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 Processor -- start 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 -- start start 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9240cfff0 0x7ff9241583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9240d04a0 0x7ff92415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240d08d0 con 0x7ff92415bb20 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff924162500 con 0x7ff9240d04a0 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92bf3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240d1980 con 0x7ff9240cfff0 2024-03-04T08:51:53.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.547+0000 7ff92a4db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53554/0 (socket says 172.21.15.19:53554) 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 -- 172.21.15.19:0/2373240240 learned_addr learned my addr 172.21.15.19:0/2373240240 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff9294d9640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9240d04a0 0x7ff92415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff929cda640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9240cfff0 0x7ff9241583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 -- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9240cfff0 msgr2=0x7ff9241583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9240cfff0 0x7ff9241583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 -- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9240d04a0 msgr2=0x7ff92415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9240d04a0 0x7ff92415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 -- 172.21.15.19:0/2373240240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924159b70 con 0x7ff92415bb20 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92a4db640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff91c036040 tx=0x7ff91c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c043030 con 0x7ff92415bb20 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c003990 con 0x7ff92415bb20 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9240c7f90 con 0x7ff92415bb20 2024-03-04T08:51:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c003b60 con 0x7ff92415bb20 2024-03-04T08:51:53.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.548+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924159090 con 0x7ff92415bb20 2024-03-04T08:51:53.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.549+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92404f330 con 0x7ff92415bb20 2024-03-04T08:51:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.550+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff91c02cbc0 con 0x7ff92415bb20 2024-03-04T08:51:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.550+0000 7ff9167fc640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 0x7ff90806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.550+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ff91c0ac7f0 con 0x7ff92415bb20 2024-03-04T08:51:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.550+0000 7ff929cda640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 0x7ff90806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.551+0000 7ff929cda640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 0x7ff90806d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff920000f60 tx=0x7ff920007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.554+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff91c04d020 con 0x7ff92415bb20 2024-03-04T08:51:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.777+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9240b0440 con 0x7ff92415bb20 2024-03-04T08:51:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.779+0000 7ff9167fc640 1 -- 172.21.15.19:0/2373240240 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7ff91c07b4e0 con 0x7ff92415bb20 2024-03-04T08:51:53.775 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:53.776 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:53.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 msgr2=0x7ff90806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 0x7ff90806d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff920000f60 tx=0x7ff920007d00 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 msgr2=0x7ff92415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff91c036040 tx=0x7ff91c004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 shutdown_connections 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92415bb20 0x7ff92415d490 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff90806b4d0 0x7ff90806d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff9240d04a0 0x7ff92415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 --2- 172.21.15.19:0/2373240240 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff9240cfff0 0x7ff9241583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 >> 172.21.15.19:0/2373240240 conn(0x7ff92409a9f0 msgr2=0x7ff9240b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 shutdown_connections 2024-03-04T08:51:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.781+0000 7ff92bf3e640 1 -- 172.21.15.19:0/2373240240 wait complete. 2024-03-04T08:51:53.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:53.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 Processor -- start 2024-03-04T08:51:53.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 -- start start 2024-03-04T08:51:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb29406e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb29406b6c0 0x7fb2940b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb294161bd0 con 0x7fb29415e0e0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb294070220 con 0x7fb29406b6c0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.899+0000 7fb299237640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb294161e90 con 0x7fb29415dd00 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb29259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb29415e0e0 0x7fb29406afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60966/0 (socket says 172.21.15.19:60966) 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb29259c640 1 -- 172.21.15.19:0/3110858463 learned_addr learned my addr 172.21.15.19:0/3110858463 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb29359e640 1 --2- 172.21.15.19:0/3110858463 >> v2:172.21.15.204:3300/0 conn(0x7fb29406b6c0 0x7fb2940b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb292d9d640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb29406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962015916 0 0) 0x7fb294161bd0 con 0x7fb29415e0e0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb27c003520 con 0x7fb29415e0e0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994605518 0 0) 0x7fb27c003520 con 0x7fb29415e0e0 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 msgr2=0x7fb29406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb29406e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 >> v2:172.21.15.204:3300/0 conn(0x7fb29406b6c0 msgr2=0x7fb2940b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 --2- 172.21.15.19:0/3110858463 >> v2:172.21.15.204:3300/0 conn(0x7fb29406b6c0 0x7fb2940b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294162170 con 0x7fb29415e0e0 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fb288001670 con 0x7fb29415e0e0 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 >> v1:172.21.15.19:6789/0 conn(0x7fb29415e0e0 legacy=0x7fb29406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb27c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb27c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb27c004d40 0x7fb27c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294070220 con 0x7fb27c003f30 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294161e90 con 0x7fb27c004d40 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c00b9c0 con 0x7fb29415dd00 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb29259c640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb27c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb292d9d640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb27c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.900+0000 7fb29359e640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb27c004d40 0x7fb27c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.901+0000 7fb29259c640 1 -- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 msgr2=0x7fb27c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.901+0000 7fb29259c640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb29415dd00 0x7fb27c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.901+0000 7fb29259c640 1 -- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb27c004d40 msgr2=0x7fb27c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:53.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.901+0000 7fb29259c640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb27c004d40 0x7fb27c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.901+0000 7fb29259c640 1 -- 172.21.15.19:0/3110858463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c003520 con 0x7fb27c003f30 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb29259c640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb27c004800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb28800c290 tx=0x7fb27c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5bd566e4c224d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288007d50 con 0x7fb27c003f30 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288030070 con 0x7fb27c003f30 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb291d9b640 1 -- 172.21.15.19:0/3110858463 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28802cdb0 con 0x7fb27c003f30 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 -- 172.21.15.19:0/3110858463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 msgr2=0x7fb27c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 --2- 172.21.15.19:0/3110858463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb27c004800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb28800c290 tx=0x7fb27c005830 comp rx=0 tx=0).stop 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb29359e640 1 -- 172.21.15.19:0/3110858463 reap_dead start 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 -- 172.21.15.19:0/3110858463 shutdown_connections 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 -- 172.21.15.19:0/3110858463 >> 172.21.15.19:0/3110858463 conn(0x7fb2940b2660 msgr2=0x7fb2940b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 -- 172.21.15.19:0/3110858463 shutdown_connections 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.902+0000 7fb299237640 1 -- 172.21.15.19:0/3110858463 wait complete. 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.904+0000 7fb299237640 1 Processor -- start 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.904+0000 7fb299237640 1 -- start start 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 0x7fb29415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 0x7fb294155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940b0180 con 0x7fb27c003f30 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940b0000 con 0x7fb2941550d0 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940b0300 con 0x7fb294152870 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53570/0 (socket says 172.21.15.19:53570) 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 -- 172.21.15.19:0/2086162015 learned_addr learned my addr 172.21.15.19:0/2086162015 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:53.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb29259c640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 0x7fb29415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb29359e640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 0x7fb294155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 -- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 msgr2=0x7fb29415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 0x7fb29415cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 -- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 msgr2=0x7fb294155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 0x7fb294155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 -- 172.21.15.19:0/2086162015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29415d2c0 con 0x7fb27c003f30 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb29359e640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 0x7fb294155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb29259c640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 0x7fb29415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb292d9d640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2840119d0 tx=0x7fb284011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400fb50 con 0x7fb27c003f30 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400fcf0 con 0x7fb27c003f30 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.905+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29415f520 con 0x7fb27c003f30 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.906+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400fea0 con 0x7fb27c003f30 2024-03-04T08:51:53.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.906+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294154400 con 0x7fb27c003f30 2024-03-04T08:51:53.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.906+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294073390 con 0x7fb27c003f30 2024-03-04T08:51:53.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.907+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb284012040 con 0x7fb27c003f30 2024-03-04T08:51:53.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.907+0000 7fb27b7fe640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 0x7fb28006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:53.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.908+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb28408a950 con 0x7fb27c003f30 2024-03-04T08:51:53.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.908+0000 7fb29259c640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 0x7fb28006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.908+0000 7fb29259c640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 0x7fb28006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb288034000 tx=0x7fb288007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:53.912+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb284019030 con 0x7fb27c003f30 2024-03-04T08:51:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.093+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2940d0480 con 0x7fb27c003f30 2024-03-04T08:51:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.093+0000 7fb27b7fe640 1 -- 172.21.15.19:0/2086162015 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb284059640 con 0x7fb27c003f30 2024-03-04T08:51:54.090 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 msgr2=0x7fb28006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 0x7fb28006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb288034000 tx=0x7fb288007000 comp rx=0 tx=0).stop 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 msgr2=0x7fb294159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb2840119d0 tx=0x7fb284011e90 comp rx=0 tx=0).stop 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 shutdown_connections 2024-03-04T08:51:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb28006b4d0 0x7fb28006d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2941550d0 0x7fb294155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb294152870 0x7fb29415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.095+0000 7fb299237640 1 --2- 172.21.15.19:0/2086162015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb27c003f30 0x7fb294159670 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.096+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 >> 172.21.15.19:0/2086162015 conn(0x7fb2940b2660 msgr2=0x7fb2940ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.096+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 shutdown_connections 2024-03-04T08:51:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.096+0000 7fb299237640 1 -- 172.21.15.19:0/2086162015 wait complete. 2024-03-04T08:51:54.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.210+0000 7f08bf3e2640 1 Processor -- start 2024-03-04T08:51:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.210+0000 7f08bf3e2640 1 -- start start 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bf3e2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08b80d06e0 0x7f08b815fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bf3e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 0x7f08b80cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bf3e2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80d47f0 con 0x7f08b80d0ac0 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bf3e2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80ced70 con 0x7f08b80d06e0 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bf3e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80d1ab0 con 0x7f08b80cf200 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08b80d06e0 0x7f08b815fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bc97d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f08b80d0ac0 0x7f08b80b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60976/0 (socket says 172.21.15.19:60976) 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bc97d640 1 -- 172.21.15.19:0/1998848903 learned_addr learned my addr 172.21.15.19:0/1998848903 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 --2- 172.21.15.19:0/1998848903 >> v2:172.21.15.19:3300/0 conn(0x7f08b80d06e0 0x7f08b815fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53582/0 (socket says 172.21.15.19:53582) 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd97f640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 0x7f08b80cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 -- 172.21.15.19:0/1998848903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 msgr2=0x7f08b80cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 0x7f08b80cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 -- 172.21.15.19:0/1998848903 >> v1:172.21.15.19:6789/0 conn(0x7f08b80d0ac0 legacy=0x7f08b80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd17e640 1 -- 172.21.15.19:0/1998848903 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80d1d90 con 0x7f08b80d06e0 2024-03-04T08:51:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08b7fff640 1 -- 172.21.15.19:0/1998848903 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953099707 0 0) 0x7f08b80d47f0 con 0x7f08b80d0ac0 2024-03-04T08:51:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.211+0000 7f08bd97f640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 0x7f08b80cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bd17e640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80d06e0 0x7f08b815fc30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009d90 tx=0x7f08b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c88e8dfeebfa853 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08b7fff640 1 -- 172.21.15.19:0/1998848903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0039070 con 0x7f08b80d06e0 2024-03-04T08:51:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08b7fff640 1 -- 172.21.15.19:0/1998848903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b002cc50 con 0x7f08b80d06e0 2024-03-04T08:51:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08b7fff640 1 -- 172.21.15.19:0/1998848903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0034440 con 0x7f08b80d06e0 2024-03-04T08:51:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 -- 172.21.15.19:0/1998848903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80d06e0 msgr2=0x7f08b815fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80d06e0 0x7f08b815fc30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009d90 tx=0x7f08b002bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 -- 172.21.15.19:0/1998848903 shutdown_connections 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80cf200 0x7f08b80cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/1998848903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80d06e0 0x7f08b815fc30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 -- 172.21.15.19:0/1998848903 >> 172.21.15.19:0/1998848903 conn(0x7f08b80d3cd0 msgr2=0x7f08b80d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.213+0000 7f08bf3e2640 1 -- 172.21.15.19:0/1998848903 shutdown_connections 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.214+0000 7f08bf3e2640 1 -- 172.21.15.19:0/1998848903 wait complete. 2024-03-04T08:51:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.215+0000 7f08bf3e2640 1 Processor -- start 2024-03-04T08:51:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.215+0000 7f08bf3e2640 1 -- start start 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 0x7f08b8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 0x7f08b8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80b44d0 con 0x7f08b80cf200 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80ce990 con 0x7f08b80d06e0 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.216+0000 7f08bf3e2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80d0f30 con 0x7f08b80d0ac0 2024-03-04T08:51:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53584/0 (socket says 172.21.15.19:53584) 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 -- 172.21.15.19:0/3944652135 learned_addr learned my addr 172.21.15.19:0/3944652135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bc97d640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 0x7f08b8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd97f640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 0x7f08b8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 -- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 msgr2=0x7f08b8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 0x7f08b8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 -- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 msgr2=0x7f08b8151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 0x7f08b8151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 -- 172.21.15.19:0/3944652135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80b2180 con 0x7f08b80cf200 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bc97d640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 0x7f08b8151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd97f640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 0x7f08b8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bd17e640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f08b0037040 tx=0x7f08b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0039050 con 0x7f08b80cf200 2024-03-04T08:51:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b0045070 con 0x7f08b80cf200 2024-03-04T08:51:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b003e610 con 0x7f08b80cf200 2024-03-04T08:51:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b80b2460 con 0x7f08b80cf200 2024-03-04T08:51:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.217+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b80b2a20 con 0x7f08b80cf200 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.219+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80a1c80 con 0x7f08b80cf200 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.219+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08b003e7b0 con 0x7f08b80cf200 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.219+0000 7f08b5ffb640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 0x7f08a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.219+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f08b00acff0 con 0x7f08b80cf200 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.220+0000 7f08bc97d640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 0x7f08a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.220+0000 7f08bc97d640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 0x7f08a406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08b80c7fc0 tx=0x7f08ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.224+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f08b007be10 con 0x7f08b80cf200 2024-03-04T08:51:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.403+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08b8068ff0 con 0x7f08b80cf200 2024-03-04T08:51:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.403+0000 7f08b5ffb640 1 -- 172.21.15.19:0/3944652135 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08b007b710 con 0x7f08b80cf200 2024-03-04T08:51:54.400 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 msgr2=0x7f08a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 0x7f08a406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08b80c7fc0 tx=0x7f08ac009040 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 msgr2=0x7f08b80b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f08b0037040 tx=0x7f08b0004a40 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 shutdown_connections 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f08b80d0ac0 0x7f08b8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f08a406b4d0 0x7f08a406d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f08b80d06e0 0x7f08b8151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 --2- 172.21.15.19:0/3944652135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08b80cf200 0x7f08b80b1a80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 >> 172.21.15.19:0/3944652135 conn(0x7f08b80d3cd0 msgr2=0x7f08b80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 shutdown_connections 2024-03-04T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.405+0000 7f08bf3e2640 1 -- 172.21.15.19:0/3944652135 wait complete. 2024-03-04T08:51:54.412 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:54.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.521+0000 7fafb4e39640 1 Processor -- start 2024-03-04T08:51:54.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.521+0000 7fafb4e39640 1 -- start start 2024-03-04T08:51:54.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafb4e39640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb0066d90 0x7fafb00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafb4e39640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fafb00b5410 0x7fafb00ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafb4e39640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006b710 con 0x7fafb00cf9a0 2024-03-04T08:51:54.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafb4e39640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00b5880 con 0x7fafb0066d90 2024-03-04T08:51:54.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafb4e39640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00b61c0 con 0x7fafb00b5410 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb0066d90 0x7fafb00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb0066d90 0x7fafb00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53588/0 (socket says 172.21.15.19:53588) 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 -- 172.21.15.19:0/1887146893 learned_addr learned my addr 172.21.15.19:0/1887146893 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafae59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fafb00cf9a0 0x7fafb00b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60990/0 (socket says 172.21.15.19:60990) 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafaed9d640 1 --2- 172.21.15.19:0/1887146893 >> v2:172.21.15.204:3300/0 conn(0x7fafb00b5410 0x7fafb00ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 -- 172.21.15.19:0/1887146893 >> v2:172.21.15.204:3300/0 conn(0x7fafb00b5410 msgr2=0x7fafb00ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 --2- 172.21.15.19:0/1887146893 >> v2:172.21.15.204:3300/0 conn(0x7fafb00b5410 0x7fafb00ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 -- 172.21.15.19:0/1887146893 >> v1:172.21.15.19:6789/0 conn(0x7fafb00cf9a0 legacy=0x7fafb00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafadd9b640 1 -- 172.21.15.19:0/1887146893 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb006b150 con 0x7fafb0066d90 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.522+0000 7fafad59a640 1 -- 172.21.15.19:0/1887146893 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362372667 0 0) 0x7fafb006b710 con 0x7fafb00cf9a0 2024-03-04T08:51:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.523+0000 7fafadd9b640 1 --2- 172.21.15.19:0/1887146893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00b4ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b3120 tx=0x7fafa002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511fa205230ebe41 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.523+0000 7fafad59a640 1 -- 172.21.15.19:0/1887146893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0034070 con 0x7fafb0066d90 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.523+0000 7fafad59a640 1 -- 172.21.15.19:0/1887146893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0030860 con 0x7fafb0066d90 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.523+0000 7fafad59a640 1 -- 172.21.15.19:0/1887146893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0030c30 con 0x7fafb0066d90 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 -- 172.21.15.19:0/1887146893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 msgr2=0x7fafb00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1887146893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00b4ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b3120 tx=0x7fafa002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 -- 172.21.15.19:0/1887146893 shutdown_connections 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1887146893 >> v2:172.21.15.204:3300/0 conn(0x7fafb00b5410 0x7fafb00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1887146893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00b4ed0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 -- 172.21.15.19:0/1887146893 >> 172.21.15.19:0/1887146893 conn(0x7fafb00b1d70 msgr2=0x7fafb00b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 -- 172.21.15.19:0/1887146893 shutdown_connections 2024-03-04T08:51:54.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.524+0000 7fafb4e39640 1 -- 172.21.15.19:0/1887146893 wait complete. 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.525+0000 7fafb4e39640 1 Processor -- start 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.525+0000 7fafb4e39640 1 -- start start 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafb00b5410 0x7fafb0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafb00cf9a0 0x7fafb00cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b0c50 con 0x7fafb0066d90 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b0970 con 0x7fafb00b5410 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafb4e39640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cfd80 con 0x7fafb00cf9a0 2024-03-04T08:51:54.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53592/0 (socket says 172.21.15.19:53592) 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 -- 172.21.15.19:0/1820647225 learned_addr learned my addr 172.21.15.19:0/1820647225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafadd9b640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafb00b5410 0x7fafb0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafaed9d640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafb00cf9a0 0x7fafb00cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 -- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafb00cf9a0 msgr2=0x7fafb00cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafb00cf9a0 0x7fafb00cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 -- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafb00b5410 msgr2=0x7fafb0156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafb00b5410 0x7fafb0156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.526+0000 7fafae59c640 1 -- 172.21.15.19:0/1820647225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00cbdc0 con 0x7fafb0066d90 2024-03-04T08:51:54.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7fafae59c640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c7f0 tx=0x7fafa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4018070 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400a640 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00cc640 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400aa30 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.527+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb00c84b0 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.528+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0156b80 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.528+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fafa401b070 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.529+0000 7faf9effd640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 0x7faf9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.529+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fafa40898c0 con 0x7fafb0066d90 2024-03-04T08:51:54.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.529+0000 7fafadd9b640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 0x7faf9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.529+0000 7fafadd9b640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 0x7faf9006d9c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fafa0036000 tx=0x7fafa003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.533+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fafb0156b80 con 0x7fafb0066d90 2024-03-04T08:51:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.712+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafb009e3d0 con 0x7fafb0066d90 2024-03-04T08:51:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.712+0000 7faf9effd640 1 -- 172.21.15.19:0/1820647225 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafa4058640 con 0x7fafb0066d90 2024-03-04T08:51:54.709 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 msgr2=0x7faf9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 0x7faf9006d9c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fafa0036000 tx=0x7fafa003b040 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 msgr2=0x7fafb00cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c7f0 tx=0x7fafa400ccb0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 shutdown_connections 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fafb00cf9a0 0x7fafb00cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf9006b500 0x7faf9006d9c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fafb00b5410 0x7fafb0156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 --2- 172.21.15.19:0/1820647225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb0066d90 0x7fafb00cbfd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 >> 172.21.15.19:0/1820647225 conn(0x7fafb00b1d70 msgr2=0x7fafb006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 shutdown_connections 2024-03-04T08:51:54.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.714+0000 7fafb4e39640 1 -- 172.21.15.19:0/1820647225 wait complete. 2024-03-04T08:51:54.724 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:51:54.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.832+0000 7fc3ebc88640 1 Processor -- start 2024-03-04T08:51:54.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.832+0000 7fc3ebc88640 1 -- start start 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ebc88640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3e41614d0 0x7fc3e40d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ebc88640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 0x7fc3e40b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ebc88640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e41618b0 con 0x7fc3e40d1910 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ebc88640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40cf400 con 0x7fc3e41614d0 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ebc88640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40cf6a0 con 0x7fc3e40d24b0 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3e41614d0 0x7fc3e40d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3e41614d0 0x7fc3e40d4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53598/0 (socket says 172.21.15.19:53598) 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9223640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc3e40d1910 0x7fc3e40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32768/0 (socket says 172.21.15.19:32768) 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9223640 1 -- 172.21.15.19:0/1054721368 learned_addr learned my addr 172.21.15.19:0/1054721368 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:54.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ea225640 1 --2- 172.21.15.19:0/1054721368 >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 0x7fc3e40b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 -- 172.21.15.19:0/1054721368 >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 msgr2=0x7fc3e40b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 --2- 172.21.15.19:0/1054721368 >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 0x7fc3e40b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 -- 172.21.15.19:0/1054721368 >> v1:172.21.15.19:6789/0 conn(0x7fc3e40d1910 legacy=0x7fc3e40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e8a22640 1 -- 172.21.15.19:0/1054721368 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294614624 0 0) 0x7fc3e41618b0 con 0x7fc3e40d1910 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3e9a24640 1 -- 172.21.15.19:0/1054721368 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e40cf980 con 0x7fc3e41614d0 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.834+0000 7fc3ea225640 1 --2- 172.21.15.19:0/1054721368 >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 0x7fc3e40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:54.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.835+0000 7fc3e9a24640 1 --2- 172.21.15.19:0/1054721368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e41614d0 0x7fc3e40d4860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b2a70 tx=0x7fc3e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d770bbeef81895 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.835+0000 7fc3e8a22640 1 -- 172.21.15.19:0/1054721368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0035020 con 0x7fc3e41614d0 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.835+0000 7fc3e8a22640 1 -- 172.21.15.19:0/1054721368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0031830 con 0x7fc3e41614d0 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.835+0000 7fc3e8a22640 1 -- 172.21.15.19:0/1054721368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0031c00 con 0x7fc3e41614d0 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 -- 172.21.15.19:0/1054721368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e41614d0 msgr2=0x7fc3e40d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/1054721368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e41614d0 0x7fc3e40d4860 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b2a70 tx=0x7fc3e002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 -- 172.21.15.19:0/1054721368 shutdown_connections 2024-03-04T08:51:54.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/1054721368 >> v2:172.21.15.204:3300/0 conn(0x7fc3e40d24b0 0x7fc3e40b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/1054721368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e41614d0 0x7fc3e40d4860 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 -- 172.21.15.19:0/1054721368 >> 172.21.15.19:0/1054721368 conn(0x7fc3e40d3d40 msgr2=0x7fc3e40d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 -- 172.21.15.19:0/1054721368 shutdown_connections 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.836+0000 7fc3ebc88640 1 -- 172.21.15.19:0/1054721368 wait complete. 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.837+0000 7fc3ebc88640 1 Processor -- start 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.837+0000 7fc3ebc88640 1 -- start start 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3e40d1910 0x7fc3e41f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3e41614d0 0x7fc3e406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b1370 con 0x7fc3e40d24b0 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b0910 con 0x7fc3e40d1910 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b14f0 con 0x7fc3e41614d0 2024-03-04T08:51:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53600/0 (socket says 172.21.15.19:53600) 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 -- 172.21.15.19:0/569316279 learned_addr learned my addr 172.21.15.19:0/569316279 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9a24640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3e40d1910 0x7fc3e41f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ea225640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3e41614d0 0x7fc3e406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 -- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3e41614d0 msgr2=0x7fc3e406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3e41614d0 0x7fc3e406cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 -- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3e40d1910 msgr2=0x7fc3e41f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3e40d1910 0x7fc3e41f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 -- 172.21.15.19:0/569316279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e41f76b0 con 0x7fc3e40d24b0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3e9223640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c500 tx=0x7fc3d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4018070 con 0x7fc3e40d24b0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4007580 con 0x7fc3e40d24b0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4004a20 con 0x7fc3e40d24b0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40cd420 con 0x7fc3e40d24b0 2024-03-04T08:51:54.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.838+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e41f7970 con 0x7fc3e40d24b0 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.840+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e40b7b10 con 0x7fc3e40d24b0 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.840+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3d401b070 con 0x7fc3e40d24b0 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.841+0000 7fc3da7fc640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 0x7fc3c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.841+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc3d4089680 con 0x7fc3e40d24b0 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.841+0000 7fc3e9a24640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 0x7fc3c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.842+0000 7fc3e9a24640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 0x7fc3c806d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0036000 tx=0x7fc3e003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:54.845+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc3d4058360 con 0x7fc3e40d24b0 2024-03-04T08:51:55.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.025+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fc3e4068ff0 con 0x7fc3e40d24b0 2024-03-04T08:51:55.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.025+0000 7fc3da7fc640 1 -- 172.21.15.19:0/569316279 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7fc3d4057c60 con 0x7fc3e40d24b0 2024-03-04T08:51:55.022 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 msgr2=0x7fc3c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 0x7fc3c806d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0036000 tx=0x7fc3e003c040 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 msgr2=0x7fc3e40ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c500 tx=0x7fc3d400c9c0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 shutdown_connections 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3e41614d0 0x7fc3e406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3e40d24b0 0x7fc3e40ccbd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3c806b4d0 0x7fc3c806d990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 --2- 172.21.15.19:0/569316279 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3e40d1910 0x7fc3e41f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 >> 172.21.15.19:0/569316279 conn(0x7fc3e40d3d40 msgr2=0x7fc3e40b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 shutdown_connections 2024-03-04T08:51:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.027+0000 7fc3ebc88640 1 -- 172.21.15.19:0/569316279 wait complete. 2024-03-04T08:51:55.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.141+0000 7fbb9ea17640 1 Processor -- start 2024-03-04T08:51:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.141+0000 7fbb9ea17640 1 -- start start 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb9ea17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb9806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb9ea17640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9806d030 con 0x7fbb9815b380 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb9ea17640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9806d310 con 0x7fbb9806cb90 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb9ea17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9806d5f0 con 0x7fbb98158880 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb977fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbb9815b380 0x7fbb980708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32772/0 (socket says 172.21.15.19:32772) 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb977fe640 1 -- 172.21.15.19:0/542525280 learned_addr learned my addr 172.21.15.19:0/542525280 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb97fff640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb9806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303808665 0 0) 0x7fbb9806d030 con 0x7fbb9815b380 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003520 con 0x7fbb9815b380 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548672102 0 0) 0x7fbb84003520 con 0x7fbb9815b380 2024-03-04T08:51:55.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 msgr2=0x7fbb9806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb9806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 >> v1:172.21.15.204:6789/0 conn(0x7fbb9806cb90 legacy=0x7fbb980cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9806d8d0 con 0x7fbb9815b380 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.142+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fbb88001670 con 0x7fbb9815b380 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 >> v1:172.21.15.19:6789/0 conn(0x7fbb9815b380 legacy=0x7fbb980708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb84004d40 0x7fbb840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9806d5f0 con 0x7fbb840039e0 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8400b9c0 con 0x7fbb84004d40 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8400bbc0 con 0x7fbb98158880 2024-03-04T08:51:55.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb977fe640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb9cfb4640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb84004d40 0x7fbb840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 -- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 msgr2=0x7fbb84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb98158880 0x7fbb84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 -- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb84004d40 msgr2=0x7fbb840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb84004d40 0x7fbb840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb97fff640 1 -- 172.21.15.19:0/542525280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84003520 con 0x7fbb840039e0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.143+0000 7fbb9cfb4640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb84004d40 0x7fbb840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb97fff640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb84003dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009aa0 tx=0x7fbb84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215d0d32c2a74d9e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80039070 con 0x7fbb840039e0 2024-03-04T08:51:55.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8002c600 con 0x7fbb840039e0 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb96ffd640 1 -- 172.21.15.19:0/542525280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80009670 con 0x7fbb840039e0 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 -- 172.21.15.19:0/542525280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 msgr2=0x7fbb84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/542525280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb84003dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009aa0 tx=0x7fbb84005830 comp rx=0 tx=0).stop 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9cfb4640 1 -- 172.21.15.19:0/542525280 reap_dead start 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 -- 172.21.15.19:0/542525280 shutdown_connections 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 -- 172.21.15.19:0/542525280 >> 172.21.15.19:0/542525280 conn(0x7fbb980b1c80 msgr2=0x7fbb980cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 -- 172.21.15.19:0/542525280 shutdown_connections 2024-03-04T08:51:55.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.144+0000 7fbb9ea17640 1 -- 172.21.15.19:0/542525280 wait complete. 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.145+0000 7fbb9ea17640 1 Processor -- start 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 -- start start 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 0x7fbb980c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb980ae6f0 0x7fbb980c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98071160 con 0x7fbb840039e0 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98070fe0 con 0x7fbb980ae270 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.146+0000 7fbb9ea17640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9806c650 con 0x7fbb980ae6f0 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53614/0 (socket says 172.21.15.19:53614) 2024-03-04T08:51:55.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 -- 172.21.15.19:0/890939655 learned_addr learned my addr 172.21.15.19:0/890939655 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb977fe640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 0x7fbb980c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb9cfb4640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb980ae6f0 0x7fbb980c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 -- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb980ae6f0 msgr2=0x7fbb980c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb980ae6f0 0x7fbb980c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 -- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 msgr2=0x7fbb980c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 0x7fbb980c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 -- 172.21.15.19:0/890939655 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980aec50 con 0x7fbb840039e0 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb977fe640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 0x7fbb980c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb97fff640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009b00 tx=0x7fbb80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80043020 con 0x7fbb840039e0 2024-03-04T08:51:55.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8003f730 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980aef30 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80039040 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.147+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb980b2d20 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.148+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb980681a0 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.149+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb80046020 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.149+0000 7fbb94ff9640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 0x7fbb7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.150+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbb800ac220 con 0x7fbb840039e0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.150+0000 7fbb977fe640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 0x7fbb7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.150+0000 7fbb977fe640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 0x7fbb7806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb9815e430 tx=0x7fbb88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.154+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb980681a0 con 0x7fbb840039e0 2024-03-04T08:51:55.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.345+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb9815de10 con 0x7fbb840039e0 2024-03-04T08:51:55.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.345+0000 7fbb94ff9640 1 -- 172.21.15.19:0/890939655 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb9815de10 con 0x7fbb840039e0 2024-03-04T08:51:55.342 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 msgr2=0x7fbb7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 0x7fbb7806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb9815e430 tx=0x7fbb88009040 comp rx=0 tx=0).stop 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 msgr2=0x7fbb98157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009b00 tx=0x7fbb80004730 comp rx=0 tx=0).stop 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 shutdown_connections 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb980ae6f0 0x7fbb980c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb7806b4d0 0x7fbb7806d990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb980ae270 0x7fbb980c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 --2- 172.21.15.19:0/890939655 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb840039e0 0x7fbb98157660 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 >> 172.21.15.19:0/890939655 conn(0x7fbb980b1c80 msgr2=0x7fbb9815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:55.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 shutdown_connections 2024-03-04T08:51:55.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.347+0000 7fbb9ea17640 1 -- 172.21.15.19:0/890939655 wait complete. 2024-03-04T08:51:55.358 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:51:55.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:55.358 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:55.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[52092]: fuse finished with error 0 and tester_r 0 2024-03-04T08:51:55.385 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:51:55.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:51:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:55.437 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:51:55.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:51:55.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.596+0000 7f9cd6f1e640 1 Processor -- start 2024-03-04T08:51:55.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.596+0000 7f9cd6f1e640 1 -- start start 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd6f1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 0x7f9cd00d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd6f1e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9cd00b41f0 0x7f9cd00b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd6f1e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00b3430 con 0x7f9cd015dfe0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd6f1e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd00d2c50 con 0x7f9cd00b41f0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd6f1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00b31e0 con 0x7f9cd00d22b0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd4cba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9cd015dfe0 0x7f9cd00cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32778/0 (socket says 172.21.15.19:32778) 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd4cba640 1 -- 172.21.15.19:0/3056897485 learned_addr learned my addr 172.21.15.19:0/3056897485 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9cd54bb640 1 --2- 172.21.15.19:0/3056897485 >> v2:172.21.15.204:3300/0 conn(0x7f9cd00b41f0 0x7f9cd00b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9ccffff640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 0x7f9cd00d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9ccf7fe640 1 -- 172.21.15.19:0/3056897485 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530916496 0 0) 0x7f9cd00b3430 con 0x7f9cd015dfe0 2024-03-04T08:51:55.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.597+0000 7f9ccf7fe640 1 -- 172.21.15.19:0/3056897485 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cbc003520 con 0x7f9cd015dfe0 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9cd54bb640 1 -- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 msgr2=0x7f9cd00d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9cd54bb640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 0x7f9cd00d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9cd54bb640 1 -- 172.21.15.19:0/3056897485 >> v1:172.21.15.19:6789/0 conn(0x7f9cd015dfe0 legacy=0x7f9cd00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9cd54bb640 1 -- 172.21.15.19:0/3056897485 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00b3710 con 0x7f9cd00b41f0 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9ccffff640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 0x7f9cd00d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.598+0000 7f9cd54bb640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd00b4650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009d90 tx=0x7f9cc802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be32964e5d8c6e7a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9ccf7fe640 1 -- 172.21.15.19:0/3056897485 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8039070 con 0x7f9cd00b41f0 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9ccf7fe640 1 -- 172.21.15.19:0/3056897485 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc802cc50 con 0x7f9cd00b41f0 2024-03-04T08:51:55.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9ccf7fe640 1 -- 172.21.15.19:0/3056897485 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8034440 con 0x7f9cd00b41f0 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 msgr2=0x7f9cd00b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd00b4650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009d90 tx=0x7f9cc802bea0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3056897485 shutdown_connections 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd00b4650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3056897485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd00d22b0 0x7f9cd00d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3056897485 >> 172.21.15.19:0/3056897485 conn(0x7f9cd00d3cd0 msgr2=0x7f9cd00d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3056897485 shutdown_connections 2024-03-04T08:51:55.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.599+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3056897485 wait complete. 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.600+0000 7f9cd6f1e640 1 Processor -- start 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.600+0000 7f9cd6f1e640 1 -- start start 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd01f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 0x7f9cd00b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00cfa00 con 0x7f9cd00d22b0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00b3d60 con 0x7f9cd00b41f0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9cd6f1e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00d1c70 con 0x7f9cd015dfe0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53618/0 (socket says 172.21.15.19:53618) 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.601+0000 7f9ccffff640 1 -- 172.21.15.19:0/3873621954 learned_addr learned my addr 172.21.15.19:0/3873621954 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd4cba640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd01f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd54bb640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 0x7f9cd00b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 -- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 msgr2=0x7f9cd00b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 0x7f9cd00b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 -- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 msgr2=0x7f9cd01f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd01f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 -- 172.21.15.19:0/3873621954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00cdbe0 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd4cba640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd54bb640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 0x7f9cd00b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccffff640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ec10 tx=0x7f9cc000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0017070 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000cc30 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd01f6e70 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0013470 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.602+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd01f7430 con 0x7f9cd00d22b0 2024-03-04T08:51:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.603+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd004f330 con 0x7f9cd00d22b0 2024-03-04T08:51:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.604+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9cc001a070 con 0x7f9cd00d22b0 2024-03-04T08:51:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.604+0000 7f9ccd7fa640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 0x7f9cb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.604+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f9cc008a290 con 0x7f9cd00d22b0 2024-03-04T08:51:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.604+0000 7f9cd4cba640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 0x7f9cb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.605+0000 7f9cd4cba640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 0x7f9cb006d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8007fd0 tx=0x7f9cb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:55.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.608+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9cc0059010 con 0x7f9cd00d22b0 2024-03-04T08:51:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.912+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9cd00b69a0 con 0x7f9cd00d22b0 2024-03-04T08:51:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.913+0000 7f9ccd7fa640 1 -- 172.21.15.19:0/3873621954 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+82 (secure 0 0 0) 0x7f9cc0058910 con 0x7f9cd00d22b0 2024-03-04T08:51:55.909 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-03-04T08:51:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 msgr2=0x7f9cb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 0x7f9cb006d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8007fd0 tx=0x7f9cb8009040 comp rx=0 tx=0).stop 2024-03-04T08:51:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 msgr2=0x7f9cd0152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ec10 tx=0x7f9cc000c520 comp rx=0 tx=0).stop 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 shutdown_connections 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9cd015dfe0 0x7f9cd00b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cd00d22b0 0x7f9cd0152020 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9cb006b4d0 0x7f9cb006d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 --2- 172.21.15.19:0/3873621954 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9cd00b41f0 0x7f9cd01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 >> 172.21.15.19:0/3873621954 conn(0x7f9cd00d3cd0 msgr2=0x7f9cd00d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 shutdown_connections 2024-03-04T08:51:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:55.915+0000 7f9cd6f1e640 1 -- 172.21.15.19:0/3873621954 wait complete. 2024-03-04T08:51:55.922 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:51:55.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:51:55.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:55.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:55.924 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.940 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:51:55.941 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42578sec preferred_lft 42578sec 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:51:55.942 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:51:55.943 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:51:55.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:55.944 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:51:56.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.007 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:51:56.062 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:51:56.062 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:51:56.062 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:51:56.062 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:51:56.062 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:51:56.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:51:56.063 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:51:56.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.158 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:51:56.173 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:51:56.173 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:51:56.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:56.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:51:56.240 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:51:56.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:56.241 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:56.296 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:51:56.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:51:56.296 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:56.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:51:56.418 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:51:56.473 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:56.474 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:56.475 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:56.476 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:56.476 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:56.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.476 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:51:56.528 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:51:56.528 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:51:56.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:51:56.597 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:51:56.653 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:51:56.654 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:51:56.655 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:51:56.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.656 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:51:56.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:51:56.659+0000 7f5ecea10480 -1 init, newargv = 0x561030e06550 newargc=15 2024-03-04T08:51:56.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[53327]: starting ceph client 2024-03-04T08:51:56.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[53327]: starting fuse 2024-03-04T08:51:56.672 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:51:56.672 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:51:56.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:56.673 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:51:56.674 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:51:56.792 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.53327.asok 2024-03-04T08:51:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:51:56.803 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53327.asok 2024-03-04T08:51:56.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53327.asok status 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "53327", 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:51:56.941 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5610, 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 5610 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3009211637 2024-03-04T08:51:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3009211637 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.5610 192.168.0.1:0/3009211637", 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/3009211637", 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 14, 2024-03-04T08:51:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 37, 2024-03-04T08:51:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:51:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:51:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:51:56.944 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:51:56.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.950 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:51:56.950 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:56.965 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:51:56.965 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:56.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:56.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:51:57.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:57.032 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-03-04T08:51:57.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:51:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:setfattr: layoutfile: Permission denied 2024-03-04T08:51:57.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:51:57.108 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-03-04T08:51:57.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:51:57.165 INFO:teuthology.orchestra.run.smithi019.stderr:setfattr: layoutdir: Permission denied 2024-03-04T08:51:57.165 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:57.165 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:57.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:57.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.365+0000 7fbffc839640 1 Processor -- start 2024-03-04T08:51:57.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.365+0000 7fbffc839640 1 -- start start 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.366+0000 7fbffc839640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 0x7fbff80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.366+0000 7fbffc839640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.366+0000 7fbffc839640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff80b3430 con 0x7fbff815dfe0 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.366+0000 7fbffc839640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff80d2c50 con 0x7fbff80b41f0 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.366+0000 7fbffc839640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b31e0 con 0x7fbff80d22b0 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff5d9b640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 0x7fbff80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff6d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff6d9d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:60904/0 (socket says 172.21.15.19:60904) 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff6d9d640 1 -- 172.21.15.19:0/3198038654 learned_addr learned my addr 172.21.15.19:0/3198038654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:57.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff659c640 1 --1- 172.21.15.19:0/3198038654 >> v1:172.21.15.204:6789/0 conn(0x7fbff815dfe0 0x7fbff80cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51720/0 (socket says 172.21.15.19:51720) 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff5d9b640 1 -- 172.21.15.19:0/3198038654 >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 msgr2=0x7fbff80b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff5d9b640 1 --2- 172.21.15.19:0/3198038654 >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff5d9b640 1 -- 172.21.15.19:0/3198038654 >> v1:172.21.15.204:6789/0 conn(0x7fbff815dfe0 legacy=0x7fbff80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff559a640 1 -- 172.21.15.19:0/3198038654 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227571551 0 0) 0x7fbff80b3430 con 0x7fbff815dfe0 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff5d9b640 1 -- 172.21.15.19:0/3198038654 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80b3710 con 0x7fbff80d22b0 2024-03-04T08:51:57.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.367+0000 7fbff6d9d640 1 --2- 172.21.15.19:0/3198038654 >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.368+0000 7fbff5d9b640 1 --2- 172.21.15.19:0/3198038654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 0x7fbff80d2710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=502d6b306afc265c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.368+0000 7fbff559a640 1 -- 172.21.15.19:0/3198038654 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0035020 con 0x7fbff80d22b0 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.368+0000 7fbff559a640 1 -- 172.21.15.19:0/3198038654 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0031830 con 0x7fbff80d22b0 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.368+0000 7fbff559a640 1 -- 172.21.15.19:0/3198038654 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0031c00 con 0x7fbff80d22b0 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 -- 172.21.15.19:0/3198038654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 msgr2=0x7fbff80d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 --2- 172.21.15.19:0/3198038654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 0x7fbff80d2710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 -- 172.21.15.19:0/3198038654 shutdown_connections 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 --2- 172.21.15.19:0/3198038654 >> v2:172.21.15.204:3300/0 conn(0x7fbff80b41f0 0x7fbff80b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 --2- 172.21.15.19:0/3198038654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80d22b0 0x7fbff80d2710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 -- 172.21.15.19:0/3198038654 >> 172.21.15.19:0/3198038654 conn(0x7fbff80d3cd0 msgr2=0x7fbff80d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 -- 172.21.15.19:0/3198038654 shutdown_connections 2024-03-04T08:51:57.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.369+0000 7fbffc839640 1 -- 172.21.15.19:0/3198038654 wait complete. 2024-03-04T08:51:57.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.371+0000 7fbffc839640 1 Processor -- start 2024-03-04T08:51:57.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.371+0000 7fbffc839640 1 -- start start 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80b41f0 0x7fbff80b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff815dfe0 0x7fbff80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80cfa00 con 0x7fbff80d22b0 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b3d60 con 0x7fbff815dfe0 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbffc839640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80d1c70 con 0x7fbff80b41f0 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbff5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbff5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53620/0 (socket says 172.21.15.19:53620) 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbff5d9b640 1 -- 172.21.15.19:0/935669910 learned_addr learned my addr 172.21.15.19:0/935669910 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbff659c640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80b41f0 0x7fbff80b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.372+0000 7fbff6d9d640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff815dfe0 0x7fbff80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 -- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80b41f0 msgr2=0x7fbff80b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80b41f0 0x7fbff80b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 -- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff815dfe0 msgr2=0x7fbff80b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff815dfe0 0x7fbff80b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 -- 172.21.15.19:0/935669910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80cd940 con 0x7fbff80d22b0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbff5d9b640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0035070 con 0x7fbff80d22b0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0004230 con 0x7fbff80d22b0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80cc8a0 con 0x7fbff80d22b0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe003a630 con 0x7fbff80d22b0 2024-03-04T08:51:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.373+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80cce60 con 0x7fbff80d22b0 2024-03-04T08:51:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.374+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff804f330 con 0x7fbff80d22b0 2024-03-04T08:51:57.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.374+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbfe0038020 con 0x7fbff80d22b0 2024-03-04T08:51:57.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.375+0000 7fbfeeffd640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 0x7fbfd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.375+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbfe00abe80 con 0x7fbff80d22b0 2024-03-04T08:51:57.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.375+0000 7fbff659c640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 0x7fbfd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.376+0000 7fbff659c640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 0x7fbfd806d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000f60 tx=0x7fbff0007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.379+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbfe0040070 con 0x7fbff80d22b0 2024-03-04T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.564+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbff815d2e0 con 0x7fbff80d22b0 2024-03-04T08:51:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.565+0000 7fbfeeffd640 1 -- 172.21.15.19:0/935669910 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fbfe007a520 con 0x7fbff80d22b0 2024-03-04T08:51:57.562 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:57.562 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 msgr2=0x7fbfd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 0x7fbfd806d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000f60 tx=0x7fbff0007d50 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 msgr2=0x7fbff80b84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe00046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 shutdown_connections 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbfd806b4d0 0x7fbfd806d990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbff815dfe0 0x7fbff80b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbff80d22b0 0x7fbff80b84a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 --2- 172.21.15.19:0/935669910 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbff80b41f0 0x7fbff80b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 >> 172.21.15.19:0/935669910 conn(0x7fbff80d3cd0 msgr2=0x7fbff80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 shutdown_connections 2024-03-04T08:51:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.567+0000 7fbffc839640 1 -- 172.21.15.19:0/935669910 wait complete. 2024-03-04T08:51:57.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:57.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:57.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.684+0000 7effd96f4640 1 Processor -- start 2024-03-04T08:51:57.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.684+0000 7effd96f4640 1 -- start start 2024-03-04T08:51:57.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd96f4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd40d4860 0x7effd40d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd96f4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40b0e30 0x7effd40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd96f4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd41618b0 con 0x7effd41614d0 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd96f4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd40d4cf0 con 0x7effd40d4860 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd96f4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cf400 con 0x7effd40b0e30 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd40d4860 0x7effd40d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd40d4860 0x7effd40d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54916/0 (socket says 172.21.15.19:54916) 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.685+0000 7effd27fc640 1 -- 172.21.15.19:0/3774207107 learned_addr learned my addr 172.21.15.19:0/3774207107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.686+0000 7effd37fe640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40b0e30 0x7effd40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.686+0000 7effd27fc640 1 -- 172.21.15.19:0/3774207107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40b0e30 msgr2=0x7effd40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.686+0000 7effd27fc640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40b0e30 0x7effd40b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.686+0000 7effd27fc640 1 -- 172.21.15.19:0/3774207107 >> v1:172.21.15.204:6789/0 conn(0x7effd41614d0 legacy=0x7effd40d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.686+0000 7effd27fc640 1 -- 172.21.15.19:0/3774207107 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40cf6a0 con 0x7effd40d4860 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd27fc640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd40d4860 0x7effd40d2020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7effc8009870 tx=0x7effc802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d00e60ad7fb862d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd1ffb640 1 -- 172.21.15.19:0/3774207107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8034070 con 0x7effd40d4860 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd1ffb640 1 -- 172.21.15.19:0/3774207107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8030840 con 0x7effd40d4860 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd1ffb640 1 -- 172.21.15.19:0/3774207107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8030c10 con 0x7effd40d4860 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd96f4640 1 -- 172.21.15.19:0/3774207107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd40d4860 msgr2=0x7effd40d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.687+0000 7effd96f4640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd40d4860 0x7effd40d2020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7effc8009870 tx=0x7effc802b980 comp rx=0 tx=0).stop 2024-03-04T08:51:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 -- 172.21.15.19:0/3774207107 shutdown_connections 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40b0e30 0x7effd40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 --2- 172.21.15.19:0/3774207107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd40d4860 0x7effd40d2020 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 -- 172.21.15.19:0/3774207107 >> 172.21.15.19:0/3774207107 conn(0x7effd40d3d40 msgr2=0x7effd40d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 -- 172.21.15.19:0/3774207107 shutdown_connections 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.688+0000 7effd96f4640 1 -- 172.21.15.19:0/3774207107 wait complete. 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.689+0000 7effd96f4640 1 Processor -- start 2024-03-04T08:51:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.689+0000 7effd96f4640 1 -- start start 2024-03-04T08:51:57.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 0x7effd414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 0x7effd414dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd40b0910 con 0x7effd41614d0 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cfc60 con 0x7effd40b0e30 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd40d2560 con 0x7effd40d4860 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54918/0 (socket says 172.21.15.19:54918) 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 -- 172.21.15.19:0/2347409991 learned_addr learned my addr 172.21.15.19:0/2347409991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd27fc640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 0x7effd414dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd2ffd640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 0x7effd414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 -- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 msgr2=0x7effd414dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 0x7effd414dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 -- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 msgr2=0x7effd414aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 0x7effd414aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 -- 172.21.15.19:0/2347409991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd414e270 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd27fc640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 0x7effd414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd2ffd640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 0x7effd414aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd37fe640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7effcc007e40 tx=0x7effcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc014620 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc019070 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd40b8570 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc014a20 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.690+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd40b8b30 con 0x7effd41614d0 2024-03-04T08:51:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.692+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4068ff0 con 0x7effd41614d0 2024-03-04T08:51:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.692+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effcc014bc0 con 0x7effd41614d0 2024-03-04T08:51:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.692+0000 7effbb7fe640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 0x7effc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.693+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7effcc08acd0 con 0x7effd41614d0 2024-03-04T08:51:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.693+0000 7effd2ffd640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 0x7effc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.693+0000 7effd2ffd640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 0x7effc006d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effc4001660 tx=0x7effc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:57.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.697+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7effd414e270 con 0x7effd41614d0 2024-03-04T08:51:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.923+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effd40d4250 con 0x7effd41614d0 2024-03-04T08:51:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.923+0000 7effbb7fe640 1 -- 172.21.15.19:0/2347409991 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7effcc059930 con 0x7effd41614d0 2024-03-04T08:51:57.920 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:51:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.925+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 msgr2=0x7effc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.925+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 0x7effc006d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effc4001660 tx=0x7effc4009040 comp rx=0 tx=0).stop 2024-03-04T08:51:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.925+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 msgr2=0x7effd40cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.925+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7effcc007e40 tx=0x7effcc00e4b0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 shutdown_connections 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd41614d0 0x7effd40cfea0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7effd40d4860 0x7effd414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7effc006b4d0 0x7effc006d990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 --2- 172.21.15.19:0/2347409991 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7effd40b0e30 0x7effd414aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 >> 172.21.15.19:0/2347409991 conn(0x7effd40d3d40 msgr2=0x7effd40b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 shutdown_connections 2024-03-04T08:51:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:57.926+0000 7effd96f4640 1 -- 172.21.15.19:0/2347409991 wait complete. 2024-03-04T08:51:57.933 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:51:58.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.061+0000 7fb1f3b16640 1 Processor -- start 2024-03-04T08:51:58.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.061+0000 7fb1f3b16640 1 -- start start 2024-03-04T08:51:58.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f3b16640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1ec0d4860 0x7fb1ec0d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f3b16640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb1ec0b0e30 0x7fb1ec0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f3b16640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec1618b0 con 0x7fb1ec1614d0 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f3b16640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0d4cf0 con 0x7fb1ec0d4860 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f3b16640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0cf400 con 0x7fb1ec0b0e30 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1ec0d4860 0x7fb1ec0d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1ec0d4860 0x7fb1ec0d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54932/0 (socket says 172.21.15.19:54932) 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 -- 172.21.15.19:0/1905689999 learned_addr learned my addr 172.21.15.19:0/1905689999 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f20b3640 1 --2- 172.21.15.19:0/1905689999 >> v2:172.21.15.204:3300/0 conn(0x7fb1ec0b0e30 0x7fb1ec0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 -- 172.21.15.19:0/1905689999 >> v2:172.21.15.204:3300/0 conn(0x7fb1ec0b0e30 msgr2=0x7fb1ec0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 --2- 172.21.15.19:0/1905689999 >> v2:172.21.15.204:3300/0 conn(0x7fb1ec0b0e30 0x7fb1ec0b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 -- 172.21.15.19:0/1905689999 >> v1:172.21.15.204:6789/0 conn(0x7fb1ec1614d0 legacy=0x7fb1ec0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.063+0000 7fb1f10b1640 1 -- 172.21.15.19:0/1905689999 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0cf6a0 con 0x7fb1ec0d4860 2024-03-04T08:51:58.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.064+0000 7fb1f10b1640 1 --2- 172.21.15.19:0/1905689999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0d2020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0ce550 tx=0x7fb1dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6920af9e9d529365 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.064+0000 7fb1f08b0640 1 -- 172.21.15.19:0/1905689999 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc035020 con 0x7fb1ec0d4860 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.064+0000 7fb1f08b0640 1 -- 172.21.15.19:0/1905689999 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc031640 con 0x7fb1ec0d4860 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.064+0000 7fb1f08b0640 1 -- 172.21.15.19:0/1905689999 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc02d040 con 0x7fb1ec0d4860 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 -- 172.21.15.19:0/1905689999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 msgr2=0x7fb1ec0d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/1905689999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0d2020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0ce550 tx=0x7fb1dc02b8f0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 -- 172.21.15.19:0/1905689999 shutdown_connections 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/1905689999 >> v2:172.21.15.204:3300/0 conn(0x7fb1ec0b0e30 0x7fb1ec0b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/1905689999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0d2020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 -- 172.21.15.19:0/1905689999 >> 172.21.15.19:0/1905689999 conn(0x7fb1ec0d3d40 msgr2=0x7fb1ec0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 -- 172.21.15.19:0/1905689999 shutdown_connections 2024-03-04T08:51:58.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.065+0000 7fb1f3b16640 1 -- 172.21.15.19:0/1905689999 wait complete. 2024-03-04T08:51:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.066+0000 7fb1f3b16640 1 Processor -- start 2024-03-04T08:51:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.066+0000 7fb1f3b16640 1 -- start start 2024-03-04T08:51:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1ec0b0e30 0x7fb1ec0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1ec1614d0 0x7fb1ec0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0b0910 con 0x7fb1ec0d4860 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0cfc60 con 0x7fb1ec0b0e30 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f3b16640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0d2560 con 0x7fb1ec1614d0 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54942/0 (socket says 172.21.15.19:54942) 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 -- 172.21.15.19:0/2929527864 learned_addr learned my addr 172.21.15.19:0/2929527864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f20b3640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1ec1614d0 0x7fb1ec0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f18b2640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1ec0b0e30 0x7fb1ec0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 -- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1ec1614d0 msgr2=0x7fb1ec0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1ec1614d0 0x7fb1ec0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 -- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1ec0b0e30 msgr2=0x7fb1ec0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1ec0b0e30 0x7fb1ec0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.067+0000 7fb1f10b1640 1 -- 172.21.15.19:0/2929527864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0b4760 con 0x7fb1ec0d4860 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1f10b1640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc000c00 tx=0x7fb1dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc040070 con 0x7fb1ec0d4860 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0399f0 con 0x7fb1ec0d4860 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec0b4a40 con 0x7fb1ec0d4860 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc035040 con 0x7fb1ec0d4860 2024-03-04T08:51:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.068+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec0b5000 con 0x7fb1ec0d4860 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.069+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec0b51d0 con 0x7fb1ec0d4860 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.069+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1dc04b060 con 0x7fb1ec0d4860 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.070+0000 7fb1e27fc640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 0x7fb1d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.070+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb1dc0abd30 con 0x7fb1ec0d4860 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.070+0000 7fb1f18b2640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 0x7fb1d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.070+0000 7fb1f18b2640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 0x7fb1d006d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8006fd0 tx=0x7fb1e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.074+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb1dc02f300 con 0x7fb1ec0d4860 2024-03-04T08:51:58.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.254+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1ec0b5f90 con 0x7fb1ec0d4860 2024-03-04T08:51:58.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.255+0000 7fb1e27fc640 1 -- 172.21.15.19:0/2929527864 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1dc07aab0 con 0x7fb1ec0d4860 2024-03-04T08:51:58.251 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 msgr2=0x7fb1d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 0x7fb1d006d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8006fd0 tx=0x7fb1e8008040 comp rx=0 tx=0).stop 2024-03-04T08:51:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 msgr2=0x7fb1ec0ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc000c00 tx=0x7fb1dc0046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 shutdown_connections 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1ec1614d0 0x7fb1ec0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1ec0d4860 0x7fb1ec0ca6f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1d006b4d0 0x7fb1d006d990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 --2- 172.21.15.19:0/2929527864 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1ec0b0e30 0x7fb1ec0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 >> 172.21.15.19:0/2929527864 conn(0x7fb1ec0d3d40 msgr2=0x7fb1ec0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 shutdown_connections 2024-03-04T08:51:58.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.257+0000 7fb1f3b16640 1 -- 172.21.15.19:0/2929527864 wait complete. 2024-03-04T08:51:58.264 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:51:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.394+0000 7f0f011e9640 1 Processor -- start 2024-03-04T08:51:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.394+0000 7f0f011e9640 1 -- start start 2024-03-04T08:51:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0f011e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc1614d0 0x7f0efc0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0f011e9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc0d2480 0x7f0efc0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0f011e9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc1618b0 con 0x7f0efc0d1910 2024-03-04T08:51:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0f011e9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0cf400 con 0x7f0efc0d2480 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0f011e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0cf6a0 con 0x7f0efc1614d0 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc0d2480 0x7f0efc0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0efc0d2480 0x7f0efc0b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54944/0 (socket says 172.21.15.19:54944) 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 -- 172.21.15.19:0/40446499 learned_addr learned my addr 172.21.15.19:0/40446499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efad9d640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc1614d0 0x7f0efc0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 -- 172.21.15.19:0/40446499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc1614d0 msgr2=0x7f0efc0d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc1614d0 0x7f0efc0d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 -- 172.21.15.19:0/40446499 >> v1:172.21.15.204:6789/0 conn(0x7f0efc0d1910 legacy=0x7f0efc0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.395+0000 7f0efb59e640 1 -- 172.21.15.19:0/40446499 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0cf980 con 0x7f0efc0d2480 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.396+0000 7f0efb59e640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc0b0e30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009e50 tx=0x7f0ef402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebddbdeaa6623a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.396+0000 7f0efa59c640 1 -- 172.21.15.19:0/40446499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef402cb00 con 0x7f0efc0d2480 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.396+0000 7f0efa59c640 1 -- 172.21.15.19:0/40446499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef402cca0 con 0x7f0efc0d2480 2024-03-04T08:51:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.396+0000 7f0efa59c640 1 -- 172.21.15.19:0/40446499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4034610 con 0x7f0efc0d2480 2024-03-04T08:51:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 -- 172.21.15.19:0/40446499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 msgr2=0x7f0efc0b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc0b0e30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009e50 tx=0x7f0ef402bf60 comp rx=0 tx=0).stop 2024-03-04T08:51:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 -- 172.21.15.19:0/40446499 shutdown_connections 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc0b0e30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 --2- 172.21.15.19:0/40446499 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc1614d0 0x7f0efc0d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 -- 172.21.15.19:0/40446499 >> 172.21.15.19:0/40446499 conn(0x7f0efc0d3d40 msgr2=0x7f0efc0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 -- 172.21.15.19:0/40446499 shutdown_connections 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.397+0000 7f0f011e9640 1 -- 172.21.15.19:0/40446499 wait complete. 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.399+0000 7f0f011e9640 1 Processor -- start 2024-03-04T08:51:58.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.399+0000 7f0f011e9640 1 -- start start 2024-03-04T08:51:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc0d1910 0x7f0efc1f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 0x7f0efc1f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0b1370 con 0x7f0efc0d2480 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0b0910 con 0x7f0efc1614d0 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0f011e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0b14f0 con 0x7f0efc0d1910 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54958/0 (socket says 172.21.15.19:54958) 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.400+0000 7f0ef3fff640 1 -- 172.21.15.19:0/2475942932 learned_addr learned my addr 172.21.15.19:0/2475942932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0efb59e640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 0x7f0efc1f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 -- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc0d1910 msgr2=0x7f0efc1f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc0d1910 0x7f0efc1f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 -- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 msgr2=0x7f0efc1f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 0x7f0efc1f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 -- 172.21.15.19:0/2475942932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc1f7640 con 0x7f0efc0d2480 2024-03-04T08:51:58.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0efb59e640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 0x7f0efc1f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef3fff640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c400 tx=0x7f0ee400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40052d0 con 0x7f0efc0d2480 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee4005490 con 0x7f0efc0d2480 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc0b80c0 con 0x7f0efc0d2480 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4007260 con 0x7f0efc0d2480 2024-03-04T08:51:58.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.401+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc0c9580 con 0x7f0efc0d2480 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.402+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc0c90d0 con 0x7f0efc0d2480 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.403+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ee4007400 con 0x7f0efc0d2480 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.403+0000 7f0ef37fe640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 0x7f0edc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.403+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f0ee4089850 con 0x7f0efc0d2480 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.403+0000 7f0efad9d640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 0x7f0edc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.404+0000 7f0efad9d640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 0x7f0edc06d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006fd0 tx=0x7f0eec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.407+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0ee40585d0 con 0x7f0efc0d2480 2024-03-04T08:51:58.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.597+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0efc068ff0 con 0x7f0efc0d2480 2024-03-04T08:51:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.598+0000 7f0ef37fe640 1 -- 172.21.15.19:0/2475942932 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ee4057ed0 con 0x7f0efc0d2480 2024-03-04T08:51:58.594 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:51:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 msgr2=0x7f0edc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 0x7f0edc06d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006fd0 tx=0x7f0eec008040 comp rx=0 tx=0).stop 2024-03-04T08:51:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 msgr2=0x7f0efc1f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c400 tx=0x7f0ee400c8c0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 shutdown_connections 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0edc06b4d0 0x7f0edc06d990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0efc1614d0 0x7f0efc1f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0efc0d2480 0x7f0efc1f7100 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.599+0000 7f0f011e9640 1 --2- 172.21.15.19:0/2475942932 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0efc0d1910 0x7f0efc1f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.600+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 >> 172.21.15.19:0/2475942932 conn(0x7f0efc0d3d40 msgr2=0x7f0efc0d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.600+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 shutdown_connections 2024-03-04T08:51:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.600+0000 7f0f011e9640 1 -- 172.21.15.19:0/2475942932 wait complete. 2024-03-04T08:51:58.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:51:58.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.723+0000 7f95298af640 1 Processor -- start 2024-03-04T08:51:58.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.723+0000 7f95298af640 1 -- start start 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95298af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 0x7f952415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95298af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95240d0ac0 0x7f95240b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95298af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240d47f0 con 0x7f95240b4d10 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95298af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95240ced70 con 0x7f95240d0ac0 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95298af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240d1ab0 con 0x7f95240d06e0 2024-03-04T08:51:58.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95227fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95240d0ac0 0x7f95240b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95237fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95240b4d10 0x7f95240cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44190/0 (socket says 172.21.15.19:44190) 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95237fe640 1 -- 172.21.15.19:0/3247426804 learned_addr learned my addr 172.21.15.19:0/3247426804 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f9522ffd640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 0x7f952415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95227fc640 1 -- 172.21.15.19:0/3247426804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 msgr2=0x7f952415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95227fc640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 0x7f952415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95227fc640 1 -- 172.21.15.19:0/3247426804 >> v1:172.21.15.19:6789/0 conn(0x7f95240b4d10 legacy=0x7f95240cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f95227fc640 1 -- 172.21.15.19:0/3247426804 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240d1d90 con 0x7f95240d0ac0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f9521ffb640 1 -- 172.21.15.19:0/3247426804 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602344283 0 0) 0x7f95240d47f0 con 0x7f95240b4d10 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.724+0000 7f9522ffd640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 0x7f952415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.725+0000 7f95227fc640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95240b47d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f950c0097a0 tx=0x7f950c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60859cdac5e4d1e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.725+0000 7f9521ffb640 1 -- 172.21.15.19:0/3247426804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c035020 con 0x7f95240d0ac0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.725+0000 7f9521ffb640 1 -- 172.21.15.19:0/3247426804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c031830 con 0x7f95240d0ac0 2024-03-04T08:51:58.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.725+0000 7f9521ffb640 1 -- 172.21.15.19:0/3247426804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c031c00 con 0x7f95240d0ac0 2024-03-04T08:51:58.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 -- 172.21.15.19:0/3247426804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 msgr2=0x7f95240b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95240b47d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f950c0097a0 tx=0x7f950c02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 -- 172.21.15.19:0/3247426804 shutdown_connections 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95240b47d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 --2- 172.21.15.19:0/3247426804 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240d06e0 0x7f952415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 -- 172.21.15.19:0/3247426804 >> 172.21.15.19:0/3247426804 conn(0x7f95240d3cd0 msgr2=0x7f95240d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 -- 172.21.15.19:0/3247426804 shutdown_connections 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.726+0000 7f95298af640 1 -- 172.21.15.19:0/3247426804 wait complete. 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.728+0000 7f95298af640 1 Processor -- start 2024-03-04T08:51:58.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.728+0000 7f95298af640 1 -- start start 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240b4d10 0x7f9524158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95240d06e0 0x7f95241e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b44d0 con 0x7f95240d0ac0 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240ce990 con 0x7f95240d06e0 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95298af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240d0f00 con 0x7f95240b4d10 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54984/0 (socket says 172.21.15.19:54984) 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 -- 172.21.15.19:0/1988787624 learned_addr learned my addr 172.21.15.19:0/1988787624 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:58.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 -- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240b4d10 msgr2=0x7f9524158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240b4d10 0x7f9524158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 -- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95240d06e0 msgr2=0x7f95241e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95227fc640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95240d06e0 0x7f95241e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95240d06e0 0x7f95241e7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.729+0000 7f95237fe640 1 -- 172.21.15.19:0/1988787624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240ca220 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f95237fe640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c410 tx=0x7f951c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0074e0 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0047e0 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95240ca500 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c004bd0 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.730+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95240cb080 con 0x7f95240d0ac0 2024-03-04T08:51:58.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.731+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95240a1c80 con 0x7f95240d0ac0 2024-03-04T08:51:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.731+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f951c011070 con 0x7f95240d0ac0 2024-03-04T08:51:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.731+0000 7f951bfff640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 0x7f950406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.732+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f951c089ef0 con 0x7f95240d0ac0 2024-03-04T08:51:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.732+0000 7f9522ffd640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 0x7f950406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.732+0000 7f9522ffd640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 0x7f950406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9514008e00 tx=0x7f9514008330 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.736+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f951c058be0 con 0x7f95240d0ac0 2024-03-04T08:51:58.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.945+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f9524068ff0 con 0x7f95240d0ac0 2024-03-04T08:51:58.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.945+0000 7f951bfff640 1 -- 172.21.15.19:0/1988787624 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7f951c0584e0 con 0x7f95240d0ac0 2024-03-04T08:51:58.942 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 msgr2=0x7f950406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 0x7f950406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9514008e00 tx=0x7f9514008330 comp rx=0 tx=0).stop 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 msgr2=0x7f95241e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c410 tx=0x7f951c00c8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 shutdown_connections 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95240d0ac0 0x7f95241e8150 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f950406b4d0 0x7f950406d990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f95240d06e0 0x7f95241e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 --2- 172.21.15.19:0/1988787624 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f95240b4d10 0x7f9524158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.947+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 >> 172.21.15.19:0/1988787624 conn(0x7f95240d3cd0 msgr2=0x7f952415f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.948+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 shutdown_connections 2024-03-04T08:51:58.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:58.948+0000 7f95298af640 1 -- 172.21.15.19:0/1988787624 wait complete. 2024-03-04T08:51:58.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:51:59.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.078+0000 7f923071e640 1 Processor -- start 2024-03-04T08:51:59.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.078+0000 7f923071e640 1 -- start start 2024-03-04T08:51:59.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f923071e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9228162970 0x7f92280d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f923071e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 0x7f9228162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f923071e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92280d22c0 con 0x7f92280b4460 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f923071e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9228161b00 con 0x7f9228162970 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f923071e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280cecc0 con 0x7f9228161cf0 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f922dcb9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9228162970 0x7f92280d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f922e4ba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f92280b4460 0x7f92280b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44204/0 (socket says 172.21.15.19:44204) 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f922dcb9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9228162970 0x7f92280d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55000/0 (socket says 172.21.15.19:55000) 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.079+0000 7f922e4ba640 1 -- 172.21.15.19:0/3576896254 learned_addr learned my addr 172.21.15.19:0/3576896254 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922ecbb640 1 --2- 172.21.15.19:0/3576896254 >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 0x7f9228162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922dcb9640 1 -- 172.21.15.19:0/3576896254 >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 msgr2=0x7f9228162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922dcb9640 1 --2- 172.21.15.19:0/3576896254 >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 0x7f9228162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922dcb9640 1 -- 172.21.15.19:0/3576896254 >> v1:172.21.15.19:6789/0 conn(0x7f92280b4460 legacy=0x7f92280b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922dcb9640 1 -- 172.21.15.19:0/3576896254 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280d25a0 con 0x7f9228162970 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922d4b8640 1 -- 172.21.15.19:0/3576896254 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552342936 0 0) 0x7f92280d22c0 con 0x7f92280b4460 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922ecbb640 1 --2- 172.21.15.19:0/3576896254 >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 0x7f9228162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.080+0000 7f922dcb9640 1 --2- 172.21.15.19:0/3576896254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228162970 0x7f92280d4800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f922808c900 tx=0x7f921c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec965d6b5584ca2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f922d4b8640 1 -- 172.21.15.19:0/3576896254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c035020 con 0x7f9228162970 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f922d4b8640 1 -- 172.21.15.19:0/3576896254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c031830 con 0x7f9228162970 2024-03-04T08:51:59.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f922d4b8640 1 -- 172.21.15.19:0/3576896254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c031c00 con 0x7f9228162970 2024-03-04T08:51:59.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 -- 172.21.15.19:0/3576896254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228162970 msgr2=0x7f92280d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 --2- 172.21.15.19:0/3576896254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228162970 0x7f92280d4800 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f922808c900 tx=0x7f921c02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 -- 172.21.15.19:0/3576896254 shutdown_connections 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 --2- 172.21.15.19:0/3576896254 >> v2:172.21.15.204:3300/0 conn(0x7f9228161cf0 0x7f9228162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 --2- 172.21.15.19:0/3576896254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228162970 0x7f92280d4800 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 -- 172.21.15.19:0/3576896254 >> 172.21.15.19:0/3576896254 conn(0x7f92280d3ce0 msgr2=0x7f92280d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 -- 172.21.15.19:0/3576896254 shutdown_connections 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.081+0000 7f923071e640 1 -- 172.21.15.19:0/3576896254 wait complete. 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.082+0000 7f923071e640 1 Processor -- start 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.082+0000 7f923071e640 1 -- start start 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92280b4460 0x7f92280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9228162970 0x7f92280b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92280ce950 con 0x7f9228161cf0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92280d2b60 con 0x7f9228162970 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f923071e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92280b4840 con 0x7f92280b4460 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55008/0 (socket says 172.21.15.19:55008) 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 -- 172.21.15.19:0/2421926863 learned_addr learned my addr 172.21.15.19:0/2421926863 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922e4ba640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92280b4460 0x7f92280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922ecbb640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9228162970 0x7f92280b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 -- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92280b4460 msgr2=0x7f92280b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92280b4460 0x7f92280b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 -- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9228162970 msgr2=0x7f92280b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.083+0000 7f922dcb9640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9228162970 0x7f92280b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f922dcb9640 1 -- 172.21.15.19:0/2421926863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280b8a30 con 0x7f9228161cf0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f922dcb9640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f921c000c00 tx=0x7f921c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c035050 con 0x7f9228161cf0 2024-03-04T08:51:59.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c004230 con 0x7f9228161cf0 2024-03-04T08:51:59.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92280b8ff0 con 0x7f9228161cf0 2024-03-04T08:51:59.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c03b800 con 0x7f9228161cf0 2024-03-04T08:51:59.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.084+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92280b95b0 con 0x7f9228161cf0 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.085+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922804f330 con 0x7f9228161cf0 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.086+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f921c038020 con 0x7f9228161cf0 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.086+0000 7f9226ffd640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.086+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f921c0ac1d0 con 0x7f9228161cf0 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.086+0000 7f922e4ba640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.087+0000 7f922e4ba640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 0x7f921406d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9220000f60 tx=0x7f9220007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.095+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f921c040070 con 0x7f9228161cf0 2024-03-04T08:51:59.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.352+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f922806b180 con 0x7f9228161cf0 2024-03-04T08:51:59.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.353+0000 7f9226ffd640 1 -- 172.21.15.19:0/2421926863 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f921c07aec0 con 0x7f9228161cf0 2024-03-04T08:51:59.349 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:51:59.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 msgr2=0x7f921406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 0x7f921406d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9220000f60 tx=0x7f9220007c00 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 msgr2=0x7f92280b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f921c000c00 tx=0x7f921c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 shutdown_connections 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9228162970 0x7f92280b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9228161cf0 0x7f92280b7f70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 --2- 172.21.15.19:0/2421926863 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f92280b4460 0x7f92280b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 >> 172.21.15.19:0/2421926863 conn(0x7f92280d3ce0 msgr2=0x7f92280d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 shutdown_connections 2024-03-04T08:51:59.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.355+0000 7f923071e640 1 -- 172.21.15.19:0/2421926863 wait complete. 2024-03-04T08:51:59.365 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:51:59.365 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:51:59.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:51:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.525+0000 7f281460e640 1 Processor -- start 2024-03-04T08:51:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.525+0000 7f281460e640 1 -- start start 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f281460e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f280c0cfff0 0x7f280c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f281460e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280c0cc8b0 0x7f280c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f281460e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c161980 con 0x7f280c15bb20 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f281460e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0d2500 con 0x7f280c0cc8b0 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f281460e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c161c60 con 0x7f280c0cfff0 2024-03-04T08:51:59.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280c0cc8b0 0x7f280c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280c0cc8b0 0x7f280c0ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55018/0 (socket says 172.21.15.19:55018) 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 -- 172.21.15.19:0/3288437613 learned_addr learned my addr 172.21.15.19:0/3288437613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 -- 172.21.15.19:0/3288437613 >> v2:172.21.15.204:3300/0 conn(0x7f280c0cfff0 msgr2=0x7f280c0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 --2- 172.21.15.19:0/3288437613 >> v2:172.21.15.204:3300/0 conn(0x7f280c0cfff0 0x7f280c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 -- 172.21.15.19:0/3288437613 >> v1:172.21.15.204:6789/0 conn(0x7f280c15bb20 legacy=0x7f280c0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.526+0000 7f2812bab640 1 -- 172.21.15.19:0/3288437613 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c161f40 con 0x7f280c0cc8b0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.527+0000 7f2812bab640 1 --2- 172.21.15.19:0/3288437613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0ccce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f280c071290 tx=0x7f280402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e3d1ae2a5ef32 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.527+0000 7f28113a8640 1 -- 172.21.15.19:0/3288437613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280402ca80 con 0x7f280c0cc8b0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.527+0000 7f28113a8640 1 -- 172.21.15.19:0/3288437613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280402cc20 con 0x7f280c0cc8b0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.527+0000 7f28113a8640 1 -- 172.21.15.19:0/3288437613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040343f0 con 0x7f280c0cc8b0 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 -- 172.21.15.19:0/3288437613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 msgr2=0x7f280c0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 --2- 172.21.15.19:0/3288437613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0ccce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f280c071290 tx=0x7f280402bee0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 -- 172.21.15.19:0/3288437613 shutdown_connections 2024-03-04T08:51:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 --2- 172.21.15.19:0/3288437613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0ccce0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 --2- 172.21.15.19:0/3288437613 >> v2:172.21.15.204:3300/0 conn(0x7f280c0cfff0 0x7f280c0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 -- 172.21.15.19:0/3288437613 >> 172.21.15.19:0/3288437613 conn(0x7f280c09a9f0 msgr2=0x7f280c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 -- 172.21.15.19:0/3288437613 shutdown_connections 2024-03-04T08:51:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.528+0000 7f281460e640 1 -- 172.21.15.19:0/3288437613 wait complete. 2024-03-04T08:51:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.529+0000 7f281460e640 1 Processor -- start 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.529+0000 7f281460e640 1 -- start start 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f280c0cfff0 0x7f280c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 0x7f280c0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0d1980 con 0x7f280c0cc8b0 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c162500 con 0x7f280c15bb20 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f281460e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0d1b00 con 0x7f280c0cfff0 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55028/0 (socket says 172.21.15.19:55028) 2024-03-04T08:51:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 -- 172.21.15.19:0/95108642 learned_addr learned my addr 172.21.15.19:0/95108642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 -- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f280c0cfff0 msgr2=0x7f280c0c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f280c0cfff0 0x7f280c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 -- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 msgr2=0x7f280c0c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f2812bab640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 0x7f280c0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 0x7f280c0c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 -- 172.21.15.19:0/95108642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0c5960 con 0x7f280c0cc8b0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f2812bab640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 0x7f280c0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.530+0000 7f28123aa640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f280800b3e0 tx=0x7f280800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.531+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808015020 con 0x7f280c0cc8b0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.531+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808011850 con 0x7f280c0cc8b0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.531+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808011c40 con 0x7f280c0cc8b0 2024-03-04T08:51:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.531+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0c5c40 con 0x7f280c0cc8b0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.531+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c0c6200 con 0x7f280c0cc8b0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.532+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c04f330 con 0x7f280c0cc8b0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.532+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2808018020 con 0x7f280c0cc8b0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.532+0000 7f2802ffd640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 0x7f27f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.532+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f280808a2c0 con 0x7f280c0cc8b0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.533+0000 7f2811ba9640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 0x7f27f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.533+0000 7f2811ba9640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 0x7f27f006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280c0cb2d0 tx=0x7f27fc006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.537+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f280801f020 con 0x7f280c0cc8b0 2024-03-04T08:51:59.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.865+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f280c0b1820 con 0x7f280c0cc8b0 2024-03-04T08:51:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.866+0000 7f2802ffd640 1 -- 172.21.15.19:0/95108642 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f28080172c0 con 0x7f280c0cc8b0 2024-03-04T08:51:59.862 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:51:59.862 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:51:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 msgr2=0x7f27f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 0x7f27f006d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f280c0cb2d0 tx=0x7f27fc006bf0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 msgr2=0x7f280c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f280800b3e0 tx=0x7f280800b8a0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 shutdown_connections 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f27f006b4d0 0x7f27f006d990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f280c15bb20 0x7f280c0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f280c0cfff0 0x7f280c0c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 --2- 172.21.15.19:0/95108642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280c0cc8b0 0x7f280c0cd6c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 >> 172.21.15.19:0/95108642 conn(0x7f280c09a9f0 msgr2=0x7f280c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 shutdown_connections 2024-03-04T08:51:59.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.868+0000 7f281460e640 1 -- 172.21.15.19:0/95108642 wait complete. 2024-03-04T08:51:59.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:51:59.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:51:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.984+0000 7fc93eafb640 1 Processor -- start 2024-03-04T08:51:59.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.984+0000 7fc93eafb640 1 -- start start 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93eafb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc9381614d0 0x7fc9380d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93eafb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 0x7fc9380d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93eafb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9380d2740 con 0x7fc9380d22b0 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93eafb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9381618b0 con 0x7fc9381614d0 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93eafb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380cf400 con 0x7fc9380d1910 2024-03-04T08:51:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93d098640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fc9380d22b0 0x7fc9380d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:42576/0 (socket says 172.21.15.19:42576) 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc93d098640 1 -- 172.21.15.19:0/1885205379 learned_addr learned my addr 172.21.15.19:0/1885205379 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.985+0000 7fc92ffff640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 0x7fc9380d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc93c897640 1 --2- 172.21.15.19:0/1885205379 >> v2:172.21.15.204:3300/0 conn(0x7fc9381614d0 0x7fc9380d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc92f7fe640 1 -- 172.21.15.19:0/1885205379 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843815244 0 0) 0x7fc930001490 con 0x7fc9380d22b0 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc92f7fe640 1 -- 172.21.15.19:0/1885205379 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc920003520 con 0x7fc9380d22b0 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc93c897640 1 -- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 msgr2=0x7fc9380d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc93c897640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 0x7fc9380d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc93c897640 1 -- 172.21.15.19:0/1885205379 >> v1:172.21.15.204:6789/0 conn(0x7fc9380d22b0 legacy=0x7fc9380d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc93c897640 1 -- 172.21.15.19:0/1885205379 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380cf6a0 con 0x7fc9381614d0 2024-03-04T08:51:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.986+0000 7fc92ffff640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 0x7fc9380d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93c897640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380d4860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9340097a0 tx=0x7fc93402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30b13bd4c502010 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc92f7fe640 1 -- 172.21.15.19:0/1885205379 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934035020 con 0x7fc9381614d0 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc92f7fe640 1 -- 172.21.15.19:0/1885205379 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934031830 con 0x7fc9381614d0 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc92f7fe640 1 -- 172.21.15.19:0/1885205379 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934031c00 con 0x7fc9381614d0 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 -- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 msgr2=0x7fc9380d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380d4860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9340097a0 tx=0x7fc93402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 -- 172.21.15.19:0/1885205379 shutdown_connections 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d1910 0x7fc9380d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 --2- 172.21.15.19:0/1885205379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380d4860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 -- 172.21.15.19:0/1885205379 >> 172.21.15.19:0/1885205379 conn(0x7fc9380d3d40 msgr2=0x7fc9380d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 -- 172.21.15.19:0/1885205379 shutdown_connections 2024-03-04T08:51:59.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.987+0000 7fc93eafb640 1 -- 172.21.15.19:0/1885205379 wait complete. 2024-03-04T08:51:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 Processor -- start 2024-03-04T08:51:59.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 -- start start 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 0x7fc9380ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380b0910 con 0x7fc9380d1910 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380cfc60 con 0x7fc9381614d0 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.989+0000 7fc93eafb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380b1e40 con 0x7fc9380d22b0 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55040/0 (socket says 172.21.15.19:55040) 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 -- 172.21.15.19:0/530539077 learned_addr learned my addr 172.21.15.19:0/530539077 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93d098640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc92ffff640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 0x7fc9380ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 -- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 msgr2=0x7fc9380ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 0x7fc9380ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 -- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 msgr2=0x7fc9380b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 -- 172.21.15.19:0/530539077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380c78b0 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc92ffff640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 0x7fc9380ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93c897640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc934034040 tx=0x7fc9340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934040070 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93403a910 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9380c7b90 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934035040 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.990+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9380c8150 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.991+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc938068ff0 con 0x7fc9380d1910 2024-03-04T08:51:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.992+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc934038020 con 0x7fc9380d1910 2024-03-04T08:51:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.992+0000 7fc92d7fa640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 0x7fc92406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:51:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.993+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc9340abb60 con 0x7fc9380d1910 2024-03-04T08:51:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.993+0000 7fc92ffff640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 0x7fc92406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:51:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.993+0000 7fc92ffff640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 0x7fc92406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9380d0b60 tx=0x7fc928008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:51:59.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:51:59.997+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc93407a8e0 con 0x7fc9380d1910 2024-03-04T08:52:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.207+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9380a1c10 con 0x7fc9380d1910 2024-03-04T08:52:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.208+0000 7fc92d7fa640 1 -- 172.21.15.19:0/530539077 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc93407a1e0 con 0x7fc9380d1910 2024-03-04T08:52:00.204 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.209+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 msgr2=0x7fc92406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.209+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 0x7fc92406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9380d0b60 tx=0x7fc928008040 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.209+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 msgr2=0x7fc93815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.209+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc934034040 tx=0x7fc9340046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 shutdown_connections 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc92406b4d0 0x7fc92406d990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9381614d0 0x7fc9380b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9380d22b0 0x7fc9380ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 --2- 172.21.15.19:0/530539077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9380d1910 0x7fc93815a240 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 >> 172.21.15.19:0/530539077 conn(0x7fc9380d3d40 msgr2=0x7fc93806ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 shutdown_connections 2024-03-04T08:52:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.210+0000 7fc93eafb640 1 -- 172.21.15.19:0/530539077 wait complete. 2024-03-04T08:52:00.217 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.325+0000 7f5fdd713640 1 Processor -- start 2024-03-04T08:52:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 -- start start 2024-03-04T08:52:00.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd8161bd0 con 0x7f5fd80b0000 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd8070220 con 0x7f5fd815dd00 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.326+0000 7f5fdd713640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8161e90 con 0x7f5fd815e0e0 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd77fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f5fd80b0000 0x7f5fd80b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:42592/0 (socket says 172.21.15.19:42592) 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd77fe640 1 -- 172.21.15.19:0/3605244614 learned_addr learned my addr 172.21.15.19:0/3605244614 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:53288/0 (socket says 172.21.15.19:53288) 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd6ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:40266/0 (socket says 172.21.15.19:40266) 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 -- 172.21.15.19:0/3605244614 >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 msgr2=0x7f5fd806e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 --2- 172.21.15.19:0/3605244614 >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 -- 172.21.15.19:0/3605244614 >> v1:172.21.15.204:6789/0 conn(0x7f5fd80b0000 legacy=0x7f5fd80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fcffff640 1 -- 172.21.15.19:0/3605244614 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8162170 con 0x7f5fd815e0e0 2024-03-04T08:52:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd67fc640 1 -- 172.21.15.19:0/3605244614 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754510189 0 0) 0x7f5fd8161bd0 con 0x7f5fd80b0000 2024-03-04T08:52:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.327+0000 7f5fd6ffd640 1 --2- 172.21.15.19:0/3605244614 >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.328+0000 7f5fcffff640 1 --2- 172.21.15.19:0/3605244614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00097a0 tx=0x7f5fc002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4c768b3cc3c2d40 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.328+0000 7f5fd67fc640 1 -- 172.21.15.19:0/3605244614 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0035020 con 0x7f5fd815e0e0 2024-03-04T08:52:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.328+0000 7f5fd67fc640 1 -- 172.21.15.19:0/3605244614 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0031830 con 0x7f5fd815e0e0 2024-03-04T08:52:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.328+0000 7f5fd67fc640 1 -- 172.21.15.19:0/3605244614 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0031c00 con 0x7f5fd815e0e0 2024-03-04T08:52:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 -- 172.21.15.19:0/3605244614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 msgr2=0x7f5fd806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 --2- 172.21.15.19:0/3605244614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00097a0 tx=0x7f5fc002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 -- 172.21.15.19:0/3605244614 shutdown_connections 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 --2- 172.21.15.19:0/3605244614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815e0e0 0x7f5fd806afb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 --2- 172.21.15.19:0/3605244614 >> v2:172.21.15.204:3300/0 conn(0x7f5fd815dd00 0x7f5fd806e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 -- 172.21.15.19:0/3605244614 >> 172.21.15.19:0/3605244614 conn(0x7f5fd80b2660 msgr2=0x7f5fd80b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 -- 172.21.15.19:0/3605244614 shutdown_connections 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.329+0000 7f5fdd713640 1 -- 172.21.15.19:0/3605244614 wait complete. 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.330+0000 7f5fdd713640 1 Processor -- start 2024-03-04T08:52:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.330+0000 7f5fdd713640 1 -- start start 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd80b0000 0x7f5fd80c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815dd00 0x7f5fd81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8162810 con 0x7f5fd814d590 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8162690 con 0x7f5fd80b0000 2024-03-04T08:52:00.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fdd713640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8162990 con 0x7f5fd815dd00 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55042/0 (socket says 172.21.15.19:55042) 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 -- 172.21.15.19:0/2005201019 learned_addr learned my addr 172.21.15.19:0/2005201019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fcffff640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815dd00 0x7f5fd81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd6ffd640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd80b0000 0x7f5fd80c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 -- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815dd00 msgr2=0x7f5fd81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815dd00 0x7f5fd81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 -- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd80b0000 msgr2=0x7f5fd80c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd80b0000 0x7f5fd80c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.331+0000 7f5fd77fe640 1 -- 172.21.15.19:0/2005201019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd815b900 con 0x7f5fd814d590 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fd77fe640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c700 tx=0x7f5fd000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0018070 con 0x7f5fd814d590 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000ce10 con 0x7f5fd814d590 2024-03-04T08:52:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd80c7810 con 0x7f5fd814d590 2024-03-04T08:52:00.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000a860 con 0x7f5fd814d590 2024-03-04T08:52:00.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.332+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd814dd70 con 0x7f5fd814d590 2024-03-04T08:52:00.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.333+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd8073390 con 0x7f5fd814d590 2024-03-04T08:52:00.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.333+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5fd001b070 con 0x7f5fd814d590 2024-03-04T08:52:00.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.334+0000 7f5fcf7fe640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 0x7f5fb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.334+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5fd00898e0 con 0x7f5fd814d590 2024-03-04T08:52:00.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.334+0000 7f5fd6ffd640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 0x7f5fb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.334+0000 7f5fd6ffd640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 0x7f5fb806d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009560 tx=0x7f5fc8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.338+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5fd815b900 con 0x7f5fd814d590 2024-03-04T08:52:00.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.521+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fd8068ff0 con 0x7f5fd814d590 2024-03-04T08:52:00.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.521+0000 7f5fcf7fe640 1 -- 172.21.15.19:0/2005201019 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fd0057f80 con 0x7f5fd814d590 2024-03-04T08:52:00.517 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 msgr2=0x7f5fb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 0x7f5fb806d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009560 tx=0x7f5fc8009190 comp rx=0 tx=0).stop 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 msgr2=0x7f5fd8160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c700 tx=0x7f5fd000cbc0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 shutdown_connections 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd814d590 0x7f5fd8160be0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd815dd00 0x7f5fd81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb806b4d0 0x7f5fb806d990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 --2- 172.21.15.19:0/2005201019 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd80b0000 0x7f5fd80c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 >> 172.21.15.19:0/2005201019 conn(0x7f5fd80b2660 msgr2=0x7f5fd815c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 shutdown_connections 2024-03-04T08:52:00.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.524+0000 7f5fdd713640 1 -- 172.21.15.19:0/2005201019 wait complete. 2024-03-04T08:52:00.531 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.641+0000 7fdc6cd13640 1 Processor -- start 2024-03-04T08:52:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.641+0000 7fdc6cd13640 1 -- start start 2024-03-04T08:52:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc680d10c0 0x7fdc680d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc680d14a0 0x7fdc6815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 0x7fdc680cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6815c050 con 0x7fdc680d10c0 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680d0060 con 0x7fdc6815eb00 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6cd13640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680cfa50 con 0x7fdc680d14a0 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc680d10c0 0x7fdc680d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc680d10c0 0x7fdc680d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55058/0 (socket says 172.21.15.19:55058) 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 -- 172.21.15.19:0/2870767648 learned_addr learned my addr 172.21.15.19:0/2870767648 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 -- 172.21.15.19:0/2870767648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc680d14a0 msgr2=0x7fdc6815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 --2- 172.21.15.19:0/2870767648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc680d14a0 0x7fdc6815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc66d9d640 1 --2- 172.21.15.19:0/2870767648 >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 0x7fdc680cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 -- 172.21.15.19:0/2870767648 >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 msgr2=0x7fdc680cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 --2- 172.21.15.19:0/2870767648 >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 0x7fdc680cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc6659c640 1 -- 172.21.15.19:0/2870767648 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680d0a30 con 0x7fdc680d10c0 2024-03-04T08:52:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.643+0000 7fdc66d9d640 1 --2- 172.21.15.19:0/2870767648 >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 0x7fdc680cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.644+0000 7fdc6659c640 1 --2- 172.21.15.19:0/2870767648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680d04f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009870 tx=0x7fdc5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ccf7cad20ddd36 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.644+0000 7fdc65d9b640 1 -- 172.21.15.19:0/2870767648 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58035020 con 0x7fdc680d10c0 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.644+0000 7fdc65d9b640 1 -- 172.21.15.19:0/2870767648 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58031640 con 0x7fdc680d10c0 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.644+0000 7fdc65d9b640 1 -- 172.21.15.19:0/2870767648 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5802d040 con 0x7fdc680d10c0 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 -- 172.21.15.19:0/2870767648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 msgr2=0x7fdc680d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/2870767648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680d04f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009870 tx=0x7fdc5802b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 -- 172.21.15.19:0/2870767648 shutdown_connections 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/2870767648 >> v2:172.21.15.204:3300/0 conn(0x7fdc6815eb00 0x7fdc680cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/2870767648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc680d14a0 0x7fdc6815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/2870767648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680d04f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 -- 172.21.15.19:0/2870767648 >> 172.21.15.19:0/2870767648 conn(0x7fdc680b3800 msgr2=0x7fdc680b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 -- 172.21.15.19:0/2870767648 shutdown_connections 2024-03-04T08:52:00.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.645+0000 7fdc6cd13640 1 -- 172.21.15.19:0/2870767648 wait complete. 2024-03-04T08:52:00.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.647+0000 7fdc6cd13640 1 Processor -- start 2024-03-04T08:52:00.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.647+0000 7fdc6cd13640 1 -- start start 2024-03-04T08:52:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 0x7fdc680cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc6815eb00 0x7fdc681f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815f440 con 0x7fdc680d10c0 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815f160 con 0x7fdc680d14a0 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6cd13640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680cfcf0 con 0x7fdc6815eb00 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55070/0 (socket says 172.21.15.19:55070) 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 -- 172.21.15.19:0/1891046648 learned_addr learned my addr 172.21.15.19:0/1891046648 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc5ffff640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 0x7fdc680cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc66d9d640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc6815eb00 0x7fdc681f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 -- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc6815eb00 msgr2=0x7fdc681f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc6815eb00 0x7fdc681f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 -- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 msgr2=0x7fdc680cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 0x7fdc680cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc6659c640 1 -- 172.21.15.19:0/1891046648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc681f4420 con 0x7fdc680d10c0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.648+0000 7fdc5ffff640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 0x7fdc680cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc6659c640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc580097c0 tx=0x7fdc580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58040070 con 0x7fdc680d10c0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58039cb0 con 0x7fdc680d10c0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc680cc720 con 0x7fdc680d10c0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58035040 con 0x7fdc680d10c0 2024-03-04T08:52:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.649+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc680ccce0 con 0x7fdc680d10c0 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.650+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6806eef0 con 0x7fdc680d10c0 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.650+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc5804b060 con 0x7fdc680d10c0 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.651+0000 7fdc5effd640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 0x7fdc4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.651+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fdc580abdb0 con 0x7fdc680d10c0 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.651+0000 7fdc5ffff640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 0x7fdc4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.651+0000 7fdc5ffff640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 0x7fdc4806d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc6806ff30 tx=0x7fdc50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.655+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdc6806eef0 con 0x7fdc680d10c0 2024-03-04T08:52:00.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.837+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc68068ff0 con 0x7fdc680d10c0 2024-03-04T08:52:00.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.837+0000 7fdc5effd640 1 -- 172.21.15.19:0/1891046648 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc5802f300 con 0x7fdc680d10c0 2024-03-04T08:52:00.833 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 msgr2=0x7fdc4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 0x7fdc4806d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc6806ff30 tx=0x7fdc50008040 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 msgr2=0x7fdc680cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc580097c0 tx=0x7fdc580046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 shutdown_connections 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc6815eb00 0x7fdc681f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdc4806b4d0 0x7fdc4806d990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc680d14a0 0x7fdc680cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 --2- 172.21.15.19:0/1891046648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc680d10c0 0x7fdc680cd7c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 >> 172.21.15.19:0/1891046648 conn(0x7fdc680b3800 msgr2=0x7fdc680b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 shutdown_connections 2024-03-04T08:52:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.839+0000 7fdc6cd13640 1 -- 172.21.15.19:0/1891046648 wait complete. 2024-03-04T08:52:00.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:52:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.955+0000 7fb11471e640 1 Processor -- start 2024-03-04T08:52:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.955+0000 7fb11471e640 1 -- start start 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb11471e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 0x7fb10c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb11471e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb10c06c9f0 0x7fb10c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb11471e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0b3320 con 0x7fb10c15a220 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb11471e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0cf610 con 0x7fb10c06c9f0 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb11471e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0728d0 con 0x7fb10c0719e0 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb10c06c9f0 0x7fb10c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb10c06c9f0 0x7fb10c06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55076/0 (socket says 172.21.15.19:55076) 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 -- 172.21.15.19:0/1061836633 learned_addr learned my addr 172.21.15.19:0/1061836633 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb1124ba640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb10c15a220 0x7fb10c0712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44210/0 (socket says 172.21.15.19:44210) 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb111cb9640 1 --2- 172.21.15.19:0/1061836633 >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 0x7fb10c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 -- 172.21.15.19:0/1061836633 >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 msgr2=0x7fb10c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 --2- 172.21.15.19:0/1061836633 >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 0x7fb10c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 -- 172.21.15.19:0/1061836633 >> v1:172.21.15.19:6789/0 conn(0x7fb10c15a220 legacy=0x7fb10c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb112cbb640 1 -- 172.21.15.19:0/1061836633 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0b3590 con 0x7fb10c06c9f0 2024-03-04T08:52:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb1114b8640 1 -- 172.21.15.19:0/1061836633 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877217440 0 0) 0x7fb10c0b3320 con 0x7fb10c15a220 2024-03-04T08:52:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.957+0000 7fb111cb9640 1 --2- 172.21.15.19:0/1061836633 >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 0x7fb10c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.958+0000 7fb112cbb640 1 --2- 172.21.15.19:0/1061836633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c06c9f0 0x7fb10c06ce40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0d0980 tx=0x7fb10402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c8cbc64e54f3fe server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.958+0000 7fb1114b8640 1 -- 172.21.15.19:0/1061836633 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10403b070 con 0x7fb10c06c9f0 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.958+0000 7fb1114b8640 1 -- 172.21.15.19:0/1061836633 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104036440 con 0x7fb10c06c9f0 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.958+0000 7fb1114b8640 1 -- 172.21.15.19:0/1061836633 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104036810 con 0x7fb10c06c9f0 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 -- 172.21.15.19:0/1061836633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c06c9f0 msgr2=0x7fb10c06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 --2- 172.21.15.19:0/1061836633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c06c9f0 0x7fb10c06ce40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0d0980 tx=0x7fb10402e0e0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 -- 172.21.15.19:0/1061836633 shutdown_connections 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 --2- 172.21.15.19:0/1061836633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c06c9f0 0x7fb10c06ce40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 --2- 172.21.15.19:0/1061836633 >> v2:172.21.15.204:3300/0 conn(0x7fb10c0719e0 0x7fb10c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 -- 172.21.15.19:0/1061836633 >> 172.21.15.19:0/1061836633 conn(0x7fb10c06b190 msgr2=0x7fb10c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 -- 172.21.15.19:0/1061836633 shutdown_connections 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.959+0000 7fb11471e640 1 -- 172.21.15.19:0/1061836633 wait complete. 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.960+0000 7fb11471e640 1 Processor -- start 2024-03-04T08:52:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.960+0000 7fb11471e640 1 -- start start 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 0x7fb10c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10c15a220 0x7fb10c0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c072530 con 0x7fb10c0719e0 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c072030 con 0x7fb10c06c9f0 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb11471e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0726b0 con 0x7fb10c15a220 2024-03-04T08:52:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55086/0 (socket says 172.21.15.19:55086) 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 -- 172.21.15.19:0/2176865871 learned_addr learned my addr 172.21.15.19:0/2176865871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb1124ba640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 0x7fb10c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 -- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10c15a220 msgr2=0x7fb10c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10c15a220 0x7fb10c0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 -- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 msgr2=0x7fb10c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 0x7fb10c0ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 -- 172.21.15.19:0/2176865871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0a96a0 con 0x7fb10c0719e0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb1124ba640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 0x7fb10c0ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.961+0000 7fb111cb9640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c820 tx=0x7fb10000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.962+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100015070 con 0x7fb10c0719e0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.962+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000079d0 con 0x7fb10c0719e0 2024-03-04T08:52:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.962+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c0a9980 con 0x7fb10c0719e0 2024-03-04T08:52:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.962+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100007da0 con 0x7fb10c0719e0 2024-03-04T08:52:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.962+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c0a9f40 con 0x7fb10c0719e0 2024-03-04T08:52:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.963+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c0732b0 con 0x7fb10c0719e0 2024-03-04T08:52:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.963+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb100018070 con 0x7fb10c0719e0 2024-03-04T08:52:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.963+0000 7fb10affd640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 0x7fb0f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.964+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb10008a300 con 0x7fb10c0719e0 2024-03-04T08:52:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.964+0000 7fb1124ba640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 0x7fb0f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.964+0000 7fb1124ba640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 0x7fb0f806d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:00.968+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb100058ff0 con 0x7fb10c0719e0 2024-03-04T08:52:01.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.151+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fb10c070ba0 con 0x7fb10c0719e0 2024-03-04T08:52:01.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.151+0000 7fb10affd640 1 -- 172.21.15.19:0/2176865871 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7fb1000588f0 con 0x7fb10c0719e0 2024-03-04T08:52:01.148 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 msgr2=0x7fb0f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 0x7fb0f806d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 msgr2=0x7fb10c157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c820 tx=0x7fb10000cc20 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 shutdown_connections 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb10c15a220 0x7fb10c0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb10c0719e0 0x7fb10c157040 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb0f806b4d0 0x7fb0f806d990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 --2- 172.21.15.19:0/2176865871 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb10c06c9f0 0x7fb10c0ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 >> 172.21.15.19:0/2176865871 conn(0x7fb10c06b190 msgr2=0x7fb10c0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 shutdown_connections 2024-03-04T08:52:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.153+0000 7fb11471e640 1 -- 172.21.15.19:0/2176865871 wait complete. 2024-03-04T08:52:01.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.293+0000 7f1bb3b81640 1 Processor -- start 2024-03-04T08:52:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.293+0000 7f1bb3b81640 1 -- start start 2024-03-04T08:52:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb3b81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bac145760 0x7f1bac0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb3b81640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 0x7f1bac0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb3b81640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac0cfff0 con 0x7f1bac06afb0 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb3b81640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac0cfd10 con 0x7f1bac145760 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb3b81640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac0cd580 con 0x7f1bac0cf270 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bac145760 0x7f1bac0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bac145760 0x7f1bac0ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55100/0 (socket says 172.21.15.19:55100) 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 -- 172.21.15.19:0/459554465 learned_addr learned my addr 172.21.15.19:0/459554465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb111c640 1 --2- 172.21.15.19:0/459554465 >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 0x7f1bac0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 -- 172.21.15.19:0/459554465 >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 msgr2=0x7f1bac0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 --2- 172.21.15.19:0/459554465 >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 0x7f1bac0cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 -- 172.21.15.19:0/459554465 >> v1:172.21.15.204:6789/0 conn(0x7f1bac06afb0 legacy=0x7f1bac06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb191d640 1 -- 172.21.15.19:0/459554465 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0cd860 con 0x7f1bac145760 2024-03-04T08:52:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.294+0000 7f1bb111c640 1 --2- 172.21.15.19:0/459554465 >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 0x7f1bac0cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb191d640 1 --2- 172.21.15.19:0/459554465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac0ce060 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0ceeb0 tx=0x7f1b9c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcf0929838b418d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb091b640 1 -- 172.21.15.19:0/459554465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c02c9f0 con 0x7f1bac145760 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb091b640 1 -- 172.21.15.19:0/459554465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c02cb90 con 0x7f1bac145760 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb091b640 1 -- 172.21.15.19:0/459554465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0343f0 con 0x7f1bac145760 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 -- 172.21.15.19:0/459554465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 msgr2=0x7f1bac0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/459554465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac0ce060 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0ceeb0 tx=0x7f1b9c02be50 comp rx=0 tx=0).stop 2024-03-04T08:52:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 -- 172.21.15.19:0/459554465 shutdown_connections 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/459554465 >> v2:172.21.15.204:3300/0 conn(0x7f1bac0cf270 0x7f1bac0cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/459554465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac0ce060 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.295+0000 7f1bb3b81640 1 -- 172.21.15.19:0/459554465 >> 172.21.15.19:0/459554465 conn(0x7f1bac0d09d0 msgr2=0x7f1bac0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.296+0000 7f1bb3b81640 1 -- 172.21.15.19:0/459554465 shutdown_connections 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.296+0000 7f1bb3b81640 1 -- 172.21.15.19:0/459554465 wait complete. 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.297+0000 7f1bb3b81640 1 Processor -- start 2024-03-04T08:52:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.297+0000 7f1bb3b81640 1 -- start start 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.297+0000 7f1bb3b81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bac06afb0 0x7f1bac13c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 0x7f1bac1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0719e0 con 0x7f1bac145760 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac15d1e0 con 0x7f1bac06afb0 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac071b60 con 0x7f1bac0cf270 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55104/0 (socket says 172.21.15.19:55104) 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 -- 172.21.15.19:0/3848383518 learned_addr learned my addr 172.21.15.19:0/3848383518 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb191d640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bac06afb0 0x7f1bac13c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb111c640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 0x7f1bac1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 -- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 msgr2=0x7f1bac1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 0x7f1bac1446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 -- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bac06afb0 msgr2=0x7f1bac13c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bac06afb0 0x7f1bac13c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 -- 172.21.15.19:0/3848383518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac1417e0 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb111c640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 0x7f1bac1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb211e640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c410 tx=0x7f1ba400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4011790 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4017070 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac141ac0 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4011bb0 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.298+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac1441c0 con 0x7f1bac145760 2024-03-04T08:52:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.299+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac143cf0 con 0x7f1bac145760 2024-03-04T08:52:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.300+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ba401c460 con 0x7f1bac145760 2024-03-04T08:52:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.301+0000 7f1baa7fc640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 0x7f1b9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.301+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f1ba4089f40 con 0x7f1bac145760 2024-03-04T08:52:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.301+0000 7f1bb191d640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 0x7f1b9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:01.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.302+0000 7f1bb191d640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 0x7f1b9806d9c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c035000 tx=0x7f1b9c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:01.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.305+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1ba4021020 con 0x7f1bac145760 2024-03-04T08:52:01.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.498+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1bac04f330 con 0x7f1bac145760 2024-03-04T08:52:01.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.499+0000 7f1baa7fc640 1 -- 172.21.15.19:0/3848383518 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1ba4058c30 con 0x7f1bac145760 2024-03-04T08:52:01.495 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:01.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 msgr2=0x7f1b9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 0x7f1b9806d9c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c035000 tx=0x7f1b9c030000 comp rx=0 tx=0).stop 2024-03-04T08:52:01.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 msgr2=0x7f1bac156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c410 tx=0x7f1ba400c8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 shutdown_connections 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bac145760 0x7f1bac156610 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1bac0cf270 0x7f1bac1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1b9806b500 0x7f1b9806d9c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 --2- 172.21.15.19:0/3848383518 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1bac06afb0 0x7f1bac13c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 >> 172.21.15.19:0/3848383518 conn(0x7f1bac0d09d0 msgr2=0x7f1bac0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 shutdown_connections 2024-03-04T08:52:01.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:01.501+0000 7f1bb3b81640 1 -- 172.21.15.19:0/3848383518 wait complete. 2024-03-04T08:52:01.508 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:52:01.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:01.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:01.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[53327]: fuse finished with error 0 and tester_r 0 2024-03-04T08:52:01.535 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:07.636 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:07.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:07.637 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:07.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-03-04T08:52:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.804+0000 7f1279181640 1 Processor -- start 2024-03-04T08:52:07.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.804+0000 7f1279181640 1 -- start start 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.805+0000 7f1279181640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f127406fd10 0x7f12740cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.805+0000 7f1279181640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12740cd4b0 con 0x7f12740d0af0 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f1279181640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12740cd790 con 0x7f127415c050 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f1279181640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12740cda70 con 0x7f127406fd10 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f127406fd10 0x7f12740cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127359e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f12740d0af0 0x7f12740ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45748/0 (socket says 172.21.15.19:45748) 2024-03-04T08:52:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127359e640 1 -- 172.21.15.19:0/1552168424 learned_addr learned my addr 172.21.15.19:0/1552168424 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:07.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127259c640 1 -- 172.21.15.19:0/1552168424 >> v1:172.21.15.204:6789/0 conn(0x7f127415c050 legacy=0x7f127406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:07.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127259c640 1 -- 172.21.15.19:0/1552168424 >> v1:172.21.15.19:6789/0 conn(0x7f12740d0af0 legacy=0x7f12740ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:07.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.806+0000 7f127259c640 1 -- 172.21.15.19:0/1552168424 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740cdd50 con 0x7f127406fd10 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f127259c640 1 --2- 172.21.15.19:0/1552168424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f127406fd10 0x7f12740cc760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f12680097a0 tx=0x7f126802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df63bf331db01505 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1271d9b640 1 -- 172.21.15.19:0/1552168424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680315a0 con 0x7f127406fd10 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1271d9b640 1 -- 172.21.15.19:0/1552168424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f127406fd10 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1271d9b640 1 -- 172.21.15.19:0/1552168424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268031960 con 0x7f127406fd10 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 -- 172.21.15.19:0/1552168424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f127406fd10 msgr2=0x7f12740cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 --2- 172.21.15.19:0/1552168424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f127406fd10 0x7f12740cc760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f12680097a0 tx=0x7f126802b840 comp rx=0 tx=0).stop 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 -- 172.21.15.19:0/1552168424 shutdown_connections 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 --2- 172.21.15.19:0/1552168424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f127406fd10 0x7f12740cc760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 -- 172.21.15.19:0/1552168424 >> 172.21.15.19:0/1552168424 conn(0x7f12740b3800 msgr2=0x7f12740b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 -- 172.21.15.19:0/1552168424 shutdown_connections 2024-03-04T08:52:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.807+0000 7f1279181640 1 -- 172.21.15.19:0/1552168424 wait complete. 2024-03-04T08:52:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.810+0000 7f1279181640 1 Processor -- start 2024-03-04T08:52:07.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.810+0000 7f1279181640 1 -- start start 2024-03-04T08:52:07.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f127406fd10 0x7f1274154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f127415c050 0x7f12741435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274166e50 con 0x7f12740d0af0 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274166cd0 con 0x7f127415c050 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1279181640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1274166fd0 con 0x7f127406fd10 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36362/0 (socket says 172.21.15.19:36362) 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 -- 172.21.15.19:0/1253797630 learned_addr learned my addr 172.21.15.19:0/1253797630 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127359e640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f127415c050 0x7f12741435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f1272d9d640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f127406fd10 0x7f1274154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 -- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f127406fd10 msgr2=0x7f1274154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f127406fd10 0x7f1274154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 -- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f127415c050 msgr2=0x7f12741435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f127415c050 0x7f12741435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 -- 172.21.15.19:0/1253797630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12741587a0 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.811+0000 7f127259c640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1268034040 tx=0x7f12680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.812+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268032840 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.812+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268032a00 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.812+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268032df0 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.812+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1274158a80 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.812+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1274159040 con 0x7f12740d0af0 2024-03-04T08:52:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.813+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127409fe60 con 0x7f12740d0af0 2024-03-04T08:52:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.813+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f126804d3f0 con 0x7f12740d0af0 2024-03-04T08:52:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.813+0000 7f125b7fe640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 0x7f126006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.814+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f126802f030 con 0x7f12740d0af0 2024-03-04T08:52:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.814+0000 7f1272d9d640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 0x7f126006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:07.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.814+0000 7f1272d9d640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 0x7f126006d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1264005520 tx=0x7f1264009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:07.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:07.818+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1268040070 con 0x7f12740d0af0 2024-03-04T08:52:08.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.069+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f1274068ff0 con 0x7f12740d0af0 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.071+0000 7f125b7fe640 1 -- 172.21.15.19:0/1253797630 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+168 (secure 0 0 0) 0x7f126807a710 con 0x7f12740d0af0 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow rwp" 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:08.067 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-03-04T08:52:08.068 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 msgr2=0x7f126006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 0x7f126006d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1264005520 tx=0x7f1264009040 comp rx=0 tx=0).stop 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 msgr2=0x7f1274143070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1268034040 tx=0x7f12680046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 shutdown_connections 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f126006b4d0 0x7f126006d990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f127415c050 0x7f12741435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12740d0af0 0x7f1274143070 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 --2- 172.21.15.19:0/1253797630 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f127406fd10 0x7f1274154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 >> 172.21.15.19:0/1253797630 conn(0x7f12740b3800 msgr2=0x7f1274157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 shutdown_connections 2024-03-04T08:52:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.073+0000 7f1279181640 1 -- 172.21.15.19:0/1253797630 wait complete. 2024-03-04T08:52:08.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:52:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.185+0000 7f9e1257a640 1 Processor -- start 2024-03-04T08:52:08.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.185+0000 7f9e1257a640 1 -- start start 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 0x7f9e0c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15e850 0x7f9e0c15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0cf3f0 con 0x7f9e0c15bf30 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c15b210 con 0x7f9e0c13dc10 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e1257a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15f580 con 0x7f9e0c15e850 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e0b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e0b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36364/0 (socket says 172.21.15.19:36364) 2024-03-04T08:52:08.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.186+0000 7f9e0b7fe640 1 -- 172.21.15.19:0/3792175433 learned_addr learned my addr 172.21.15.19:0/3792175433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0bfff640 1 --2- 172.21.15.19:0/3792175433 >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 0x7f9e0c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e10b17640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15e850 0x7f9e0c15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 -- 172.21.15.19:0/3792175433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15e850 msgr2=0x7f9e0c15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15e850 0x7f9e0c15eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 -- 172.21.15.19:0/3792175433 >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 msgr2=0x7f9e0c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/3792175433 >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 0x7f9e0c0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 -- 172.21.15.19:0/3792175433 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c15b450 con 0x7f9e0c15bf30 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0bfff640 1 --2- 172.21.15.19:0/3792175433 >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 0x7f9e0c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:08.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.187+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0731a0 tx=0x7f9e0002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72f9956ef3d34f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e0affd640 1 -- 172.21.15.19:0/3792175433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0002e070 con 0x7f9e0c15bf30 2024-03-04T08:52:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e0affd640 1 -- 172.21.15.19:0/3792175433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00037070 con 0x7f9e0c15bf30 2024-03-04T08:52:08.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e0affd640 1 -- 172.21.15.19:0/3792175433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00031a00 con 0x7f9e0c15bf30 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 -- 172.21.15.19:0/3792175433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c15bf30 msgr2=0x7f9e0c0b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0731a0 tx=0x7f9e0002b880 comp rx=0 tx=0).stop 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 -- 172.21.15.19:0/3792175433 shutdown_connections 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15e850 0x7f9e0c15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 --2- 172.21.15.19:0/3792175433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c15bf30 0x7f9e0c0b2e90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 --2- 172.21.15.19:0/3792175433 >> v2:172.21.15.204:3300/0 conn(0x7f9e0c13dc10 0x7f9e0c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 -- 172.21.15.19:0/3792175433 >> 172.21.15.19:0/3792175433 conn(0x7f9e0c0cf8a0 msgr2=0x7f9e0c0cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 -- 172.21.15.19:0/3792175433 shutdown_connections 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.188+0000 7f9e1257a640 1 -- 172.21.15.19:0/3792175433 wait complete. 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.189+0000 7f9e1257a640 1 Processor -- start 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 -- start start 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 0x7f9e0c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 0x7f9e0c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15f1e0 con 0x7f9e0c13dc10 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c13dff0 con 0x7f9e0c15e850 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e1257a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c15f360 con 0x7f9e0c15bf30 2024-03-04T08:52:08.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.190+0000 7f9e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36374/0 (socket says 172.21.15.19:36374) 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 -- 172.21.15.19:0/2342126562 learned_addr learned my addr 172.21.15.19:0/2342126562 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 0x7f9e0c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e10b17640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 0x7f9e0c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 -- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 msgr2=0x7f9e0c141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 0x7f9e0c141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 -- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 msgr2=0x7f9e0c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 0x7f9e0c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 -- 172.21.15.19:0/2342126562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c1f6370 con 0x7f9e0c13dc10 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e10b17640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 0x7f9e0c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 0x7f9e0c141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e0bfff640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d800 tx=0x7f9dfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:08.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc018070 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc004030 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c1f57f0 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc004400 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.191+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1f5db0 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.192+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c04f330 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.193+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9dfc0096a0 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.193+0000 7f9e08ff9640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 0x7f9df806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.193+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f9dfc08a660 con 0x7f9e0c13dc10 2024-03-04T08:52:08.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.193+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 0x7f9df806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:08.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.194+0000 7f9e0b7fe640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 0x7f9df806d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e00036000 tx=0x7f9e0003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:08.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.198+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9dfc0593e0 con 0x7f9e0c13dc10 2024-03-04T08:52:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.420+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e0c141d00 con 0x7f9e0c13dc10 2024-03-04T08:52:08.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.421+0000 7f9e08ff9640 1 -- 172.21.15.19:0/2342126562 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+82 (secure 0 0 0) 0x7f9dfc088e20 con 0x7f9e0c13dc10 2024-03-04T08:52:08.417 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-03-04T08:52:08.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 msgr2=0x7f9df806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 0x7f9df806d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e00036000 tx=0x7f9e0003d040 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 msgr2=0x7f9e0c13a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d800 tx=0x7f9dfc00dcc0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 shutdown_connections 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9df806b4d0 0x7f9df806d990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9e0c15e850 0x7f9e0c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9e0c15bf30 0x7f9e0c141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 --2- 172.21.15.19:0/2342126562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e0c13dc10 0x7f9e0c13a500 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 >> 172.21.15.19:0/2342126562 conn(0x7f9e0c0cf8a0 msgr2=0x7f9e0c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 shutdown_connections 2024-03-04T08:52:08.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:08.423+0000 7f9e1257a640 1 -- 172.21.15.19:0/2342126562 wait complete. 2024-03-04T08:52:08.430 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:52:08.430 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:52:08.430 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:52:08.430 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:52:08.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:08.431 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:52:08.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:52:08.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:52:08.431 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:08.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.431 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:52:08.448 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42566sec preferred_lft 42566sec 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:08.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.450 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:52:08.513 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:52:08.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.515 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:52:08.569 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:52:08.570 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:52:08.570 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:52:08.570 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:52:08.570 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:52:08.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:52:08.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.665 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:52:08.678 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:52:08.679 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:52:08.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:08.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:52:08.746 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:52:08.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:08.746 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:08.800 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:08.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:08.800 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:08.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:08.924 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:08.978 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:08.979 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:08.980 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:08.981 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:08.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:08.981 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:09.035 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:52:09.036 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:52:09.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:09.106 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:09.162 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:09.163 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:09.164 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:09.165 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:09.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.166 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:09.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:52:09.169+0000 7f2d2c064480 -1 init, newargv = 0x55c9683d4780 newargc=15 2024-03-04T08:52:09.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[54390]: starting ceph client 2024-03-04T08:52:09.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[54390]: starting fuse 2024-03-04T08:52:09.182 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:52:09.182 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:09.182 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:52:09.183 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:52:09.184 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:52:09.184 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:52:09.184 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:09.184 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:52:09.184 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.54390.asok 2024-03-04T08:52:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:52:09.315 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54390.asok 2024-03-04T08:52:09.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54390.asok status 2024-03-04T08:52:09.452 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "54390", 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5700, 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:52:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 5700 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4199013435 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 4199013435 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.5700 192.168.0.1:0/4199013435", 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/4199013435", 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 14, 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 37, 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:52:09.455 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:09.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.461 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:52:09.461 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:09.476 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:52:09.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:09.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.476 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:09.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.542 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-03-04T08:52:09.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-03-04T08:52:09.656 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:09.656 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:09.711 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.858+0000 7fa2e3de2640 1 Processor -- start 2024-03-04T08:52:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 -- start start 2024-03-04T08:52:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15ac70 0x7fa2dc0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa2dc15e650 0x7fa2dc15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc06b170 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc06ec60 con 0x7fa2dc15e650 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e3de2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06efb0 con 0x7fa2dc15ac70 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e137d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.859+0000 7fa2e137d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36376/0 (socket says 172.21.15.19:36376) 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 -- 172.21.15.19:0/2329818260 learned_addr learned my addr 172.21.15.19:0/2329818260 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e237f640 1 --2- 172.21.15.19:0/2329818260 >> v2:172.21.15.204:3300/0 conn(0x7fa2dc15e650 0x7fa2dc15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e1b7e640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15ac70 0x7fa2dc0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 -- 172.21.15.19:0/2329818260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15ac70 msgr2=0x7fa2dc0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15ac70 0x7fa2dc0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 -- 172.21.15.19:0/2329818260 >> v2:172.21.15.204:3300/0 conn(0x7fa2dc15e650 msgr2=0x7fa2dc15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 --2- 172.21.15.19:0/2329818260 >> v2:172.21.15.204:3300/0 conn(0x7fa2dc15e650 0x7fa2dc15eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.860+0000 7fa2e137d640 1 -- 172.21.15.19:0/2329818260 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc06e6e0 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.861+0000 7fa2e137d640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0b2d10 tx=0x7fa2cc02dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d689798e5fb04e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.861+0000 7fa2e0b7c640 1 -- 172.21.15.19:0/2329818260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc03b070 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.861+0000 7fa2e0b7c640 1 -- 172.21.15.19:0/2329818260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc02ed70 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.861+0000 7fa2e0b7c640 1 -- 172.21.15.19:0/2329818260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc036660 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 -- 172.21.15.19:0/2329818260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 msgr2=0x7fa2dc0ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0b2d10 tx=0x7fa2cc02dfc0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 -- 172.21.15.19:0/2329818260 shutdown_connections 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/2329818260 >> v2:172.21.15.204:3300/0 conn(0x7fa2dc15e650 0x7fa2dc15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc0ce1f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/2329818260 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15ac70 0x7fa2dc0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 -- 172.21.15.19:0/2329818260 >> 172.21.15.19:0/2329818260 conn(0x7fa2dc0d00e0 msgr2=0x7fa2dc0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 -- 172.21.15.19:0/2329818260 shutdown_connections 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.862+0000 7fa2e3de2640 1 -- 172.21.15.19:0/2329818260 wait complete. 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.863+0000 7fa2e3de2640 1 Processor -- start 2024-03-04T08:52:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.863+0000 7fa2e3de2640 1 -- start start 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2dc15ac70 0x7fa2dc1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15e650 0x7fa2dc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06e910 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06e400 con 0x7fa2dc15ac70 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc09dec0 con 0x7fa2dc15e650 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36386/0 (socket says 172.21.15.19:36386) 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 -- 172.21.15.19:0/960179614 learned_addr learned my addr 172.21.15.19:0/960179614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 -- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15e650 msgr2=0x7fa2dc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15e650 0x7fa2dc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 -- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2dc15ac70 msgr2=0x7fa2dc1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2dc15ac70 0x7fa2dc1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 -- 172.21.15.19:0/960179614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc09b7c0 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e1b7e640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d830 tx=0x7fa2d800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8018020 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009620 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc09baa0 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80099f0 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.864+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc09c060 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.865+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc04f330 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.866+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa2d801b020 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.866+0000 7fa2d27fc640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 0x7fa2c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.866+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa2d808a5b0 con 0x7fa2dc06d0d0 2024-03-04T08:52:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.867+0000 7fa2e137d640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 0x7fa2c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.867+0000 7fa2e137d640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 0x7fa2c006d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc038000 tx=0x7fa2cc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:09.872+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa2d8022030 con 0x7fa2dc06d0d0 2024-03-04T08:52:10.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.056+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2dc0b5fa0 con 0x7fa2dc06d0d0 2024-03-04T08:52:10.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.058+0000 7fa2d27fc640 1 -- 172.21.15.19:0/960179614 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fa2d80592a0 con 0x7fa2dc06d0d0 2024-03-04T08:52:10.053 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:10.054 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 msgr2=0x7fa2c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 0x7fa2c006d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc038000 tx=0x7fa2cc030000 comp rx=0 tx=0).stop 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 msgr2=0x7fa2dc09c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d830 tx=0x7fa2d800dcf0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 shutdown_connections 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa2dc15e650 0x7fa2dc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa2c006b4d0 0x7fa2c006d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa2dc15ac70 0x7fa2dc1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 --2- 172.21.15.19:0/960179614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d0d0 0x7fa2dc09c860 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 >> 172.21.15.19:0/960179614 conn(0x7fa2dc0d00e0 msgr2=0x7fa2dc0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 shutdown_connections 2024-03-04T08:52:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.060+0000 7fa2e3de2640 1 -- 172.21.15.19:0/960179614 wait complete. 2024-03-04T08:52:10.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:10.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.176+0000 7fbabb278640 1 Processor -- start 2024-03-04T08:52:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbabb278640 1 -- start start 2024-03-04T08:52:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbabb278640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbab406cab0 0x7fbab40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbabb278640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab406d030 con 0x7fbab40cea50 2024-03-04T08:52:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbabb278640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab406d310 con 0x7fbab415def0 2024-03-04T08:52:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbabb278640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab40cf1c0 con 0x7fbab406cab0 2024-03-04T08:52:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbab9815640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbab406cab0 0x7fbab40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbab9815640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbab406cab0 0x7fbab40b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36394/0 (socket says 172.21.15.19:36394) 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbab8813640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbab40cea50 0x7fbab40ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45750/0 (socket says 172.21.15.19:45750) 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.177+0000 7fbab9815640 1 -- 172.21.15.19:0/3988615515 learned_addr learned my addr 172.21.15.19:0/3988615515 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.178+0000 7fbab9815640 1 -- 172.21.15.19:0/3988615515 >> v1:172.21.15.204:6789/0 conn(0x7fbab415def0 legacy=0x7fbab40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.178+0000 7fbab9815640 1 -- 172.21.15.19:0/3988615515 >> v1:172.21.15.19:6789/0 conn(0x7fbab40cea50 legacy=0x7fbab40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.178+0000 7fbab9815640 1 -- 172.21.15.19:0/3988615515 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40cc110 con 0x7fbab406cab0 2024-03-04T08:52:10.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.178+0000 7fbab9815640 1 --2- 172.21.15.19:0/3988615515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab406cab0 0x7fbab40b41b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009870 tx=0x7fbaac02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55bbfa53f9a9218 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbab3fff640 1 -- 172.21.15.19:0/3988615515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac02f840 con 0x7fbab406cab0 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbab3fff640 1 -- 172.21.15.19:0/3988615515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac02f9e0 con 0x7fbab406cab0 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbab3fff640 1 -- 172.21.15.19:0/3988615515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac02fdb0 con 0x7fbab406cab0 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 -- 172.21.15.19:0/3988615515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab406cab0 msgr2=0x7fbab40b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 --2- 172.21.15.19:0/3988615515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab406cab0 0x7fbab40b41b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009870 tx=0x7fbaac02ba20 comp rx=0 tx=0).stop 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 -- 172.21.15.19:0/3988615515 shutdown_connections 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 --2- 172.21.15.19:0/3988615515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab406cab0 0x7fbab40b41b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 -- 172.21.15.19:0/3988615515 >> 172.21.15.19:0/3988615515 conn(0x7fbab40b3690 msgr2=0x7fbab40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 -- 172.21.15.19:0/3988615515 shutdown_connections 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.179+0000 7fbabb278640 1 -- 172.21.15.19:0/3988615515 wait complete. 2024-03-04T08:52:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.180+0000 7fbabb278640 1 Processor -- start 2024-03-04T08:52:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.180+0000 7fbabb278640 1 -- start start 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 0x7fbab41f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbab40cea50 0x7fbab40b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab415e2d0 con 0x7fbab415def0 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40cc760 con 0x7fbab40cea50 2024-03-04T08:52:10.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbabb278640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab415e450 con 0x7fbab406cab0 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbab9815640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbab9815640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36396/0 (socket says 172.21.15.19:36396) 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbab9815640 1 -- 172.21.15.19:0/2794439077 learned_addr learned my addr 172.21.15.19:0/2794439077 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbab8813640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbab40cea50 0x7fbab40b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.181+0000 7fbab9014640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 0x7fbab41f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 -- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 msgr2=0x7fbab41f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 0x7fbab41f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 -- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbab40cea50 msgr2=0x7fbab40b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbab40cea50 0x7fbab40b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 -- 172.21.15.19:0/2794439077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40b6450 con 0x7fbab415def0 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9014640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 0x7fbab41f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab9815640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009870 tx=0x7fbaac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac041400 con 0x7fbab415def0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac046070 con 0x7fbab415def0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab40c5d30 con 0x7fbab415def0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac041800 con 0x7fbab415def0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.182+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab40c62f0 con 0x7fbab415def0 2024-03-04T08:52:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.183+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab409fcf0 con 0x7fbab415def0 2024-03-04T08:52:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.184+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbaac040070 con 0x7fbab415def0 2024-03-04T08:52:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.184+0000 7fbab1ffb640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 0x7fbaa006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.184+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbaac0acbc0 con 0x7fbab415def0 2024-03-04T08:52:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.184+0000 7fbab9014640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 0x7fbaa006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.185+0000 7fbab9014640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 0x7fbaa006d9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001cd0 tx=0x7fbaa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.188+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbaac033030 con 0x7fbab415def0 2024-03-04T08:52:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.368+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbab4068ff0 con 0x7fbab415def0 2024-03-04T08:52:10.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.368+0000 7fbab1ffb640 1 -- 172.21.15.19:0/2794439077 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbaac07b8b0 con 0x7fbab415def0 2024-03-04T08:52:10.363 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 msgr2=0x7fbaa006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 0x7fbaa006d9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001cd0 tx=0x7fbaa4009040 comp rx=0 tx=0).stop 2024-03-04T08:52:10.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 msgr2=0x7fbab40b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009870 tx=0x7fbaac004730 comp rx=0 tx=0).stop 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 shutdown_connections 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbab415def0 0x7fbab40b5ac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbaa006b500 0x7fbaa006d9c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbab40cea50 0x7fbab40b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 --2- 172.21.15.19:0/2794439077 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbab406cab0 0x7fbab41f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 >> 172.21.15.19:0/2794439077 conn(0x7fbab40b3690 msgr2=0x7fbab40d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 shutdown_connections 2024-03-04T08:52:10.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.371+0000 7fbabb278640 1 -- 172.21.15.19:0/2794439077 wait complete. 2024-03-04T08:52:10.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:10.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.488+0000 7fa954464640 1 Processor -- start 2024-03-04T08:52:10.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.489+0000 7fa954464640 1 -- start start 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.489+0000 7fa954464640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 0x7fa94c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.489+0000 7fa954464640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0cd4b0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.489+0000 7fa954464640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0cd790 con 0x7fa94c15c050 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.489+0000 7fa954464640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0cda70 con 0x7fa94c06fd10 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa952a01640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa94c0d0af0 0x7fa94c0ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45756/0 (socket says 172.21.15.19:45756) 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa952a01640 1 -- 172.21.15.19:0/857872957 learned_addr learned my addr 172.21.15.19:0/857872957 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:10.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9519ff640 1 --2- 172.21.15.19:0/857872957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 0x7fa94c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550123752 0 0) 0x7fa94c0cd4b0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa938003520 con 0x7fa94c0d0af0 2024-03-04T08:52:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647681433 0 0) 0x7fa94c0cd790 con 0x7fa94c15c050 2024-03-04T08:52:10.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c0cd4b0 con 0x7fa94c15c050 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9519ff640 1 -- 172.21.15.19:0/857872957 >> v1:172.21.15.204:6789/0 conn(0x7fa94c15c050 legacy=0x7fa94c06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9519ff640 1 -- 172.21.15.19:0/857872957 >> v1:172.21.15.19:6789/0 conn(0x7fa94c0d0af0 legacy=0x7fa94c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.490+0000 7fa9519ff640 1 -- 172.21.15.19:0/857872957 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0cdd50 con 0x7fa94c06fd10 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.491+0000 7fa9519ff640 1 --2- 172.21.15.19:0/857872957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 0x7fa94c0cc760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097d0 tx=0x7fa94002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0658496d038232 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.491+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940035020 con 0x7fa94c06fd10 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.491+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940031800 con 0x7fa94c06fd10 2024-03-04T08:52:10.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.491+0000 7fa9511fe640 1 -- 172.21.15.19:0/857872957 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940031bb0 con 0x7fa94c06fd10 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 -- 172.21.15.19:0/857872957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 msgr2=0x7fa94c0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 --2- 172.21.15.19:0/857872957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 0x7fa94c0cc760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097d0 tx=0x7fa94002b8a0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 -- 172.21.15.19:0/857872957 shutdown_connections 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 --2- 172.21.15.19:0/857872957 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c06fd10 0x7fa94c0cc760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 -- 172.21.15.19:0/857872957 >> 172.21.15.19:0/857872957 conn(0x7fa94c0b3800 msgr2=0x7fa94c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 -- 172.21.15.19:0/857872957 shutdown_connections 2024-03-04T08:52:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.492+0000 7fa954464640 1 -- 172.21.15.19:0/857872957 wait complete. 2024-03-04T08:52:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.494+0000 7fa954464640 1 Processor -- start 2024-03-04T08:52:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.494+0000 7fa954464640 1 -- start start 2024-03-04T08:52:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa94c06fd10 0x7fa94c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 0x7fa94c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c166e50 con 0x7fa94c0d0af0 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c166cd0 con 0x7fa94c06fd10 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa954464640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c166fd0 con 0x7fa94c15c050 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa9519ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa9519ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36408/0 (socket says 172.21.15.19:36408) 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa9519ff640 1 -- 172.21.15.19:0/2691917351 learned_addr learned my addr 172.21.15.19:0/2691917351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa952200640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa94c06fd10 0x7fa94c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.495+0000 7fa952a01640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 0x7fa94c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 -- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 msgr2=0x7fa94c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 0x7fa94c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 -- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa94c06fd10 msgr2=0x7fa94c14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa94c06fd10 0x7fa94c14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 -- 172.21.15.19:0/2691917351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c152950 con 0x7fa94c0d0af0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa952a01640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 0x7fa94c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa9519ff640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa940034040 tx=0x7fa9400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940035040 con 0x7fa94c0d0af0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940039cf0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940039ea0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c152bc0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.496+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c153180 con 0x7fa94c0d0af0 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.497+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c0cc340 con 0x7fa94c0d0af0 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.498+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa940038020 con 0x7fa94c0d0af0 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.498+0000 7fa93effd640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 0x7fa93006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.498+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa9400ac3a0 con 0x7fa94c0d0af0 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.498+0000 7fa952200640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 0x7fa93006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.499+0000 7fa952200640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 0x7fa93006d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa948007fd0 tx=0x7fa948009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.502+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa94c0cc340 con 0x7fa94c0d0af0 2024-03-04T08:52:10.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.681+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa94c09fe60 con 0x7fa94c0d0af0 2024-03-04T08:52:10.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.682+0000 7fa93effd640 1 -- 172.21.15.19:0/2691917351 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa94007b090 con 0x7fa94c0d0af0 2024-03-04T08:52:10.678 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 msgr2=0x7fa93006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 0x7fa93006d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa948007fd0 tx=0x7fa948009040 comp rx=0 tx=0).stop 2024-03-04T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 msgr2=0x7fa94c157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa940034040 tx=0x7fa9400046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 shutdown_connections 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa94c15c050 0x7fa94c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94c0d0af0 0x7fa94c157af0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa93006b4d0 0x7fa93006d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 --2- 172.21.15.19:0/2691917351 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa94c06fd10 0x7fa94c14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 >> 172.21.15.19:0/2691917351 conn(0x7fa94c0b3800 msgr2=0x7fa94c0cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 shutdown_connections 2024-03-04T08:52:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.684+0000 7fa954464640 1 -- 172.21.15.19:0/2691917351 wait complete. 2024-03-04T08:52:10.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:10.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.802+0000 7ffbe24c9640 1 Processor -- start 2024-03-04T08:52:10.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.802+0000 7ffbe24c9640 1 -- start start 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe24c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffbdc0d06e0 0x7ffbdc15fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe24c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbdc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe24c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0d47f0 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe24c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0ced70 con 0x7ffbdc0d06e0 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe24c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0d1ab0 con 0x7ffbdc0d0ac0 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe0a66640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffbdc0b4d10 0x7ffbdc0cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45770/0 (socket says 172.21.15.19:45770) 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3373187950 learned_addr learned my addr 172.21.15.19:0/3373187950 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3373187950 >> v2:172.21.15.204:3300/0 conn(0x7ffbdc0d06e0 0x7ffbdc15fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdb7fe640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbdc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329640619 0 0) 0x7ffbdc0d47f0 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc4003520 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823792335 0 0) 0x7ffbc4003520 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 msgr2=0x7ffbdc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbdc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 >> v2:172.21.15.204:3300/0 conn(0x7ffbdc0d06e0 msgr2=0x7ffbdc15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 --2- 172.21.15.19:0/3373187950 >> v2:172.21.15.204:3300/0 conn(0x7ffbdc0d06e0 0x7ffbdc15fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0d1d90 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7ffbd40019f0 con 0x7ffbdc0b4d10 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 >> v1:172.21.15.19:6789/0 conn(0x7ffbdc0b4d10 legacy=0x7ffbdc0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc40039b0 0x7ffbc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc4004800 0x7ffbc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0ced70 con 0x7ffbc40039b0 2024-03-04T08:52:10.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0d1ab0 con 0x7ffbc4004800 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.803+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc400b9c0 con 0x7ffbdc0d0ac0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc40039b0 0x7ffbc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbe0a66640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdb7fe640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc4004800 0x7ffbc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 -- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 msgr2=0x7ffbc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0d0ac0 0x7ffbc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 -- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc4004800 msgr2=0x7ffbc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc4004800 0x7ffbc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 -- 172.21.15.19:0/3373187950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4003520 con 0x7ffbc40039b0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.804+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc40039b0 0x7ffbc4003dd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009ac0 tx=0x7ffbc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a11d29c0814c0a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc039070 con 0x7ffbc40039b0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc02c710 con 0x7ffbc40039b0 2024-03-04T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbdaffd640 1 -- 172.21.15.19:0/3373187950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc009690 con 0x7ffbc40039b0 2024-03-04T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3373187950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc40039b0 msgr2=0x7ffbc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3373187950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc40039b0 0x7ffbc4003dd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009ac0 tx=0x7ffbc4005830 comp rx=0 tx=0).stop 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3373187950 reap_dead start 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3373187950 shutdown_connections 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3373187950 >> 172.21.15.19:0/3373187950 conn(0x7ffbdc0d3cd0 msgr2=0x7ffbdc0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3373187950 shutdown_connections 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.805+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3373187950 wait complete. 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.807+0000 7ffbe24c9640 1 Processor -- start 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.807+0000 7ffbe24c9640 1 -- start start 2024-03-04T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40039b0 0x7ffbdc0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0b7b00 0x7ffbdc150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0b44d0 con 0x7ffbdc1512c0 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0ce990 con 0x7ffbc40039b0 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe24c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0d0f00 con 0x7ffbdc0b7b00 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe0a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe0a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36422/0 (socket says 172.21.15.19:36422) 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3783291413 learned_addr learned my addr 172.21.15.19:0/3783291413 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40039b0 0x7ffbdc0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.808+0000 7ffbdb7fe640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0b7b00 0x7ffbdc150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0b7b00 msgr2=0x7ffbdc150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0b7b00 0x7ffbdc150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40039b0 msgr2=0x7ffbdc0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40039b0 0x7ffbdc0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 -- 172.21.15.19:0/3783291413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0cd960 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe0a66640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4002230 tx=0x7ffbd400a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4007970 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4018070 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc151740 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4013630 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.809+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0b7300 con 0x7ffbdc1512c0 2024-03-04T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.810+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc0a1c80 con 0x7ffbdc1512c0 2024-03-04T08:52:10.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.811+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffbd40137d0 con 0x7ffbdc1512c0 2024-03-04T08:52:10.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.811+0000 7ffbd8ff9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 0x7ffbc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:10.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.811+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ffbd408a9c0 con 0x7ffbdc1512c0 2024-03-04T08:52:10.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.811+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 0x7ffbc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:10.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.812+0000 7ffbdbfff640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 0x7ffbc806d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc036000 tx=0x7ffbcc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:10.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.816+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffbd408ce20 con 0x7ffbdc1512c0 2024-03-04T08:52:10.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.996+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbdc068ff0 con 0x7ffbdc1512c0 2024-03-04T08:52:10.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.996+0000 7ffbd8ff9640 1 -- 172.21.15.19:0/3783291413 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbd40596b0 con 0x7ffbdc1512c0 2024-03-04T08:52:10.993 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:10.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 msgr2=0x7ffbc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 0x7ffbc806d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc036000 tx=0x7ffbcc030000 comp rx=0 tx=0).stop 2024-03-04T08:52:10.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 msgr2=0x7ffbdc0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:10.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4002230 tx=0x7ffbd400a790 comp rx=0 tx=0).stop 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 shutdown_connections 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbdc1512c0 0x7ffbdc0c8680 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffbdc0b7b00 0x7ffbdc150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffbc806b4d0 0x7ffbc806d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 --2- 172.21.15.19:0/3783291413 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffbc40039b0 0x7ffbdc0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 >> 172.21.15.19:0/3783291413 conn(0x7ffbdc0d3cd0 msgr2=0x7ffbdc1612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 shutdown_connections 2024-03-04T08:52:10.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:10.999+0000 7ffbe24c9640 1 -- 172.21.15.19:0/3783291413 wait complete. 2024-03-04T08:52:11.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:52:11.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 Processor -- start 2024-03-04T08:52:11.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 -- start start 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb941614d0 0x7fbb940d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbb940d2480 0x7fbb940b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb941618b0 con 0x7fbb940d1910 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940cf400 con 0x7fbb940d2480 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.118+0000 7fbb9a756640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940cf6a0 con 0x7fbb941614d0 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb937fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbb940d1910 0x7fbb940d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45772/0 (socket says 172.21.15.19:45772) 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb937fe640 1 -- 172.21.15.19:0/2048602648 learned_addr learned my addr 172.21.15.19:0/2048602648 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:11.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb98cf3640 1 --2- 172.21.15.19:0/2048602648 >> v2:172.21.15.204:3300/0 conn(0x7fbb940d2480 0x7fbb940b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb93fff640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb941614d0 0x7fbb940d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8210303 0 0) 0x7fbb941618b0 con 0x7fbb940d1910 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003520 con 0x7fbb940d1910 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb98cf3640 1 -- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb941614d0 msgr2=0x7fbb940d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb98cf3640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb941614d0 0x7fbb940d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb98cf3640 1 -- 172.21.15.19:0/2048602648 >> v1:172.21.15.19:6789/0 conn(0x7fbb940d1910 legacy=0x7fbb940d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260914767 0 0) 0x7fbb7c003520 con 0x7fbb940d1910 2024-03-04T08:52:11.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.119+0000 7fbb98cf3640 1 -- 172.21.15.19:0/2048602648 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940cf980 con 0x7fbb940d2480 2024-03-04T08:52:11.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.120+0000 7fbb98cf3640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940d2480 0x7fbb940b0e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=963726d124d0910a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.120+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c039070 con 0x7fbb940d2480 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c02c8a0 con 0x7fbb940d2480 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb92ffd640 1 -- 172.21.15.19:0/2048602648 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88001670 con 0x7fbb940d2480 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 -- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940d2480 msgr2=0x7fbb940b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940d2480 0x7fbb940b0e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009d90 tx=0x7fbb8c02bd70 comp rx=0 tx=0).stop 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 -- 172.21.15.19:0/2048602648 shutdown_connections 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb940d2480 0x7fbb940b0e30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 --2- 172.21.15.19:0/2048602648 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb941614d0 0x7fbb940d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 -- 172.21.15.19:0/2048602648 >> 172.21.15.19:0/2048602648 conn(0x7fbb940d3d40 msgr2=0x7fbb940d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 -- 172.21.15.19:0/2048602648 shutdown_connections 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.121+0000 7fbb9a756640 1 -- 172.21.15.19:0/2048602648 wait complete. 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.122+0000 7fbb9a756640 1 Processor -- start 2024-03-04T08:52:11.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.122+0000 7fbb9a756640 1 -- start start 2024-03-04T08:52:11.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940d1910 0x7fbb940c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 0x7fbb940ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b1370 con 0x7fbb940d2480 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b0910 con 0x7fbb941614d0 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb9a756640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b14f0 con 0x7fbb940d1910 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36428/0 (socket says 172.21.15.19:36428) 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb937fe640 1 -- 172.21.15.19:0/816962045 learned_addr learned my addr 172.21.15.19:0/816962045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb98cf3640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 0x7fbb940ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.123+0000 7fbb93fff640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940d1910 0x7fbb940c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 -- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940d1910 msgr2=0x7fbb940c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940d1910 0x7fbb940c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 -- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 msgr2=0x7fbb940ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 0x7fbb940ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 -- 172.21.15.19:0/816962045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940b8600 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb98cf3640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 0x7fbb940ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb937fe640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c780 tx=0x7fbb8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88005ad0 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88005c90 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940b88e0 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880072b0 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.124+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb940b8ea0 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.125+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94068ff0 con 0x7fbb940d2480 2024-03-04T08:52:11.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.125+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb88007450 con 0x7fbb940d2480 2024-03-04T08:52:11.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.126+0000 7fbb90ff9640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 0x7fbb8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.126+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbb8808a260 con 0x7fbb940d2480 2024-03-04T08:52:11.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.126+0000 7fbb93fff640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 0x7fbb8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.127+0000 7fbb93fff640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 0x7fbb8006d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009a30 tx=0x7fbb84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.130+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb88010300 con 0x7fbb940d2480 2024-03-04T08:52:11.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.310+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fbb9415f650 con 0x7fbb940d2480 2024-03-04T08:52:11.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.310+0000 7fbb90ff9640 1 -- 172.21.15.19:0/816962045 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7fbb88058f60 con 0x7fbb940d2480 2024-03-04T08:52:11.307 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 msgr2=0x7fbb8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 0x7fbb8006d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009a30 tx=0x7fbb84008040 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 msgr2=0x7fbb940c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c780 tx=0x7fbb8800cc40 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 shutdown_connections 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbb8006b4d0 0x7fbb8006d990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbb941614d0 0x7fbb940ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb940d2480 0x7fbb940c9d00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 --2- 172.21.15.19:0/816962045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbb940d1910 0x7fbb940c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 >> 172.21.15.19:0/816962045 conn(0x7fbb940d3d40 msgr2=0x7fbb940cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 shutdown_connections 2024-03-04T08:52:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.312+0000 7fbb9a756640 1 -- 172.21.15.19:0/816962045 wait complete. 2024-03-04T08:52:11.320 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:11.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.429+0000 7f57ce678640 1 Processor -- start 2024-03-04T08:52:11.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.429+0000 7f57ce678640 1 -- start start 2024-03-04T08:52:11.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57ce678640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 0x7f57c80d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57ce678640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c8162970 0x7f57c80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57ce678640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80d22c0 con 0x7f57c8161cf0 2024-03-04T08:52:11.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57ce678640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c8161b00 con 0x7f57c8162970 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57ce678640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c80cecc0 con 0x7f57c80b4460 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c8162970 0x7f57c80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c8162970 0x7f57c80b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36440/0 (socket says 172.21.15.19:36440) 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 -- 172.21.15.19:0/1268760116 learned_addr learned my addr 172.21.15.19:0/1268760116 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c7fff640 1 --2- 172.21.15.19:0/1268760116 >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 0x7f57c80d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 -- 172.21.15.19:0/1268760116 >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 msgr2=0x7f57c80d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 --2- 172.21.15.19:0/1268760116 >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 0x7f57c80d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 -- 172.21.15.19:0/1268760116 >> v1:172.21.15.204:6789/0 conn(0x7f57c8161cf0 legacy=0x7f57c80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c77fe640 1 -- 172.21.15.19:0/1268760116 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80d25a0 con 0x7f57c8162970 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.430+0000 7f57c7fff640 1 --2- 172.21.15.19:0/1268760116 >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 0x7f57c80d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.431+0000 7f57c77fe640 1 --2- 172.21.15.19:0/1268760116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8162970 0x7f57c80b3580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f57c808ddd0 tx=0x7f57b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e6dd95b620df17 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.431+0000 7f57c6ffd640 1 -- 172.21.15.19:0/1268760116 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8035020 con 0x7f57c8162970 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.431+0000 7f57c6ffd640 1 -- 172.21.15.19:0/1268760116 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8031870 con 0x7f57c8162970 2024-03-04T08:52:11.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.431+0000 7f57c6ffd640 1 -- 172.21.15.19:0/1268760116 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031c40 con 0x7f57c8162970 2024-03-04T08:52:11.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 -- 172.21.15.19:0/1268760116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8162970 msgr2=0x7f57c80b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 --2- 172.21.15.19:0/1268760116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8162970 0x7f57c80b3580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f57c808ddd0 tx=0x7f57b802b910 comp rx=0 tx=0).stop 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 -- 172.21.15.19:0/1268760116 shutdown_connections 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 --2- 172.21.15.19:0/1268760116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c8162970 0x7f57c80b3580 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 --2- 172.21.15.19:0/1268760116 >> v2:172.21.15.204:3300/0 conn(0x7f57c80b4460 0x7f57c80d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 -- 172.21.15.19:0/1268760116 >> 172.21.15.19:0/1268760116 conn(0x7f57c80d3ce0 msgr2=0x7f57c80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 -- 172.21.15.19:0/1268760116 shutdown_connections 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.432+0000 7f57ce678640 1 -- 172.21.15.19:0/1268760116 wait complete. 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.433+0000 7f57ce678640 1 Processor -- start 2024-03-04T08:52:11.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.433+0000 7f57ce678640 1 -- start start 2024-03-04T08:52:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c8161cf0 0x7f57c80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 0x7f57c8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80ce950 con 0x7f57c80b4460 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80d2b60 con 0x7f57c8162970 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ce678640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b3ac0 con 0x7f57c8161cf0 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36454/0 (socket says 172.21.15.19:36454) 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 -- 172.21.15.19:0/940468638 learned_addr learned my addr 172.21.15.19:0/940468638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ccc15640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 0x7f57c8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c77fe640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c8161cf0 0x7f57c80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 -- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c8161cf0 msgr2=0x7f57c80ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c8161cf0 0x7f57c80ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 -- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 msgr2=0x7f57c8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 0x7f57c8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 -- 172.21.15.19:0/940468638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80b88b0 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57ccc15640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 0x7f57c8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.434+0000 7f57c7fff640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c7f0 tx=0x7f57bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.435+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc015070 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.435+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc007820 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.435+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c8155db0 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.435+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc007bd0 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.435+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c80cb090 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.436+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c804f330 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.437+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57bc018070 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.437+0000 7f57c4ff9640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 0x7f57b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.437+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f57bc08a430 con 0x7f57c80b4460 2024-03-04T08:52:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.437+0000 7f57c77fe640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 0x7f57b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.438+0000 7f57c77fe640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 0x7f57b406d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57b8036000 tx=0x7f57b803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.441+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f57bc0591b0 con 0x7f57c80b4460 2024-03-04T08:52:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.633+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57c806b180 con 0x7f57c80b4460 2024-03-04T08:52:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.633+0000 7f57c4ff9640 1 -- 172.21.15.19:0/940468638 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f57bc058ab0 con 0x7f57c80b4460 2024-03-04T08:52:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:11.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 msgr2=0x7f57b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 0x7f57b406d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57b8036000 tx=0x7f57b803c040 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 msgr2=0x7f57c80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c7f0 tx=0x7f57bc00ccb0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 shutdown_connections 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f57b406b4d0 0x7f57b406d990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f57c8162970 0x7f57c8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f57c8161cf0 0x7f57c80ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 --2- 172.21.15.19:0/940468638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c80b4460 0x7f57c80cbb70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 >> 172.21.15.19:0/940468638 conn(0x7f57c80d3ce0 msgr2=0x7f57c8161190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 shutdown_connections 2024-03-04T08:52:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.636+0000 7f57ce678640 1 -- 172.21.15.19:0/940468638 wait complete. 2024-03-04T08:52:11.646 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:11.646 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:11.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.805+0000 7f09428ed640 1 Processor -- start 2024-03-04T08:52:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.805+0000 7f09428ed640 1 -- start start 2024-03-04T08:52:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f09428ed640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f09428ed640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f09428ed640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c161980 con 0x7f093c0cfff0 2024-03-04T08:52:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f09428ed640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c161c60 con 0x7f093c15bb20 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f09428ed640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c161f40 con 0x7f093c0cd8c0 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f093bfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f0940e8a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f093b7fe640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f093c0cfff0 0x7f093c0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:37728/0 (socket says 172.21.15.19:37728) 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f093bfff640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:55700/0 (socket says 172.21.15.19:55700) 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.806+0000 7f093b7fe640 1 -- 172.21.15.19:0/3573064239 learned_addr learned my addr 172.21.15.19:0/3573064239 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.807+0000 7f0940e8a640 1 -- 172.21.15.19:0/3573064239 >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 msgr2=0x7f093c0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.807+0000 7f0940e8a640 1 --2- 172.21.15.19:0/3573064239 >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.807+0000 7f0940e8a640 1 -- 172.21.15.19:0/3573064239 >> v1:172.21.15.204:6789/0 conn(0x7f093c0cfff0 legacy=0x7f093c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.807+0000 7f0940e8a640 1 -- 172.21.15.19:0/3573064239 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c162220 con 0x7f093c0cd8c0 2024-03-04T08:52:11.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.807+0000 7f093bfff640 1 --2- 172.21.15.19:0/3573064239 >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f0940e8a640 1 --2- 172.21.15.19:0/3573064239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c0d04a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f093402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f861dd8be0ac7f62 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f093affd640 1 -- 172.21.15.19:0/3573064239 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934039070 con 0x7f093c0cd8c0 2024-03-04T08:52:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f093affd640 1 -- 172.21.15.19:0/3573064239 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093402cc50 con 0x7f093c0cd8c0 2024-03-04T08:52:11.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f093affd640 1 -- 172.21.15.19:0/3573064239 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934034440 con 0x7f093c0cd8c0 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 -- 172.21.15.19:0/3573064239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 msgr2=0x7f093c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 --2- 172.21.15.19:0/3573064239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c0d04a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f093402bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 -- 172.21.15.19:0/3573064239 shutdown_connections 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 --2- 172.21.15.19:0/3573064239 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c0d04a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 --2- 172.21.15.19:0/3573064239 >> v2:172.21.15.204:3300/0 conn(0x7f093c15bb20 0x7f093c0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 -- 172.21.15.19:0/3573064239 >> 172.21.15.19:0/3573064239 conn(0x7f093c09a9f0 msgr2=0x7f093c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 -- 172.21.15.19:0/3573064239 shutdown_connections 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.808+0000 7f09428ed640 1 -- 172.21.15.19:0/3573064239 wait complete. 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 Processor -- start 2024-03-04T08:52:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 -- start start 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 0x7f093c1f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0d24b0 con 0x7f093c15bb20 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0d2330 con 0x7f093c0cfff0 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.810+0000 7f09428ed640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0d1980 con 0x7f093c0cd8c0 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36456/0 (socket says 172.21.15.19:36456) 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 -- 172.21.15.19:0/1820647667 learned_addr learned my addr 172.21.15.19:0/1820647667 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:11.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f093b7fe640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 0x7f093c1f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f093bfff640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 -- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 msgr2=0x7f093c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 -- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 msgr2=0x7f093c1f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 0x7f093c1f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 -- 172.21.15.19:0/1820647667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c1603f0 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f093b7fe640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 0x7f093c1f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0940e8a640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f0934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934039050 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934045070 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c1606d0 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934009450 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.811+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c160c90 con 0x7f093c15bb20 2024-03-04T08:52:11.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.812+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c0c6730 con 0x7f093c15bb20 2024-03-04T08:52:11.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.813+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f093403e610 con 0x7f093c15bb20 2024-03-04T08:52:11.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.813+0000 7f0938ff9640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:11.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.813+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f09340ac6d0 con 0x7f093c15bb20 2024-03-04T08:52:11.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.814+0000 7f093bfff640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:11.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.814+0000 7f093bfff640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 0x7f092806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f092c009560 tx=0x7f092c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:11.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:11.822+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f093404e020 con 0x7f093c15bb20 2024-03-04T08:52:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.004+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f093c04f330 con 0x7f093c15bb20 2024-03-04T08:52:12.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.006+0000 7f0938ff9640 1 -- 172.21.15.19:0/1820647667 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f093407ad70 con 0x7f093c15bb20 2024-03-04T08:52:12.003 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:12.003 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 msgr2=0x7f092806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 0x7f092806d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f092c009560 tx=0x7f092c009190 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 msgr2=0x7f093c15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f0934004a40 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 shutdown_connections 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c15bb20 0x7f093c15fba0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c0cfff0 0x7f093c1f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 --2- 172.21.15.19:0/1820647667 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c0cd8c0 0x7f093c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 >> 172.21.15.19:0/1820647667 conn(0x7f093c09a9f0 msgr2=0x7f093c15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 shutdown_connections 2024-03-04T08:52:12.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.008+0000 7f09428ed640 1 -- 172.21.15.19:0/1820647667 wait complete. 2024-03-04T08:52:12.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:12.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 Processor -- start 2024-03-04T08:52:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 -- start start 2024-03-04T08:52:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0378066d90 0x7f03780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03780b5410 0x7f03780ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037806b710 con 0x7f03780cf9a0 2024-03-04T08:52:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780b5880 con 0x7f03780b5410 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.128+0000 7f037c98a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780b61c0 con 0x7f0378066d90 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f037659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03780cf9a0 0x7f03780b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45786/0 (socket says 172.21.15.19:45786) 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f037659c640 1 -- 172.21.15.19:0/3972174596 learned_addr learned my addr 172.21.15.19:0/3972174596 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0376d9d640 1 --2- 172.21.15.19:0/3972174596 >> v2:172.21.15.19:3300/0 conn(0x7f03780b5410 0x7f03780ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0375d9b640 1 --2- 172.21.15.19:0/3972174596 >> v2:172.21.15.204:3300/0 conn(0x7f0378066d90 0x7f03780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0376d9d640 1 -- 172.21.15.19:0/3972174596 >> v2:172.21.15.204:3300/0 conn(0x7f0378066d90 msgr2=0x7f03780b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0376d9d640 1 --2- 172.21.15.19:0/3972174596 >> v2:172.21.15.204:3300/0 conn(0x7f0378066d90 0x7f03780b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0376d9d640 1 -- 172.21.15.19:0/3972174596 >> v1:172.21.15.19:6789/0 conn(0x7f03780cf9a0 legacy=0x7f03780b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f037559a640 1 -- 172.21.15.19:0/3972174596 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110393385 0 0) 0x7f037806b710 con 0x7f03780cf9a0 2024-03-04T08:52:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.129+0000 7f0376d9d640 1 -- 172.21.15.19:0/3972174596 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037806b150 con 0x7f03780b5410 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f0376d9d640 1 --2- 172.21.15.19:0/3972174596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780ce040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03780d11d0 tx=0x7f037002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd39c89de49302 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037559a640 1 -- 172.21.15.19:0/3972174596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370039070 con 0x7f03780b5410 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037559a640 1 -- 172.21.15.19:0/3972174596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037002cc80 con 0x7f03780b5410 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037559a640 1 -- 172.21.15.19:0/3972174596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370034660 con 0x7f03780b5410 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 -- 172.21.15.19:0/3972174596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 msgr2=0x7f03780ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 --2- 172.21.15.19:0/3972174596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780ce040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03780d11d0 tx=0x7f037002bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 -- 172.21.15.19:0/3972174596 shutdown_connections 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 --2- 172.21.15.19:0/3972174596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780ce040 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 --2- 172.21.15.19:0/3972174596 >> v2:172.21.15.204:3300/0 conn(0x7f0378066d90 0x7f03780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.130+0000 7f037c98a640 1 -- 172.21.15.19:0/3972174596 >> 172.21.15.19:0/3972174596 conn(0x7f03780b1d70 msgr2=0x7f03780b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.131+0000 7f037c98a640 1 -- 172.21.15.19:0/3972174596 shutdown_connections 2024-03-04T08:52:12.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.131+0000 7f037c98a640 1 -- 172.21.15.19:0/3972174596 wait complete. 2024-03-04T08:52:12.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.132+0000 7f037c98a640 1 Processor -- start 2024-03-04T08:52:12.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.132+0000 7f037c98a640 1 -- start start 2024-03-04T08:52:12.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 0x7f037815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 0x7f03780c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b0c50 con 0x7f03780b5410 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b0970 con 0x7f0378066d90 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037c98a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780cfd80 con 0x7f03780cf9a0 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36480/0 (socket says 172.21.15.19:36480) 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 -- 172.21.15.19:0/292634779 learned_addr learned my addr 172.21.15.19:0/292634779 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0376d9d640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 0x7f03780c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f037659c640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 0x7f037815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 -- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 msgr2=0x7f03780c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 0x7f03780c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 -- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 msgr2=0x7f037815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 0x7f037815e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.133+0000 7f0375d9b640 1 -- 172.21.15.19:0/292634779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03781f3ee0 con 0x7f03780b5410 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f0376d9d640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 0x7f03780c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f037659c640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 0x7f037815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f0375d9b640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f036800e980 tx=0x7f036800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368017070 con 0x7f03780b5410 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800ca00 con 0x7f03780b5410 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03780c6230 con 0x7f03780b5410 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800cdd0 con 0x7f03780b5410 2024-03-04T08:52:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.134+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03781f4160 con 0x7f03780b5410 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.135+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037809e3d0 con 0x7f03780b5410 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.136+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f036801a070 con 0x7f03780b5410 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.136+0000 7f036effd640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 0x7f035806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.136+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f036808a370 con 0x7f03780b5410 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.136+0000 7f037659c640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 0x7f035806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.137+0000 7f037659c640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 0x7f035806d9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0360000f60 tx=0x7f0360007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.140+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f03781f3ee0 con 0x7f03780b5410 2024-03-04T08:52:12.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.320+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0378068ff0 con 0x7f03780b5410 2024-03-04T08:52:12.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.321+0000 7f036effd640 1 -- 172.21.15.19:0/292634779 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0368059060 con 0x7f03780b5410 2024-03-04T08:52:12.317 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:12.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 msgr2=0x7f035806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 0x7f035806d9c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0360000f60 tx=0x7f0360007cc0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 msgr2=0x7f03780c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f036800e980 tx=0x7f036800ee40 comp rx=0 tx=0).stop 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 shutdown_connections 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03780cf9a0 0x7f03780c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03780b5410 0x7f03780c4fe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f035806b500 0x7f035806d9c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 --2- 172.21.15.19:0/292634779 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0378066d90 0x7f037815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 >> 172.21.15.19:0/292634779 conn(0x7f03780b1d70 msgr2=0x7f03780b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 shutdown_connections 2024-03-04T08:52:12.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.323+0000 7f037c98a640 1 -- 172.21.15.19:0/292634779 wait complete. 2024-03-04T08:52:12.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:12.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.438+0000 7fdc148eb640 1 Processor -- start 2024-03-04T08:52:12.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.438+0000 7fdc148eb640 1 -- start start 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc148eb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc101614d0 0x7fdc100d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc148eb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdc100d1910 0x7fdc100d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc148eb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc101618b0 con 0x7fdc100d22e0 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc148eb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100cf400 con 0x7fdc101614d0 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc148eb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100d2710 con 0x7fdc100d1910 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc101614d0 0x7fdc100d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc101614d0 0x7fdc100d4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36492/0 (socket says 172.21.15.19:36492) 2024-03-04T08:52:12.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 -- 172.21.15.19:0/2526906679 learned_addr learned my addr 172.21.15.19:0/2526906679 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc07fff640 1 --2- 172.21.15.19:0/2526906679 >> v2:172.21.15.204:3300/0 conn(0x7fdc100d1910 0x7fdc100d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 -- 172.21.15.19:0/2526906679 >> v2:172.21.15.204:3300/0 conn(0x7fdc100d1910 msgr2=0x7fdc100d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 --2- 172.21.15.19:0/2526906679 >> v2:172.21.15.204:3300/0 conn(0x7fdc100d1910 0x7fdc100d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 -- 172.21.15.19:0/2526906679 >> v1:172.21.15.204:6789/0 conn(0x7fdc100d22e0 legacy=0x7fdc100d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.439+0000 7fdc0e59c640 1 -- 172.21.15.19:0/2526906679 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100cf6a0 con 0x7fdc101614d0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.440+0000 7fdc0e59c640 1 --2- 172.21.15.19:0/2526906679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc100d4860 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc1008c470 tx=0x7fdc0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fa6d06d82f73b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.440+0000 7fdc0dd9b640 1 -- 172.21.15.19:0/2526906679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00035020 con 0x7fdc101614d0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.440+0000 7fdc0dd9b640 1 -- 172.21.15.19:0/2526906679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00031640 con 0x7fdc101614d0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.440+0000 7fdc0dd9b640 1 -- 172.21.15.19:0/2526906679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0002d040 con 0x7fdc101614d0 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 -- 172.21.15.19:0/2526906679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 msgr2=0x7fdc100d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 --2- 172.21.15.19:0/2526906679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc100d4860 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc1008c470 tx=0x7fdc0002b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 -- 172.21.15.19:0/2526906679 shutdown_connections 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 --2- 172.21.15.19:0/2526906679 >> v2:172.21.15.204:3300/0 conn(0x7fdc100d1910 0x7fdc100d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 --2- 172.21.15.19:0/2526906679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc100d4860 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 -- 172.21.15.19:0/2526906679 >> 172.21.15.19:0/2526906679 conn(0x7fdc100d3d40 msgr2=0x7fdc100d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 -- 172.21.15.19:0/2526906679 shutdown_connections 2024-03-04T08:52:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.441+0000 7fdc148eb640 1 -- 172.21.15.19:0/2526906679 wait complete. 2024-03-04T08:52:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.443+0000 7fdc148eb640 1 Processor -- start 2024-03-04T08:52:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.443+0000 7fdc148eb640 1 -- start start 2024-03-04T08:52:12.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc100d1910 0x7fdc1015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc100d22e0 0x7fdc101f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100b0910 con 0x7fdc101614d0 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100cfc60 con 0x7fdc100d22e0 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc148eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100b1e40 con 0x7fdc100d1910 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36504/0 (socket says 172.21.15.19:36504) 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 -- 172.21.15.19:0/1785344379 learned_addr learned my addr 172.21.15.19:0/1785344379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 -- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc100d1910 msgr2=0x7fdc1015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc100d1910 0x7fdc1015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 -- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc100d22e0 msgr2=0x7fdc101f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc100d22e0 0x7fdc101f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.444+0000 7fdc0ed9d640 1 -- 172.21.15.19:0/1785344379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100cc130 con 0x7fdc101614d0 2024-03-04T08:52:12.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc0ed9d640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800c780 tx=0x7fdc0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08004b60 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08004d00 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc100c8680 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800aa90 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.445+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc100cc3d0 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.446+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100d05b0 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.446+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc0800ac30 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.447+0000 7fdc06ffd640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 0x7fdbf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.447+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fdc0808a600 con 0x7fdc101614d0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.447+0000 7fdc0e59c640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 0x7fdbf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.448+0000 7fdc0e59c640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 0x7fdbf006d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc00036000 tx=0x7fdc00030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.451+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdc100d05b0 con 0x7fdc101614d0 2024-03-04T08:52:12.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.675+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc10068ff0 con 0x7fdc101614d0 2024-03-04T08:52:12.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.676+0000 7fdc06ffd640 1 -- 172.21.15.19:0/1785344379 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc08020070 con 0x7fdc101614d0 2024-03-04T08:52:12.672 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:12.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 msgr2=0x7fdbf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 0x7fdbf006d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc00036000 tx=0x7fdc00030000 comp rx=0 tx=0).stop 2024-03-04T08:52:12.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 msgr2=0x7fdc101f7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800c780 tx=0x7fdc0800cc40 comp rx=0 tx=0).stop 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 shutdown_connections 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101614d0 0x7fdc101f7180 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdbf006b4d0 0x7fdbf006d990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdc100d22e0 0x7fdc101f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 --2- 172.21.15.19:0/1785344379 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdc100d1910 0x7fdc1015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 >> 172.21.15.19:0/1785344379 conn(0x7fdc100d3d40 msgr2=0x7fdc100cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 shutdown_connections 2024-03-04T08:52:12.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.678+0000 7fdc148eb640 1 -- 172.21.15.19:0/1785344379 wait complete. 2024-03-04T08:52:12.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.795+0000 7f64039d7640 1 Processor -- start 2024-03-04T08:52:12.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 -- start start 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63fc0d4860 0x7f63fc0d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc1618b0 con 0x7f63fc1614d0 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0d4cf0 con 0x7f63fc0d4860 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.796+0000 7f64039d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0cf400 con 0x7f63fc0b0e30 2024-03-04T08:52:12.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6401f74640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6400f72640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f63fc0d4860 0x7f63fc0d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6401773640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f63fc1614d0 0x7f63fc0d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:37746/0 (socket says 172.21.15.19:37746) 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6401773640 1 -- 172.21.15.19:0/3985141899 learned_addr learned my addr 172.21.15.19:0/3985141899 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6401f74640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:44826/0 (socket says 172.21.15.19:44826) 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6400f72640 1 -- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 msgr2=0x7f63fc0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6400f72640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6400f72640 1 -- 172.21.15.19:0/3985141899 >> v1:172.21.15.204:6789/0 conn(0x7f63fc1614d0 legacy=0x7f63fc0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6400f72640 1 -- 172.21.15.19:0/3985141899 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0cf6a0 con 0x7f63fc0d4860 2024-03-04T08:52:12.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.797+0000 7f6401f74640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.798+0000 7f6400f72640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0d2020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3bfabb6aa495f88 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.798+0000 7f63f3fff640 1 -- 172.21.15.19:0/3985141899 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec035020 con 0x7f63fc0d4860 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.798+0000 7f63f3fff640 1 -- 172.21.15.19:0/3985141899 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec031830 con 0x7f63fc0d4860 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.798+0000 7f63f3fff640 1 -- 172.21.15.19:0/3985141899 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec031c00 con 0x7f63fc0d4860 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 -- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 msgr2=0x7f63fc0d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0d2020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 -- 172.21.15.19:0/3985141899 shutdown_connections 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 --2- 172.21.15.19:0/3985141899 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0d2020 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 -- 172.21.15.19:0/3985141899 >> 172.21.15.19:0/3985141899 conn(0x7f63fc0d3d40 msgr2=0x7f63fc0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 -- 172.21.15.19:0/3985141899 shutdown_connections 2024-03-04T08:52:12.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.799+0000 7f64039d7640 1 -- 172.21.15.19:0/3985141899 wait complete. 2024-03-04T08:52:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.801+0000 7f64039d7640 1 Processor -- start 2024-03-04T08:52:12.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.801+0000 7f64039d7640 1 -- start start 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc14c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0b0910 con 0x7f63fc1614d0 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0cfc60 con 0x7f63fc0d4860 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f64039d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0d2560 con 0x7f63fc0b0e30 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36516/0 (socket says 172.21.15.19:36516) 2024-03-04T08:52:12.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 -- 172.21.15.19:0/2738391734 learned_addr learned my addr 172.21.15.19:0/2738391734 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6400f72640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401773640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc14c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 -- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 msgr2=0x7f63fc14c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc14c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 -- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 msgr2=0x7f63fc0b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0b9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.802+0000 7f6401f74640 1 -- 172.21.15.19:0/2738391734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0b7820 con 0x7f63fc1614d0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f6401f74640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63f400efc0 tx=0x7f63f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4018030 con 0x7f63fc1614d0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f400cdf0 con 0x7f63fc1614d0 2024-03-04T08:52:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc0b84b0 con 0x7f63fc1614d0 2024-03-04T08:52:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4003bb0 con 0x7f63fc1614d0 2024-03-04T08:52:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.803+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc0b8a70 con 0x7f63fc1614d0 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.804+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc068ff0 con 0x7f63fc1614d0 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.804+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63f401b070 con 0x7f63fc1614d0 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.805+0000 7f63f1ffb640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 0x7f63e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.805+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f63f408adf0 con 0x7f63fc1614d0 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.805+0000 7f6401773640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 0x7f63e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.806+0000 7f6401773640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 0x7f63e006d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f63f8000f60 tx=0x7f63f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.809+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f63f4010040 con 0x7f63fc1614d0 2024-03-04T08:52:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.989+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63fc0d31f0 con 0x7f63fc1614d0 2024-03-04T08:52:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.989+0000 7f63f1ffb640 1 -- 172.21.15.19:0/2738391734 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63f4059a40 con 0x7f63fc1614d0 2024-03-04T08:52:12.986 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.991+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 msgr2=0x7f63e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.991+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 0x7f63e006d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f63f8000f60 tx=0x7f63f8009040 comp rx=0 tx=0).stop 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.991+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 msgr2=0x7f63fc15f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.991+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63f400efc0 tx=0x7f63f400c490 comp rx=0 tx=0).stop 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 shutdown_connections 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63fc1614d0 0x7f63fc15f630 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f63e006b4d0 0x7f63e006d990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f63fc0d4860 0x7f63fc0b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 --2- 172.21.15.19:0/2738391734 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f63fc0b0e30 0x7f63fc14c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 >> 172.21.15.19:0/2738391734 conn(0x7f63fc0d3d40 msgr2=0x7f63fc0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 shutdown_connections 2024-03-04T08:52:12.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:12.992+0000 7f64039d7640 1 -- 172.21.15.19:0/2738391734 wait complete. 2024-03-04T08:52:12.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:52:13.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.107+0000 7efd4b5c9640 1 Processor -- start 2024-03-04T08:52:13.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.107+0000 7efd4b5c9640 1 -- start start 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd4b5c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4415dd00 0x7efd4406e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd4b5c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd4406b6c0 0x7efd440b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd4b5c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd44161bd0 con 0x7efd4415e0e0 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd4b5c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd44070220 con 0x7efd4406b6c0 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd4b5c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd44161e90 con 0x7efd4415dd00 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd4406b6c0 0x7efd440b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd48b64640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd4415e0e0 0x7efd4406afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45798/0 (socket says 172.21.15.19:45798) 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd4406b6c0 0x7efd440b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36526/0 (socket says 172.21.15.19:36526) 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd48b64640 1 -- 172.21.15.19:0/1910424117 learned_addr learned my addr 172.21.15.19:0/1910424117 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49365640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4415dd00 0x7efd4406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 -- 172.21.15.19:0/1910424117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4415dd00 msgr2=0x7efd4406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4415dd00 0x7efd4406e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 -- 172.21.15.19:0/1910424117 >> v1:172.21.15.19:6789/0 conn(0x7efd4415e0e0 legacy=0x7efd4406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd49b66640 1 -- 172.21.15.19:0/1910424117 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44162170 con 0x7efd4406b6c0 2024-03-04T08:52:13.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.108+0000 7efd37fff640 1 -- 172.21.15.19:0/1910424117 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249784101 0 0) 0x7efd44161bd0 con 0x7efd4415e0e0 2024-03-04T08:52:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.109+0000 7efd49b66640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4406b6c0 0x7efd440b42d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009d90 tx=0x7efd3c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e7274f1df0288c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.109+0000 7efd37fff640 1 -- 172.21.15.19:0/1910424117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c039070 con 0x7efd4406b6c0 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.109+0000 7efd37fff640 1 -- 172.21.15.19:0/1910424117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c02cc50 con 0x7efd4406b6c0 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.109+0000 7efd37fff640 1 -- 172.21.15.19:0/1910424117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c034440 con 0x7efd4406b6c0 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 -- 172.21.15.19:0/1910424117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4406b6c0 msgr2=0x7efd440b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4406b6c0 0x7efd440b42d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009d90 tx=0x7efd3c02bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 -- 172.21.15.19:0/1910424117 shutdown_connections 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4406b6c0 0x7efd440b42d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/1910424117 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4415dd00 0x7efd4406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 -- 172.21.15.19:0/1910424117 >> 172.21.15.19:0/1910424117 conn(0x7efd440b2660 msgr2=0x7efd440b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 -- 172.21.15.19:0/1910424117 shutdown_connections 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.110+0000 7efd4b5c9640 1 -- 172.21.15.19:0/1910424117 wait complete. 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.111+0000 7efd4b5c9640 1 Processor -- start 2024-03-04T08:52:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.111+0000 7efd4b5c9640 1 -- start start 2024-03-04T08:52:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 0x7efd44142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 0x7efd441e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd440b0180 con 0x7efd4415f940 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd440b0000 con 0x7efd4415dd00 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd4b5c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd440b0300 con 0x7efd4406b6c0 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36536/0 (socket says 172.21.15.19:36536) 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 -- 172.21.15.19:0/4029693685 learned_addr learned my addr 172.21.15.19:0/4029693685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd48b64640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 0x7efd441e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49365640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 0x7efd44142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 -- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 msgr2=0x7efd44142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 0x7efd44142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 -- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 msgr2=0x7efd441e75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 0x7efd441e75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 -- 172.21.15.19:0/4029693685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44142970 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd48b64640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 0x7efd441e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49365640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 0x7efd44142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.112+0000 7efd49b66640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009d90 tx=0x7efd3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.113+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c039050 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.113+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c045070 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.113+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd441e7e00 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.113+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c03e610 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.113+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd441e83c0 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.114+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd44073390 con 0x7efd4415f940 2024-03-04T08:52:13.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.114+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd3c03e7b0 con 0x7efd4415f940 2024-03-04T08:52:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.115+0000 7efd35ffb640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 0x7efd2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.115+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7efd3c0acf40 con 0x7efd4415f940 2024-03-04T08:52:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.115+0000 7efd49365640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 0x7efd2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.116+0000 7efd49365640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 0x7efd2806d990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd40006fd0 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.119+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efd44142970 con 0x7efd4415f940 2024-03-04T08:52:13.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.299+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7efd44068ff0 con 0x7efd4415f940 2024-03-04T08:52:13.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.300+0000 7efd35ffb640 1 -- 172.21.15.19:0/4029693685 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7efd3c07bc30 con 0x7efd4415f940 2024-03-04T08:52:13.296 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 msgr2=0x7efd2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 0x7efd2806d990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd40006fd0 tx=0x7efd40008040 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 msgr2=0x7efd44160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009d90 tx=0x7efd3c004a40 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 shutdown_connections 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd4415f940 0x7efd44160270 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efd2806b4d0 0x7efd2806d990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efd4415dd00 0x7efd441e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 --2- 172.21.15.19:0/4029693685 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efd4406b6c0 0x7efd44142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 >> 172.21.15.19:0/4029693685 conn(0x7efd440b2660 msgr2=0x7efd440cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:13.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 shutdown_connections 2024-03-04T08:52:13.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.302+0000 7efd4b5c9640 1 -- 172.21.15.19:0/4029693685 wait complete. 2024-03-04T08:52:13.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:13.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.416+0000 7fa4cd5eb640 1 Processor -- start 2024-03-04T08:52:13.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.416+0000 7fa4cd5eb640 1 -- start start 2024-03-04T08:52:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.417+0000 7fa4cd5eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.417+0000 7fa4cd5eb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.417+0000 7fa4cd5eb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c806e770 con 0x7fa4c806e000 2024-03-04T08:52:13.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.417+0000 7fa4cd5eb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c815e660 con 0x7fa4c80b4a50 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.417+0000 7fa4cd5eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c806e490 con 0x7fa4c80cc920 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:55770/0 (socket says 172.21.15.19:55770) 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:44868/0 (socket says 172.21.15.19:44868) 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4bffff640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa4c806e000 0x7fa4c8072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:37758/0 (socket says 172.21.15.19:37758) 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c77fe640 1 -- 172.21.15.19:0/3163702668 learned_addr learned my addr 172.21.15.19:0/3163702668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 -- 172.21.15.19:0/3163702668 >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 msgr2=0x7fa4c8150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 --2- 172.21.15.19:0/3163702668 >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 -- 172.21.15.19:0/3163702668 >> v1:172.21.15.204:6789/0 conn(0x7fa4c806e000 legacy=0x7fa4c8072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c67fc640 1 -- 172.21.15.19:0/3163702668 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931539762 0 0) 0x7fa4c806e770 con 0x7fa4c806e000 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c6ffd640 1 -- 172.21.15.19:0/3163702668 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c815e010 con 0x7fa4c80cc920 2024-03-04T08:52:13.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.418+0000 7fa4c77fe640 1 --2- 172.21.15.19:0/3163702668 >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.419+0000 7fa4c6ffd640 1 --2- 172.21.15.19:0/3163702668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c815e7e0 tx=0x7fa4b802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2138b4599eae93bf server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.419+0000 7fa4c67fc640 1 -- 172.21.15.19:0/3163702668 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8035020 con 0x7fa4c80cc920 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.419+0000 7fa4c67fc640 1 -- 172.21.15.19:0/3163702668 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8031800 con 0x7fa4c80cc920 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.419+0000 7fa4c67fc640 1 -- 172.21.15.19:0/3163702668 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031bd0 con 0x7fa4c80cc920 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3163702668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 msgr2=0x7fa4c815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3163702668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c815e7e0 tx=0x7fa4b802b8a0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3163702668 shutdown_connections 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3163702668 >> v2:172.21.15.204:3300/0 conn(0x7fa4c80b4a50 0x7fa4c8150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3163702668 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80cc920 0x7fa4c815eaf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3163702668 >> 172.21.15.19:0/3163702668 conn(0x7fa4c80b1c80 msgr2=0x7fa4c80cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3163702668 shutdown_connections 2024-03-04T08:52:13.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.420+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3163702668 wait complete. 2024-03-04T08:52:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.421+0000 7fa4cd5eb640 1 Processor -- start 2024-03-04T08:52:13.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.421+0000 7fa4cd5eb640 1 -- start start 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.422+0000 7fa4cd5eb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80b4a50 0x7fa4c81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4c814dd20 0x7fa4c814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80cce80 con 0x7fa4c80cc920 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80ccd00 con 0x7fa4c814dd20 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8070940 con 0x7fa4c80b4a50 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36552/0 (socket says 172.21.15.19:36552) 2024-03-04T08:52:13.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 -- 172.21.15.19:0/3160597060 learned_addr learned my addr 172.21.15.19:0/3160597060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4c6ffd640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80b4a50 0x7fa4c81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4c77fe640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4c814dd20 0x7fa4c814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 -- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80b4a50 msgr2=0x7fa4c81575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80b4a50 0x7fa4c81575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 -- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4c814dd20 msgr2=0x7fa4c814b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4c814dd20 0x7fa4c814b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 -- 172.21.15.19:0/3160597060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c814cf60 con 0x7fa4c80cc920 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bffff640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c470 tx=0x7fa4b000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00074e0 con 0x7fa4c80cc920 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c814d240 con 0x7fa4c80cc920 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b00047e0 con 0x7fa4c80cc920 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004bd0 con 0x7fa4c80cc920 2024-03-04T08:52:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.423+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c814d800 con 0x7fa4c80cc920 2024-03-04T08:52:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.424+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c804f330 con 0x7fa4c80cc920 2024-03-04T08:52:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.425+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4b0011070 con 0x7fa4c80cc920 2024-03-04T08:52:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.426+0000 7fa4bf7fe640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 0x7fa4a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.426+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa4b008a050 con 0x7fa4c80cc920 2024-03-04T08:52:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.426+0000 7fa4c6ffd640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 0x7fa4a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.427+0000 7fa4c6ffd640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 0x7fa4a806d9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8036000 tx=0x7fa4b8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.434+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa4b0058c20 con 0x7fa4c80cc920 2024-03-04T08:52:13.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.628+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa4c80b40d0 con 0x7fa4c80cc920 2024-03-04T08:52:13.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.628+0000 7fa4bf7fe640 1 -- 172.21.15.19:0/3160597060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa4b0058520 con 0x7fa4c80cc920 2024-03-04T08:52:13.625 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 msgr2=0x7fa4a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 0x7fa4a806d9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8036000 tx=0x7fa4b8008030 comp rx=0 tx=0).stop 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 msgr2=0x7fa4c8155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c470 tx=0x7fa4b000c930 comp rx=0 tx=0).stop 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 shutdown_connections 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa4a806b500 0x7fa4a806d9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa4c814dd20 0x7fa4c814b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4c80cc920 0x7fa4c8155a20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 --2- 172.21.15.19:0/3160597060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa4c80b4a50 0x7fa4c81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 >> 172.21.15.19:0/3160597060 conn(0x7fa4c80b1c80 msgr2=0x7fa4c80b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 shutdown_connections 2024-03-04T08:52:13.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.630+0000 7fa4cd5eb640 1 -- 172.21.15.19:0/3160597060 wait complete. 2024-03-04T08:52:13.637 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:52:13.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:13.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:13.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[54390]: fuse finished with error 0 and tester_r 0 2024-03-04T08:52:13.665 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:13.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:13.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:13.759 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:13.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-03-04T08:52:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.925+0000 7fc9cb471640 1 Processor -- start 2024-03-04T08:52:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.925+0000 7fc9cb471640 1 -- start start 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9cb471640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c406f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9cb471640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9c406fb40 0x7fc9c40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9cb471640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40cd4b0 con 0x7fc9c40ccca0 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9cb471640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c406ff80 con 0x7fc9c406fb40 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9cb471640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40cd790 con 0x7fc9c415c050 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9c8a0c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9c406fb40 0x7fc9c40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9c8a0c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9c406fb40 0x7fc9c40cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36554/0 (socket says 172.21.15.19:36554) 2024-03-04T08:52:13.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9c8a0c640 1 -- 172.21.15.19:0/3865397062 learned_addr learned my addr 172.21.15.19:0/3865397062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.926+0000 7fc9c920d640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9c8a0c640 1 -- 172.21.15.19:0/3865397062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 msgr2=0x7fc9c406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9c8a0c640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9c8a0c640 1 -- 172.21.15.19:0/3865397062 >> v1:172.21.15.204:6789/0 conn(0x7fc9c40ccca0 legacy=0x7fc9c40cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9c8a0c640 1 -- 172.21.15.19:0/3865397062 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40cda70 con 0x7fc9c406fb40 2024-03-04T08:52:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9c8a0c640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40cc760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6074a1d19086a63e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.927+0000 7fc9bbfff640 1 -- 172.21.15.19:0/3865397062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4035020 con 0x7fc9c406fb40 2024-03-04T08:52:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9bbfff640 1 -- 172.21.15.19:0/3865397062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4031640 con 0x7fc9c406fb40 2024-03-04T08:52:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9bbfff640 1 -- 172.21.15.19:0/3865397062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b402d040 con 0x7fc9c406fb40 2024-03-04T08:52:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 -- 172.21.15.19:0/3865397062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 msgr2=0x7fc9c40cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40cc760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 -- 172.21.15.19:0/3865397062 shutdown_connections 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40cc760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3865397062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 -- 172.21.15.19:0/3865397062 >> 172.21.15.19:0/3865397062 conn(0x7fc9c40b3800 msgr2=0x7fc9c40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 -- 172.21.15.19:0/3865397062 shutdown_connections 2024-03-04T08:52:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.928+0000 7fc9cb471640 1 -- 172.21.15.19:0/3865397062 wait complete. 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.929+0000 7fc9cb471640 1 Processor -- start 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.930+0000 7fc9cb471640 1 -- start start 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9c40ccca0 0x7fc9c4147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c41f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40d01f0 con 0x7fc9c406fb40 2024-03-04T08:52:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40cd130 con 0x7fc9c40ccca0 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9cb471640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40d0370 con 0x7fc9c415c050 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36562/0 (socket says 172.21.15.19:36562) 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 -- 172.21.15.19:0/3053342801 learned_addr learned my addr 172.21.15.19:0/3053342801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c8a0c640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9c40ccca0 0x7fc9c4147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 -- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 msgr2=0x7fc9c41f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c41f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 -- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9c40ccca0 msgr2=0x7fc9c4147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9c40ccca0 0x7fc9c4147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 -- 172.21.15.19:0/3053342801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4158240 con 0x7fc9c406fb40 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9c920d640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d800 tx=0x7fc9bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.931+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00b6c0 con 0x7fc9c406fb40 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.932+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc019070 con 0x7fc9c406fb40 2024-03-04T08:52:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.932+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c4158520 con 0x7fc9c406fb40 2024-03-04T08:52:13.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.932+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00ba80 con 0x7fc9c406fb40 2024-03-04T08:52:13.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.932+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c4158ae0 con 0x7fc9c406fb40 2024-03-04T08:52:13.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.933+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9bc00bc20 con 0x7fc9c406fb40 2024-03-04T08:52:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.933+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c409fe60 con 0x7fc9c406fb40 2024-03-04T08:52:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.933+0000 7fc9b9ffb640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 0x7fc9a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.933+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc9bc08a7b0 con 0x7fc9c406fb40 2024-03-04T08:52:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.933+0000 7fc9c8a0c640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 0x7fc9a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.934+0000 7fc9c8a0c640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 0x7fc9a806d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4036000 tx=0x7fc9b403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:13.938+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc9bc059530 con 0x7fc9c406fb40 2024-03-04T08:52:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.190+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc9c4068ff0 con 0x7fc9c406fb40 2024-03-04T08:52:14.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.192+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/3053342801 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+141 (secure 0 0 0) 0x7fc9bc058e30 con 0x7fc9c406fb40 2024-03-04T08:52:14.188 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:14.188 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:14.188 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:52:14.188 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:14.189 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw pool=cephfs_data" 2024-03-04T08:52:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 msgr2=0x7fc9a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 0x7fc9a806d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4036000 tx=0x7fc9b403c040 comp rx=0 tx=0).stop 2024-03-04T08:52:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 msgr2=0x7fc9c40b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d800 tx=0x7fc9bc00dcc0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 shutdown_connections 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc9c415c050 0x7fc9c41f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc9a806b4d0 0x7fc9a806d990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc9c40ccca0 0x7fc9c4147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 --2- 172.21.15.19:0/3053342801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9c406fb40 0x7fc9c40b73a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 >> 172.21.15.19:0/3053342801 conn(0x7fc9c40b3800 msgr2=0x7fc9c40d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 shutdown_connections 2024-03-04T08:52:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.195+0000 7fc9cb471640 1 -- 172.21.15.19:0/3053342801 wait complete. 2024-03-04T08:52:14.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-04T08:52:14.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:14.252 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:14.300 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-04T08:52:14.301 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:14.301 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:14.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:52:14.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:14.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:14.316 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:14.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:14.370 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T08:52:14.370 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:14.370 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:14.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:14.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:52:14.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:14.389 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-04T08:52:14.446 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-04T08:52:14.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:14.447 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:14.447 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:14.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:52:14.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:14.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:14.462 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-04T08:52:14.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:14.516 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-04T08:52:14.517 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:14.517 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:14.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:14.534 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:52:14.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:14.534 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-04T08:52:14.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:14.576 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:14.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:14.591 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-04T08:52:14.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:14.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 Processor -- start 2024-03-04T08:52:14.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 -- start start 2024-03-04T08:52:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5cc015bdd0 0x7f5cc00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00cebe0 con 0x7f5cc015fa10 2024-03-04T08:52:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00ceec0 con 0x7f5cc00d16e0 2024-03-04T08:52:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.722+0000 7f5cc4b5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00ce980 con 0x7f5cc015bdd0 2024-03-04T08:52:14.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cb5d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5cc015fa10 0x7f5cc00ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45810/0 (socket says 172.21.15.19:45810) 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cb5d9b640 1 -- 172.21.15.19:0/2641651936 learned_addr learned my addr 172.21.15.19:0/2641651936 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbe59c640 1 --2- 172.21.15.19:0/2641651936 >> v2:172.21.15.204:3300/0 conn(0x7f5cc015bdd0 0x7f5cc00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920933497 0 0) 0x7f5cc00cebe0 con 0x7f5cc015fa10 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cac003520 con 0x7f5cc015fa10 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860410885 0 0) 0x7f5cac003520 con 0x7f5cc015fa10 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 >> v2:172.21.15.204:3300/0 conn(0x7f5cc015bdd0 msgr2=0x7f5cc00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 --2- 172.21.15.19:0/2641651936 >> v2:172.21.15.204:3300/0 conn(0x7f5cc015bdd0 0x7f5cc00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 >> v1:172.21.15.204:6789/0 conn(0x7f5cc00d16e0 legacy=0x7f5cc00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00cf1a0 con 0x7f5cc015fa10 2024-03-04T08:52:14.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f5ca8001690 con 0x7f5cc015fa10 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 >> v1:172.21.15.19:6789/0 conn(0x7f5cc015fa10 legacy=0x7f5cc00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cac0039b0 0x7f5cac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac004800 0x7f5cac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 0x7f5cac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00ce980 con 0x7f5cac0051c0 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac00c160 con 0x7f5cac0039b0 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac00c360 con 0x7f5cac004800 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 0x7f5cac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.723+0000 7f5cbe59c640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cac0039b0 0x7f5cac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cb5d9b640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac004800 0x7f5cac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cbed9d640 1 -- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac004800 msgr2=0x7f5cac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac004800 0x7f5cac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cbed9d640 1 -- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cac0039b0 msgr2=0x7f5cac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cac0039b0 0x7f5cac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cbed9d640 1 -- 172.21.15.19:0/2641651936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac003520 con 0x7f5cac0051c0 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.724+0000 7f5cb5d9b640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac004800 0x7f5cac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.725+0000 7f5cbed9d640 1 -- 172.21.15.19:0/2641651936 reap_dead start 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.725+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 0x7f5cac00b9c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8001e50 tx=0x7f5cac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f42d7a15daec76 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:14.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.725+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8001a70 con 0x7f5cac0051c0 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.725+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb8003bb0 con 0x7f5cac0051c0 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.725+0000 7f5cbdd9b640 1 -- 172.21.15.19:0/2641651936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80050d0 con 0x7f5cac0051c0 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 msgr2=0x7f5cac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 0x7f5cac00b9c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8001e50 tx=0x7f5cac005830 comp rx=0 tx=0).stop 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/2641651936 shutdown_connections 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/2641651936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac0051c0 0x7f5cac00b9c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/2641651936 >> 172.21.15.19:0/2641651936 conn(0x7f5cc009a9f0 msgr2=0x7f5cc009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/2641651936 shutdown_connections 2024-03-04T08:52:14.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.726+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/2641651936 wait complete. 2024-03-04T08:52:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.727+0000 7f5cc4b5e640 1 Processor -- start 2024-03-04T08:52:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.727+0000 7f5cc4b5e640 1 -- start start 2024-03-04T08:52:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac0051c0 0x7f5cc015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cc0153900 0x7f5cc006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc015c1b0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00cc5d0 con 0x7f5cc0153900 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cc4b5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00ce270 con 0x7f5cac0051c0 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36588/0 (socket says 172.21.15.19:36588) 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 -- 172.21.15.19:0/3687664620 learned_addr learned my addr 172.21.15.19:0/3687664620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbe59c640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac0051c0 0x7f5cc015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 -- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac0051c0 msgr2=0x7f5cc015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac0051c0 0x7f5cc015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 -- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cc0153900 msgr2=0x7f5cc006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cb5d9b640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cc0153900 0x7f5cc006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cc0153900 0x7f5cc006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.728+0000 7f5cbed9d640 1 -- 172.21.15.19:0/3687664620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc015e140 con 0x7f5cc00b2d00 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cbed9d640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8005040 tx=0x7f5cb80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8006d60 con 0x7f5cc00b2d00 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb8007030 con 0x7f5cc00b2d00 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc015c6f0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80073e0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.729+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc015c330 con 0x7f5cc00b2d00 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.730+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc00b36c0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.730+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5cb8007580 con 0x7f5cc00b2d00 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.731+0000 7f5cb77fe640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 0x7f5ca006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.731+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5cb80abfb0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.731+0000 7f5cbe59c640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 0x7f5ca006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.732+0000 7f5cbe59c640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 0x7f5ca006d9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009980 tx=0x7f5cb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.735+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5cb8033030 con 0x7f5cc00b2d00 2024-03-04T08:52:14.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.953+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cc004f330 con 0x7f5cc00b2d00 2024-03-04T08:52:14.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.954+0000 7f5cb77fe640 1 -- 172.21.15.19:0/3687664620 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4981 (secure 0 0 0) 0x7f5cb807aca0 con 0x7f5cc00b2d00 2024-03-04T08:52:14.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:14.950 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:49.451927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:52:14.950 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 msgr2=0x7f5ca006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 0x7f5ca006d9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009980 tx=0x7f5cb0008040 comp rx=0 tx=0).stop 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 msgr2=0x7f5cc00b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8005040 tx=0x7f5cb80014a0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 shutdown_connections 2024-03-04T08:52:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cc00b2d00 0x7f5cc00b3180 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5ca006b500 0x7f5ca006d9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cc0153900 0x7f5cc006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 --2- 172.21.15.19:0/3687664620 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cac0051c0 0x7f5cc015ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 >> 172.21.15.19:0/3687664620 conn(0x7f5cc009a9f0 msgr2=0x7f5cc00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 shutdown_connections 2024-03-04T08:52:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:14.957+0000 7f5cc4b5e640 1 -- 172.21.15.19:0/3687664620 wait complete. 2024-03-04T08:52:14.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.069+0000 7f37aee47640 1 Processor -- start 2024-03-04T08:52:15.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 -- start start 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37a80cf850 0x7f37a80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f37a806cf20 0x7f37a806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a815e380 con 0x7f37a80d00c0 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a806ca90 con 0x7f37a80cf850 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37aee47640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a80cdc10 con 0x7f37a806cf20 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37acbe3640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f37a80d00c0 0x7f37a80d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45818/0 (socket says 172.21.15.19:45818) 2024-03-04T08:52:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37acbe3640 1 -- 172.21.15.19:0/2014621045 learned_addr learned my addr 172.21.15.19:0/2014621045 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.070+0000 7f37a7fff640 1 --2- 172.21.15.19:0/2014621045 >> v2:172.21.15.19:3300/0 conn(0x7f37a80cf850 0x7f37a80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37ad3e4640 1 --2- 172.21.15.19:0/2014621045 >> v2:172.21.15.204:3300/0 conn(0x7f37a806cf20 0x7f37a806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37a7fff640 1 -- 172.21.15.19:0/2014621045 >> v2:172.21.15.204:3300/0 conn(0x7f37a806cf20 msgr2=0x7f37a806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37a7fff640 1 --2- 172.21.15.19:0/2014621045 >> v2:172.21.15.204:3300/0 conn(0x7f37a806cf20 0x7f37a806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37a7fff640 1 -- 172.21.15.19:0/2014621045 >> v1:172.21.15.19:6789/0 conn(0x7f37a80d00c0 legacy=0x7f37a80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37a7fff640 1 -- 172.21.15.19:0/2014621045 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a806c160 con 0x7f37a80cf850 2024-03-04T08:52:15.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.071+0000 7f37a77fe640 1 -- 172.21.15.19:0/2014621045 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301596224 0 0) 0x7f37a815e380 con 0x7f37a80d00c0 2024-03-04T08:52:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.072+0000 7f37a7fff640 1 --2- 172.21.15.19:0/2014621045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80cf850 0x7f37a80cd3c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f37a8071f50 tx=0x7f379002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7923f9846e659c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.072+0000 7f37a77fe640 1 -- 172.21.15.19:0/2014621045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790035020 con 0x7f37a80cf850 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.072+0000 7f37a77fe640 1 -- 172.21.15.19:0/2014621045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790031830 con 0x7f37a80cf850 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.072+0000 7f37a77fe640 1 -- 172.21.15.19:0/2014621045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790031c00 con 0x7f37a80cf850 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 -- 172.21.15.19:0/2014621045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80cf850 msgr2=0x7f37a80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 --2- 172.21.15.19:0/2014621045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80cf850 0x7f37a80cd3c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f37a8071f50 tx=0x7f379002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 -- 172.21.15.19:0/2014621045 shutdown_connections 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 --2- 172.21.15.19:0/2014621045 >> v2:172.21.15.204:3300/0 conn(0x7f37a806cf20 0x7f37a806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 --2- 172.21.15.19:0/2014621045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80cf850 0x7f37a80cd3c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 -- 172.21.15.19:0/2014621045 >> 172.21.15.19:0/2014621045 conn(0x7f37a80b35a0 msgr2=0x7f37a80b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 -- 172.21.15.19:0/2014621045 shutdown_connections 2024-03-04T08:52:15.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.073+0000 7f37aee47640 1 -- 172.21.15.19:0/2014621045 wait complete. 2024-03-04T08:52:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.074+0000 7f37aee47640 1 Processor -- start 2024-03-04T08:52:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.074+0000 7f37aee47640 1 -- start start 2024-03-04T08:52:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37a806cf20 0x7f37a8154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37a80cf850 0x7f37a80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80cd900 con 0x7f37a80d00c0 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a806c720 con 0x7f37a806cf20 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80b1030 con 0x7f37a80cf850 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36618/0 (socket says 172.21.15.19:36618) 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 -- 172.21.15.19:0/2736941292 learned_addr learned my addr 172.21.15.19:0/2736941292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37acbe3640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37a806cf20 0x7f37a8154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37a7fff640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37a80cf850 0x7f37a80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 -- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37a80cf850 msgr2=0x7f37a80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37a80cf850 0x7f37a80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 -- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37a806cf20 msgr2=0x7f37a8154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37a806cf20 0x7f37a8154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 -- 172.21.15.19:0/2736941292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80b4e40 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37ad3e4640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e40 tx=0x7f37a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014620 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a0019070 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014a20 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.075+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a80b5120 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.076+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a80b56e0 con 0x7f37a80d00c0 2024-03-04T08:52:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.076+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a804f330 con 0x7f37a80d00c0 2024-03-04T08:52:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.077+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37a0014bc0 con 0x7f37a80d00c0 2024-03-04T08:52:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.077+0000 7f37a57fa640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 0x7f378806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.077+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f37a008ab70 con 0x7f37a80d00c0 2024-03-04T08:52:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.078+0000 7f37acbe3640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 0x7f378806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.078+0000 7f37acbe3640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 0x7f378806d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3798007fd0 tx=0x7f3798007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.082+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f37a0059210 con 0x7f37a80d00c0 2024-03-04T08:52:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.272+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37a80cea80 con 0x7f37a80d00c0 2024-03-04T08:52:15.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.273+0000 7f37a57fa640 1 -- 172.21.15.19:0/2736941292 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f37a005d2b0 con 0x7f37a80d00c0 2024-03-04T08:52:15.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:15.270 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.275+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 msgr2=0x7f378806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.275+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 0x7f378806d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3798007fd0 tx=0x7f3798007de0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.275+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 msgr2=0x7f37a80b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.275+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e40 tx=0x7f37a000e4b0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 shutdown_connections 2024-03-04T08:52:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37a80d00c0 0x7f37a80b4810 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37a80cf850 0x7f37a80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f378806b4d0 0x7f378806d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 --2- 172.21.15.19:0/2736941292 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37a806cf20 0x7f37a8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 >> 172.21.15.19:0/2736941292 conn(0x7f37a80b35a0 msgr2=0x7f37a806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 shutdown_connections 2024-03-04T08:52:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.276+0000 7f37aee47640 1 -- 172.21.15.19:0/2736941292 wait complete. 2024-03-04T08:52:15.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:51:35.772177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:51:36.177235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-04T08:51:48.985080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:15.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:15.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.395+0000 7f5b34fb6640 1 Processor -- start 2024-03-04T08:52:15.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.395+0000 7f5b34fb6640 1 -- start start 2024-03-04T08:52:15.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b34fb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b300d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b34fb6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5b300b0e30 0x7f5b300b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b34fb6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b301618b0 con 0x7f5b301614d0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b34fb6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300d4cc0 con 0x7f5b300b0e30 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b34fb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300cf400 con 0x7f5b300d4860 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b2e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5b301614d0 0x7f5b300d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45828/0 (socket says 172.21.15.19:45828) 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.396+0000 7f5b2e59c640 1 -- 172.21.15.19:0/1002897187 learned_addr learned my addr 172.21.15.19:0/1002897187 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b27fff640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b300d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/1002897187 >> v2:172.21.15.204:3300/0 conn(0x7f5b300b0e30 0x7f5b300b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478484048 0 0) 0x7f5b301618b0 con 0x7f5b301614d0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c003520 con 0x7f5b301614d0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795983764 0 0) 0x7f5b1c003520 con 0x7f5b301614d0 2024-03-04T08:52:15.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 msgr2=0x7f5b300d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b300d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 >> v2:172.21.15.204:3300/0 conn(0x7f5b300b0e30 msgr2=0x7f5b300b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 --2- 172.21.15.19:0/1002897187 >> v2:172.21.15.204:3300/0 conn(0x7f5b300b0e30 0x7f5b300b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300cf6a0 con 0x7f5b301614d0 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f5b20001670 con 0x7f5b301614d0 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 >> v1:172.21.15.19:6789/0 conn(0x7f5b301614d0 legacy=0x7f5b300d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1c003f30 0x7f5b1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300d4cc0 con 0x7f5b1c004d40 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300cf400 con 0x7f5b1c003f30 2024-03-04T08:52:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c00b9c0 con 0x7f5b300d4860 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b27fff640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1c003f30 0x7f5b1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2e59c640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 -- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 msgr2=0x7f5b1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300d4860 0x7f5b1c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 -- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1c003f30 msgr2=0x7f5b1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1c003f30 0x7f5b1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b2ed9d640 1 -- 172.21.15.19:0/1002897187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c003520 con 0x7f5b1c004d40 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.397+0000 7f5b27fff640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b1c003f30 0x7f5b1c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.398+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b1c0051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009fc0 tx=0x7f5b1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40d5abae14cb0ef server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.398+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28039070 con 0x7f5b1c004d40 2024-03-04T08:52:15.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.398+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2802cc40 con 0x7f5b1c004d40 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.398+0000 7f5b2dd9b640 1 -- 172.21.15.19:0/1002897187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28009c10 con 0x7f5b1c004d40 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 -- 172.21.15.19:0/1002897187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 msgr2=0x7f5b1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/1002897187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b1c0051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009fc0 tx=0x7f5b1c005830 comp rx=0 tx=0).stop 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b2ed9d640 1 -- 172.21.15.19:0/1002897187 reap_dead start 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 -- 172.21.15.19:0/1002897187 shutdown_connections 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 -- 172.21.15.19:0/1002897187 >> 172.21.15.19:0/1002897187 conn(0x7f5b300d3d40 msgr2=0x7f5b300d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 -- 172.21.15.19:0/1002897187 shutdown_connections 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.399+0000 7f5b34fb6640 1 -- 172.21.15.19:0/1002897187 wait complete. 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.400+0000 7f5b34fb6640 1 Processor -- start 2024-03-04T08:52:15.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.400+0000 7f5b34fb6640 1 -- start start 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300cbe60 0x7f5b301f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300c8b30 0x7f5b30153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300b0910 con 0x7f5b1c004d40 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300cfc60 con 0x7f5b300c8b30 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b34fb6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300d2020 con 0x7f5b300cbe60 2024-03-04T08:52:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36636/0 (socket says 172.21.15.19:36636) 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 -- 172.21.15.19:0/2767587387 learned_addr learned my addr 172.21.15.19:0/2767587387 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2ed9d640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300c8b30 0x7f5b30153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b27fff640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300cbe60 0x7f5b301f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 -- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300cbe60 msgr2=0x7f5b301f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300cbe60 0x7f5b301f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 -- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300c8b30 msgr2=0x7f5b30153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300c8b30 0x7f5b30153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.401+0000 7f5b2e59c640 1 -- 172.21.15.19:0/2767587387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b301f7520 con 0x7f5b1c004d40 2024-03-04T08:52:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b2e59c640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000e8e0 tx=0x7f5b2000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20019070 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200053e0 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b301f77c0 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200047e0 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.402+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b301f7d80 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.403+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30068ff0 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.403+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b2001c070 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.404+0000 7f5b26ffd640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.404+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5b20089eb0 con 0x7f5b1c004d40 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.404+0000 7f5b27fff640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.404+0000 7f5b27fff640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 0x7f5b1006d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b3015d1c0 tx=0x7f5b18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.412+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5b20058b90 con 0x7f5b1c004d40 2024-03-04T08:52:15.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.592+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b30160a40 con 0x7f5b1c004d40 2024-03-04T08:52:15.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.593+0000 7f5b26ffd640 1 -- 172.21.15.19:0/2767587387 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b20058490 con 0x7f5b1c004d40 2024-03-04T08:52:15.589 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 msgr2=0x7f5b1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 0x7f5b1006d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b3015d1c0 tx=0x7f5b18008040 comp rx=0 tx=0).stop 2024-03-04T08:52:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 msgr2=0x7f5b3015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000e8e0 tx=0x7f5b2000eda0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 shutdown_connections 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b300c8b30 0x7f5b30153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5b300cbe60 0x7f5b301f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 --2- 172.21.15.19:0/2767587387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b1c004d40 0x7f5b3015d760 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 >> 172.21.15.19:0/2767587387 conn(0x7f5b300d3d40 msgr2=0x7f5b300b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 shutdown_connections 2024-03-04T08:52:15.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.595+0000 7f5b34fb6640 1 -- 172.21.15.19:0/2767587387 wait complete. 2024-03-04T08:52:15.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.713+0000 7ff195637640 1 Processor -- start 2024-03-04T08:52:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.713+0000 7ff195637640 1 -- start start 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff195637640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1900cf200 0x7ff1900cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff195637640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1901600a0 con 0x7ff1900d06e0 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff195637640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900d47f0 con 0x7ff19015fc30 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff195637640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900ced70 con 0x7ff1900cf200 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff18f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1900cf200 0x7ff1900cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff18f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1900cf200 0x7ff1900cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36644/0 (socket says 172.21.15.19:36644) 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff18effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff1900d06e0 0x7ff1900d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45830/0 (socket says 172.21.15.19:45830) 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.714+0000 7ff18f7fe640 1 -- 172.21.15.19:0/297306804 learned_addr learned my addr 172.21.15.19:0/297306804 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.715+0000 7ff18f7fe640 1 -- 172.21.15.19:0/297306804 >> v1:172.21.15.204:6789/0 conn(0x7ff19015fc30 legacy=0x7ff1900b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.715+0000 7ff18f7fe640 1 -- 172.21.15.19:0/297306804 >> v1:172.21.15.19:6789/0 conn(0x7ff1900d06e0 legacy=0x7ff1900d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.715+0000 7ff18e7fc640 1 -- 172.21.15.19:0/297306804 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801518223 0 0) 0x7ff1901600a0 con 0x7ff1900d06e0 2024-03-04T08:52:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.715+0000 7ff18f7fe640 1 -- 172.21.15.19:0/297306804 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900d1ab0 con 0x7ff1900cf200 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.715+0000 7ff18f7fe640 1 --2- 172.21.15.19:0/297306804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900cf200 0x7ff1900cf670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff188009e50 tx=0x7ff18802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5945d8e68c6c4bb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff18e7fc640 1 -- 172.21.15.19:0/297306804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18802cbb0 con 0x7ff1900cf200 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff18e7fc640 1 -- 172.21.15.19:0/297306804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18802cd50 con 0x7ff1900cf200 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff18e7fc640 1 -- 172.21.15.19:0/297306804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188034610 con 0x7ff1900cf200 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 -- 172.21.15.19:0/297306804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900cf200 msgr2=0x7ff1900cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 --2- 172.21.15.19:0/297306804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900cf200 0x7ff1900cf670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff188009e50 tx=0x7ff18802c010 comp rx=0 tx=0).stop 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 -- 172.21.15.19:0/297306804 shutdown_connections 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 --2- 172.21.15.19:0/297306804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900cf200 0x7ff1900cf670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 -- 172.21.15.19:0/297306804 >> 172.21.15.19:0/297306804 conn(0x7ff1900d3cd0 msgr2=0x7ff1900d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 -- 172.21.15.19:0/297306804 shutdown_connections 2024-03-04T08:52:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.716+0000 7ff195637640 1 -- 172.21.15.19:0/297306804 wait complete. 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.717+0000 7ff195637640 1 Processor -- start 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.717+0000 7ff195637640 1 -- start start 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1900cf200 0x7ff190153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 0x7ff19006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900ce990 con 0x7ff1900d06e0 2024-03-04T08:52:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900d4ab0 con 0x7ff19015fc30 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff195637640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900b44d0 con 0x7ff1900cf200 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff1867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff1867fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36660/0 (socket says 172.21.15.19:36660) 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff1867fc640 1 -- 172.21.15.19:0/1442229134 learned_addr learned my addr 172.21.15.19:0/1442229134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff18f7fe640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 0x7ff19006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.718+0000 7ff18effd640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1900cf200 0x7ff190153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 -- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1900cf200 msgr2=0x7ff190153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1900cf200 0x7ff190153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 -- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 msgr2=0x7ff19006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 0x7ff19006c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 -- 172.21.15.19:0/1442229134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900cd6c0 con 0x7ff1900d06e0 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff18f7fe640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 0x7ff19006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff1867fc640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c450 tx=0x7ff17800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780052d0 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178005470 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1900cd9a0 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178012870 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.719+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1900cb1b0 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.720+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1900cb3b0 con 0x7ff1900d06e0 2024-03-04T08:52:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.720+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff178012a10 con 0x7ff1900d06e0 2024-03-04T08:52:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.721+0000 7ff187fff640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 0x7ff17006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.721+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ff178089f10 con 0x7ff1900d06e0 2024-03-04T08:52:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.721+0000 7ff18effd640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 0x7ff17006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.721+0000 7ff18effd640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 0x7ff17006d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff180000f60 tx=0x7ff180007d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:15.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.725+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff178058c90 con 0x7ff1900d06e0 2024-03-04T08:52:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.905+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1900a1c80 con 0x7ff1900d06e0 2024-03-04T08:52:15.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.906+0000 7ff187fff640 1 -- 172.21.15.19:0/1442229134 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff178058590 con 0x7ff1900d06e0 2024-03-04T08:52:15.902 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 msgr2=0x7ff17006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 0x7ff17006d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff180000f60 tx=0x7ff180007d20 comp rx=0 tx=0).stop 2024-03-04T08:52:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 msgr2=0x7ff1900cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c450 tx=0x7ff17800c910 comp rx=0 tx=0).stop 2024-03-04T08:52:15.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 shutdown_connections 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff17006b4d0 0x7ff17006d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff19015fc30 0x7ff19006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1900d06e0 0x7ff1900cb6d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 --2- 172.21.15.19:0/1442229134 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff1900cf200 0x7ff190153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 >> 172.21.15.19:0/1442229134 conn(0x7ff1900d3cd0 msgr2=0x7ff190161640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 shutdown_connections 2024-03-04T08:52:15.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:15.908+0000 7ff195637640 1 -- 172.21.15.19:0/1442229134 wait complete. 2024-03-04T08:52:15.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.023+0000 7f37fc113640 1 Processor -- start 2024-03-04T08:52:16.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.023+0000 7f37fc113640 1 -- start start 2024-03-04T08:52:16.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fc113640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37f40d10c0 0x7f37f40d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fc113640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40cfa50 con 0x7f37f415ecd0 2024-03-04T08:52:16.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fc113640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40d0a30 con 0x7f37f40d14a0 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fc113640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f415c050 con 0x7f37f40d10c0 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37f9eaf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37f40d10c0 0x7f37f40d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fa6b0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f37f415ecd0 0x7f37f40cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45836/0 (socket says 172.21.15.19:45836) 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37fa6b0640 1 -- 172.21.15.19:0/777884600 learned_addr learned my addr 172.21.15.19:0/777884600 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37f9eaf640 1 -- 172.21.15.19:0/777884600 >> v1:172.21.15.204:6789/0 conn(0x7f37f40d14a0 legacy=0x7f37f415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37f9eaf640 1 -- 172.21.15.19:0/777884600 >> v1:172.21.15.19:6789/0 conn(0x7f37f415ecd0 legacy=0x7f37f40cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37f9eaf640 1 -- 172.21.15.19:0/777884600 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40b45c0 con 0x7f37f40d10c0 2024-03-04T08:52:16.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.024+0000 7f37f8ead640 1 -- 172.21.15.19:0/777884600 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477690968 0 0) 0x7f37f40cfa50 con 0x7f37f415ecd0 2024-03-04T08:52:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.025+0000 7f37f9eaf640 1 --2- 172.21.15.19:0/777884600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d10c0 0x7f37f40d04f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c0a421abae5215 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.025+0000 7f37f8ead640 1 -- 172.21.15.19:0/777884600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0035020 con 0x7f37f40d10c0 2024-03-04T08:52:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.025+0000 7f37f8ead640 1 -- 172.21.15.19:0/777884600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f0031830 con 0x7f37f40d10c0 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37f8ead640 1 -- 172.21.15.19:0/777884600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0031c00 con 0x7f37f40d10c0 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 -- 172.21.15.19:0/777884600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d10c0 msgr2=0x7f37f40d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 --2- 172.21.15.19:0/777884600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d10c0 0x7f37f40d04f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097a0 tx=0x7f37f002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 -- 172.21.15.19:0/777884600 shutdown_connections 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 --2- 172.21.15.19:0/777884600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d10c0 0x7f37f40d04f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 -- 172.21.15.19:0/777884600 >> 172.21.15.19:0/777884600 conn(0x7f37f40b3800 msgr2=0x7f37f40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 -- 172.21.15.19:0/777884600 shutdown_connections 2024-03-04T08:52:16.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.026+0000 7f37fc113640 1 -- 172.21.15.19:0/777884600 wait complete. 2024-03-04T08:52:16.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.027+0000 7f37fc113640 1 Processor -- start 2024-03-04T08:52:16.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.027+0000 7f37fc113640 1 -- start start 2024-03-04T08:52:16.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 0x7f37f415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 0x7f37f40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f415f440 con 0x7f37f40d14a0 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40d0060 con 0x7f37f40d10c0 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fc113640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40cfcf0 con 0x7f37f40b0070 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36678/0 (socket says 172.21.15.19:36678) 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 -- 172.21.15.19:0/3939994813 learned_addr learned my addr 172.21.15.19:0/3939994813 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f9eaf640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 0x7f37f415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fa6b0640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 0x7f37f40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 -- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 msgr2=0x7f37f40b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 0x7f37f40b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 -- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 msgr2=0x7f37f415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 0x7f37f415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f96ae640 1 -- 172.21.15.19:0/3939994813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f415b860 con 0x7f37f40d14a0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37f9eaf640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 0x7f37f415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.028+0000 7f37fa6b0640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 0x7f37f40b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37f96ae640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b3f0 tx=0x7f37e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4015020 con 0x7f37f40d14a0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e4011830 con 0x7f37f40d14a0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4011c20 con 0x7f37f40d14a0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40b76d0 con 0x7f37f40d14a0 2024-03-04T08:52:16.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.029+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40b7110 con 0x7f37f40d14a0 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.030+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f40b0480 con 0x7f37f40d14a0 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.030+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37e4018020 con 0x7f37f40d14a0 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.031+0000 7f37ea7fc640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 0x7f37d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.031+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f37e4089f90 con 0x7f37f40d14a0 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.031+0000 7f37f9eaf640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 0x7f37d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.031+0000 7f37f9eaf640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 0x7f37d806d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f37f0036000 tx=0x7f37f003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.035+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f37f40b0480 con 0x7f37f40d14a0 2024-03-04T08:52:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.229+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37f409fe60 con 0x7f37f40d14a0 2024-03-04T08:52:16.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.229+0000 7f37ea7fc640 1 -- 172.21.15.19:0/3939994813 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37e401f030 con 0x7f37f40d14a0 2024-03-04T08:52:16.226 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:16.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 msgr2=0x7f37d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 0x7f37d806d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f37f0036000 tx=0x7f37f003c040 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 msgr2=0x7f37f40afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b3f0 tx=0x7f37e400b8b0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 shutdown_connections 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f37f40b0070 0x7f37f40b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37f40d14a0 0x7f37f40afb30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f37d806b4d0 0x7f37d806d990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 --2- 172.21.15.19:0/3939994813 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f37f40d10c0 0x7f37f415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 >> 172.21.15.19:0/3939994813 conn(0x7f37f40b3800 msgr2=0x7f37f40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 shutdown_connections 2024-03-04T08:52:16.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.231+0000 7f37fc113640 1 -- 172.21.15.19:0/3939994813 wait complete. 2024-03-04T08:52:16.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-04T08:52:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.347+0000 7fb59ee0f640 1 Processor -- start 2024-03-04T08:52:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.347+0000 7fb59ee0f640 1 -- start start 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.347+0000 7fb59ee0f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb5980d10c0 0x7fb5980d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb59ee0f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5980cfa50 con 0x7fb5980d14a0 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb59ee0f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5980d0a30 con 0x7fb59815ecd0 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb59ee0f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59815c050 con 0x7fb5980d10c0 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb597fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb5980d14a0 0x7fb59815e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45844/0 (socket says 172.21.15.19:45844) 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb597fff640 1 -- 172.21.15.19:0/3577100219 learned_addr learned my addr 172.21.15.19:0/3577100219 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3577100219 >> v2:172.21.15.204:3300/0 conn(0x7fb5980d10c0 0x7fb5980d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253754844 0 0) 0x7fb5980cfa50 con 0x7fb5980d14a0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588003520 con 0x7fb5980d14a0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000068409 0 0) 0x7fb588003520 con 0x7fb5980d14a0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 >> v2:172.21.15.204:3300/0 conn(0x7fb5980d10c0 msgr2=0x7fb5980d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 --2- 172.21.15.19:0/3577100219 >> v2:172.21.15.204:3300/0 conn(0x7fb5980d10c0 0x7fb5980d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 >> v1:172.21.15.204:6789/0 conn(0x7fb59815ecd0 legacy=0x7fb5980cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980b45c0 con 0x7fb5980d14a0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fb584001670 con 0x7fb5980d14a0 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3577100219 >> v2:172.21.15.204:3300/0 conn(0x7fb5980d10c0 0x7fb5980d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 >> v1:172.21.15.19:6789/0 conn(0x7fb5980d14a0 legacy=0x7fb59815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5880039b0 0x7fb588003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 0x7fb588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5880051c0 0x7fb58800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c030 con 0x7fb588004800 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c1e0 con 0x7fb5880051c0 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800c3e0 con 0x7fb5880039b0 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.348+0000 7fb597fff640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 0x7fb588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5880039b0 0x7fb588003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb59d3ac640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5880051c0 0x7fb58800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 -- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5880039b0 msgr2=0x7fb588003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb5880039b0 0x7fb588003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 -- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5880051c0 msgr2=0x7fb58800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb5880051c0 0x7fb58800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 -- 172.21.15.19:0/3577100219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588003520 con 0x7fb588004800 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb59d3ac640 1 -- 172.21.15.19:0/3577100219 reap_dead start 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.349+0000 7fb597fff640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 0x7fb588004c80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c210 tx=0x7fb588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc05bd93e9e8e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584007d30 con 0x7fb588004800 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584030070 con 0x7fb588004800 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb5977fe640 1 -- 172.21.15.19:0/3577100219 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58402cda0 con 0x7fb588004800 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 msgr2=0x7fb588004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 0x7fb588004c80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c210 tx=0x7fb588005830 comp rx=0 tx=0).stop 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3577100219 shutdown_connections 2024-03-04T08:52:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3577100219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb588004800 0x7fb588004c80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3577100219 >> 172.21.15.19:0/3577100219 conn(0x7fb5980b3800 msgr2=0x7fb5980b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3577100219 shutdown_connections 2024-03-04T08:52:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.350+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3577100219 wait complete. 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 Processor -- start 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 -- start start 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb588004800 0x7fb5980b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 0x7fb5980b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815f440 con 0x7fb5980b6770 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980d0060 con 0x7fb588004800 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.352+0000 7fb59ee0f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980cfcf0 con 0x7fb59814f6b0 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36700/0 (socket says 172.21.15.19:36700) 2024-03-04T08:52:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 -- 172.21.15.19:0/3176123225 learned_addr learned my addr 172.21.15.19:0/3176123225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb588004800 0x7fb5980b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb597fff640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 0x7fb5980b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 -- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 msgr2=0x7fb5980b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 0x7fb5980b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 -- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb588004800 msgr2=0x7fb5980b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb588004800 0x7fb5980b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 -- 172.21.15.19:0/3176123225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980ceec0 con 0x7fb5980b6770 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb597fff640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 0x7fb5980b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59d3ac640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb598072610 tx=0x7fb59000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59001a070 con 0x7fb5980b6770 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590006d60 con 0x7fb5980b6770 2024-03-04T08:52:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5980b48f0 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590003bb0 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.353+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5980b4eb0 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.354+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59814fa90 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.355+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb59001d070 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.355+0000 7fb5957fa640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 0x7fb57c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.355+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb5900899e0 con 0x7fb5980b6770 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.355+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 0x7fb57c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.356+0000 7fb59cbab640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 0x7fb57c06d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5980686a0 tx=0x7fb58c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.360+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb590058760 con 0x7fb5980b6770 2024-03-04T08:52:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.549+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fb59809fe60 con 0x7fb5980b6770 2024-03-04T08:52:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.550+0000 7fb5957fa640 1 -- 172.21.15.19:0/3176123225 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v37) v1 ==== 97+0+11 (secure 0 0 0) 0x7fb590058060 con 0x7fb5980b6770 2024-03-04T08:52:16.546 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.551+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 msgr2=0x7fb57c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.551+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 0x7fb57c06d990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5980686a0 tx=0x7fb58c008040 comp rx=0 tx=0).stop 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.551+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 msgr2=0x7fb5980ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.551+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb598072610 tx=0x7fb59000fc00 comp rx=0 tx=0).stop 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 shutdown_connections 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5980b6770 0x7fb5980ce2b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb59814f6b0 0x7fb5980b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb57c06b4d0 0x7fb57c06d990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 --2- 172.21.15.19:0/3176123225 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb588004800 0x7fb5980b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 >> 172.21.15.19:0/3176123225 conn(0x7fb5980b3800 msgr2=0x7fb5980b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 shutdown_connections 2024-03-04T08:52:16.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.552+0000 7fb59ee0f640 1 -- 172.21.15.19:0/3176123225 wait complete. 2024-03-04T08:52:16.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:16.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.664+0000 7f831b725640 1 Processor -- start 2024-03-04T08:52:16.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.664+0000 7f831b725640 1 -- start start 2024-03-04T08:52:16.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.665+0000 7f831b725640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4170 0x7f83140b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.665+0000 7f831b725640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83140d4760 0x7f83140d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.665+0000 7f831b725640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140d25d0 con 0x7f83140b4dd0 2024-03-04T08:52:16.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.665+0000 7f831b725640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140d4bf0 con 0x7f83140d4760 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.665+0000 7f831b725640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140ce9e0 con 0x7f83140b4170 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83140d4760 0x7f83140d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83140d4760 0x7f83140d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36712/0 (socket says 172.21.15.19:36712) 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 -- 172.21.15.19:0/3326706480 learned_addr learned my addr 172.21.15.19:0/3326706480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8319cc2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f83140b4dd0 0x7f83140cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45852/0 (socket says 172.21.15.19:45852) 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f83194c1640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4170 0x7f83140b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 -- 172.21.15.19:0/3326706480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4170 msgr2=0x7f83140b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4170 0x7f83140b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 -- 172.21.15.19:0/3326706480 >> v1:172.21.15.19:6789/0 conn(0x7f83140b4dd0 legacy=0x7f83140cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f830bfff640 1 -- 172.21.15.19:0/3326706480 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014494459 0 0) 0x7f83140d25d0 con 0x7f83140b4dd0 2024-03-04T08:52:16.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.666+0000 7f8318cc0640 1 -- 172.21.15.19:0/3326706480 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140d2870 con 0x7f83140d4760 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f8318cc0640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140d4760 0x7f83140d0370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb2f4a13cecd122 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f830bfff640 1 -- 172.21.15.19:0/3326706480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304034070 con 0x7f83140d4760 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f830bfff640 1 -- 172.21.15.19:0/3326706480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304030840 con 0x7f83140d4760 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f830bfff640 1 -- 172.21.15.19:0/3326706480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304030c10 con 0x7f83140d4760 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 -- 172.21.15.19:0/3326706480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140d4760 msgr2=0x7f83140d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140d4760 0x7f83140d0370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830402b980 comp rx=0 tx=0).stop 2024-03-04T08:52:16.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 -- 172.21.15.19:0/3326706480 shutdown_connections 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140d4760 0x7f83140d0370 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 --2- 172.21.15.19:0/3326706480 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4170 0x7f83140b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 -- 172.21.15.19:0/3326706480 >> 172.21.15.19:0/3326706480 conn(0x7f83140d3c40 msgr2=0x7f83140d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 -- 172.21.15.19:0/3326706480 shutdown_connections 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.667+0000 7f831b725640 1 -- 172.21.15.19:0/3326706480 wait complete. 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.669+0000 7f831b725640 1 Processor -- start 2024-03-04T08:52:16.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.669+0000 7f831b725640 1 -- start start 2024-03-04T08:52:16.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4dd0 0x7f83140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83141f3b90 0x7f83141f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b47d0 con 0x7f83140b4170 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b4550 con 0x7f83141f3b90 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f831b725640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b4950 con 0x7f83140b4dd0 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36718/0 (socket says 172.21.15.19:36718) 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 -- 172.21.15.19:0/3390919011 learned_addr learned my addr 172.21.15.19:0/3390919011 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 -- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4dd0 msgr2=0x7f83140c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f8318cc0640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4dd0 0x7f83140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4dd0 0x7f83140c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f8319cc2640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83141f3b90 0x7f83141f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 -- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83141f3b90 msgr2=0x7f83141f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83141f3b90 0x7f83141f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 -- 172.21.15.19:0/3390919011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831415bdc0 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f83194c1640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f831000c7f0 tx=0x7f831000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.670+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310015070 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.671+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310004240 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.671+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310007620 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.671+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831415c0a0 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.671+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831415c660 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.672+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831404f330 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.672+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83100079d0 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.672+0000 7f8309ffb640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 0x7f82f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.673+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f831008a3f0 con 0x7f83140b4170 2024-03-04T08:52:16.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.673+0000 7f8318cc0640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 0x7f82f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:16.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.673+0000 7f8318cc0640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 0x7f82f806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8304036000 tx=0x7f8304008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:16.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.681+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f83100590e0 con 0x7f83140b4170 2024-03-04T08:52:16.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.900+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83140733b0 con 0x7f83140b4170 2024-03-04T08:52:16.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.901+0000 7f8309ffb640 1 -- 172.21.15.19:0/3390919011 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4981 (secure 0 0 0) 0x7f83100589e0 con 0x7f83140b4170 2024-03-04T08:52:16.897 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:16.897 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:49.451927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:52:16.898 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-03-04T08:52:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 msgr2=0x7f82f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 0x7f82f806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8304036000 tx=0x7f8304008030 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 msgr2=0x7f8314152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f831000c7f0 tx=0x7f831000ccb0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 shutdown_connections 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f82f806b4d0 0x7f82f806d990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f83141f3b90 0x7f83141f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140b4dd0 0x7f83140c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 --2- 172.21.15.19:0/3390919011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83140b4170 0x7f8314152150 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 >> 172.21.15.19:0/3390919011 conn(0x7f83140d3c40 msgr2=0x7f83140b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 shutdown_connections 2024-03-04T08:52:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:16.903+0000 7f831b725640 1 -- 172.21.15.19:0/3390919011 wait complete. 2024-03-04T08:52:16.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:17.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.016+0000 7f341cc66640 1 Processor -- start 2024-03-04T08:52:17.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.016+0000 7f341cc66640 1 -- start start 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341cc66640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3418162020 0x7f34180d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341cc66640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180b1070 con 0x7f3418162400 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341cc66640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180d2500 con 0x7f3418162a00 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341cc66640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180ce9d0 con 0x7f3418162020 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341659c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3418162020 0x7f34180d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f3416d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3418162400 0x7f34180cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45856/0 (socket says 172.21.15.19:45856) 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f3416d9d640 1 -- 172.21.15.19:0/728653196 learned_addr learned my addr 172.21.15.19:0/728653196 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341659c640 1 -- 172.21.15.19:0/728653196 >> v1:172.21.15.204:6789/0 conn(0x7f3418162a00 legacy=0x7f34180b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.017+0000 7f341659c640 1 -- 172.21.15.19:0/728653196 >> v1:172.21.15.19:6789/0 conn(0x7f3418162400 legacy=0x7f34180cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341559a640 1 -- 172.21.15.19:0/728653196 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895331434 0 0) 0x7f34180b1070 con 0x7f3418162400 2024-03-04T08:52:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341659c640 1 -- 172.21.15.19:0/728653196 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180d27e0 con 0x7f3418162020 2024-03-04T08:52:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341659c640 1 --2- 172.21.15.19:0/728653196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f34180d4830 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df6be126c98d66c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341559a640 1 -- 172.21.15.19:0/728653196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408039070 con 0x7f3418162020 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341559a640 1 -- 172.21.15.19:0/728653196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340802cd80 con 0x7f3418162020 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.018+0000 7f341559a640 1 -- 172.21.15.19:0/728653196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408034660 con 0x7f3418162020 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 -- 172.21.15.19:0/728653196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 msgr2=0x7f34180d4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 --2- 172.21.15.19:0/728653196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f34180d4830 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340802bfd0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 -- 172.21.15.19:0/728653196 shutdown_connections 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 --2- 172.21.15.19:0/728653196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f34180d4830 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 -- 172.21.15.19:0/728653196 >> 172.21.15.19:0/728653196 conn(0x7f34180d3d10 msgr2=0x7f34180d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 -- 172.21.15.19:0/728653196 shutdown_connections 2024-03-04T08:52:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.019+0000 7f341cc66640 1 -- 172.21.15.19:0/728653196 wait complete. 2024-03-04T08:52:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.020+0000 7f341cc66640 1 Processor -- start 2024-03-04T08:52:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.020+0000 7f341cc66640 1 -- start start 2024-03-04T08:52:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 0x7f341814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3418162a00 0x7f34180d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180cec00 con 0x7f3418162020 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180d2da0 con 0x7f3418162400 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341cc66640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180cfb10 con 0x7f3418162a00 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36746/0 (socket says 172.21.15.19:36746) 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 -- 172.21.15.19:0/759234658 learned_addr learned my addr 172.21.15.19:0/759234658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 -- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3418162a00 msgr2=0x7f34180d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3418162a00 0x7f34180d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f3415d9b640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 0x7f341814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 -- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 msgr2=0x7f341814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 0x7f341814a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f341659c640 1 -- 172.21.15.19:0/759234658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341814e020 con 0x7f3418162020 2024-03-04T08:52:17.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.021+0000 7f3415d9b640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 0x7f341814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f341659c640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3408037040 tx=0x7f3408004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408044020 con 0x7f3418162020 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340803f670 con 0x7f3418162020 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341815d9f0 con 0x7f3418162020 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408039040 con 0x7f3418162020 2024-03-04T08:52:17.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.022+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341815dc90 con 0x7f3418162020 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.023+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341804f330 con 0x7f3418162020 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.023+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3408047020 con 0x7f3418162020 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.024+0000 7f340effd640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 0x7f33f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.024+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f34080acca0 con 0x7f3418162020 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.024+0000 7f3415d9b640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 0x7f33f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.025+0000 7f3415d9b640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 0x7f33f806d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f341806d560 tx=0x7f3400009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.032+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f340804e070 con 0x7f3418162020 2024-03-04T08:52:17.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.214+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3418073380 con 0x7f3418162020 2024-03-04T08:52:17.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.216+0000 7f340effd640 1 -- 172.21.15.19:0/759234658 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f341814e020 con 0x7f3418162020 2024-03-04T08:52:17.212 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:17.212 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.217+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 msgr2=0x7f33f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.217+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 0x7f33f806d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f341806d560 tx=0x7f3400009040 comp rx=0 tx=0).stop 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 msgr2=0x7f341814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3408037040 tx=0x7f3408004a40 comp rx=0 tx=0).stop 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 shutdown_connections 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3418162a00 0x7f34180d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33f806b500 0x7f33f806d9c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3418162400 0x7f341814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 --2- 172.21.15.19:0/759234658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3418162020 0x7f341814dae0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 >> 172.21.15.19:0/759234658 conn(0x7f34180d3d10 msgr2=0x7f3418160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 shutdown_connections 2024-03-04T08:52:17.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.218+0000 7f341cc66640 1 -- 172.21.15.19:0/759234658 wait complete. 2024-03-04T08:52:17.228 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T08:52:17.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.334+0000 7f032a5d7640 1 Processor -- start 2024-03-04T08:52:17.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 -- start start 2024-03-04T08:52:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f032415dfe0 0x7f03240cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f03240d29c0 0x7f03240b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03240b3430 con 0x7f03240cf830 2024-03-04T08:52:17.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240b31e0 con 0x7f032415dfe0 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f032a5d7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240b3d60 con 0x7f03240d29c0 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f0323fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f032415dfe0 0x7f03240cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f03237fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03240cf830 0x7f03240d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45868/0 (socket says 172.21.15.19:45868) 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.335+0000 7f03237fe640 1 -- 172.21.15.19:0/1374308157 learned_addr learned my addr 172.21.15.19:0/1374308157 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0328b74640 1 --2- 172.21.15.19:0/1374308157 >> v2:172.21.15.204:3300/0 conn(0x7f03240d29c0 0x7f03240b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0323fff640 1 -- 172.21.15.19:0/1374308157 >> v2:172.21.15.204:3300/0 conn(0x7f03240d29c0 msgr2=0x7f03240b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0323fff640 1 --2- 172.21.15.19:0/1374308157 >> v2:172.21.15.204:3300/0 conn(0x7f03240d29c0 0x7f03240b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0323fff640 1 -- 172.21.15.19:0/1374308157 >> v1:172.21.15.19:6789/0 conn(0x7f03240cf830 legacy=0x7f03240d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0322ffd640 1 -- 172.21.15.19:0/1374308157 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202721691 0 0) 0x7f03240b3430 con 0x7f03240cf830 2024-03-04T08:52:17.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.336+0000 7f0323fff640 1 -- 172.21.15.19:0/1374308157 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240b3710 con 0x7f032415dfe0 2024-03-04T08:52:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.337+0000 7f0323fff640 1 --2- 172.21.15.19:0/1374308157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f03240cf2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f03240b3cd0 tx=0x7f031402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2840a05cb4bfa52 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.337+0000 7f0322ffd640 1 -- 172.21.15.19:0/1374308157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314035020 con 0x7f032415dfe0 2024-03-04T08:52:17.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.337+0000 7f0322ffd640 1 -- 172.21.15.19:0/1374308157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314031830 con 0x7f032415dfe0 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.337+0000 7f0322ffd640 1 -- 172.21.15.19:0/1374308157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314031c00 con 0x7f032415dfe0 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 -- 172.21.15.19:0/1374308157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 msgr2=0x7f03240cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 --2- 172.21.15.19:0/1374308157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f03240cf2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f03240b3cd0 tx=0x7f031402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 -- 172.21.15.19:0/1374308157 shutdown_connections 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 --2- 172.21.15.19:0/1374308157 >> v2:172.21.15.204:3300/0 conn(0x7f03240d29c0 0x7f03240b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 --2- 172.21.15.19:0/1374308157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f03240cf2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 -- 172.21.15.19:0/1374308157 >> 172.21.15.19:0/1374308157 conn(0x7f03240d3cd0 msgr2=0x7f03240d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 -- 172.21.15.19:0/1374308157 shutdown_connections 2024-03-04T08:52:17.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.338+0000 7f032a5d7640 1 -- 172.21.15.19:0/1374308157 wait complete. 2024-03-04T08:52:17.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.339+0000 7f032a5d7640 1 Processor -- start 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.339+0000 7f032a5d7640 1 -- start start 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 0x7f0324161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03240d29c0 0x7f03240cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03240d1df0 con 0x7f032415dfe0 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03240d1c70 con 0x7f03240d29c0 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f032a5d7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032415e3c0 con 0x7f03240cf830 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36770/0 (socket says 172.21.15.19:36770) 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 -- 172.21.15.19:0/545539586 learned_addr learned my addr 172.21.15.19:0/545539586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f03237fe640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03240d29c0 0x7f03240cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0323fff640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 0x7f0324161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 -- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 msgr2=0x7f0324161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 0x7f0324161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 -- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03240d29c0 msgr2=0x7f03240cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03240d29c0 0x7f03240cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 -- 172.21.15.19:0/545539586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240cb370 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0323fff640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 0x7f0324161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.340+0000 7f0328b74640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f031c00cd40 tx=0x7f031c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.341+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c003b90 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.341+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c003d30 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.341+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c004240 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.341+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0324151550 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.341+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03240cd8d0 con 0x7f032415dfe0 2024-03-04T08:52:17.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.342+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032404f330 con 0x7f032415dfe0 2024-03-04T08:52:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.342+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f031c0043e0 con 0x7f032415dfe0 2024-03-04T08:52:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.343+0000 7f0320ff9640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.343+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f031c08ae50 con 0x7f032415dfe0 2024-03-04T08:52:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.343+0000 7f0323fff640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.344+0000 7f0323fff640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 0x7f030406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0314036000 tx=0x7f0314008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.351+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f031c059b40 con 0x7f032415dfe0 2024-03-04T08:52:17.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.749+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03240b5510 con 0x7f032415dfe0 2024-03-04T08:52:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.750+0000 7f0320ff9640 1 -- 172.21.15.19:0/545539586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4981 (secure 0 0 0) 0x7f031c059440 con 0x7f032415dfe0 2024-03-04T08:52:17.746 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:17.746 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:49.451927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:52:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-03-04T08:52:17.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 msgr2=0x7f030406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 0x7f030406d990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0314036000 tx=0x7f0314008030 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 msgr2=0x7f0324151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f031c00cd40 tx=0x7f031c00a660 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 shutdown_connections 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032415dfe0 0x7f0324151010 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f030406b4d0 0x7f030406d990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f03240d29c0 0x7f03240cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 --2- 172.21.15.19:0/545539586 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f03240cf830 0x7f0324161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 >> 172.21.15.19:0/545539586 conn(0x7f03240d3cd0 msgr2=0x7f03240b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.752+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 shutdown_connections 2024-03-04T08:52:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.753+0000 7f032a5d7640 1 -- 172.21.15.19:0/545539586 wait complete. 2024-03-04T08:52:17.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.870+0000 7f82049e9640 1 Processor -- start 2024-03-04T08:52:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.870+0000 7f82049e9640 1 -- start start 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f82049e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820015e180 0x7f820006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f82049e9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f82000b0aa0 0x7f820006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f82049e9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820006cfa0 con 0x7f820006c680 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f82049e9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82000d06c0 con 0x7f82000b0aa0 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f82049e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820015f380 con 0x7f820015e180 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f81fe59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f820006c680 0x7f82000d0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52070/0 (socket says 172.21.15.19:52070) 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f81fe59c640 1 -- 172.21.15.19:0/373790530 learned_addr learned my addr 172.21.15.19:0/373790530 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f81fed9d640 1 --2- 172.21.15.19:0/373790530 >> v2:172.21.15.204:3300/0 conn(0x7f82000b0aa0 0x7f820006ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f81fdd9b640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820015e180 0x7f820006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.871+0000 7f81fd59a640 1 -- 172.21.15.19:0/373790530 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780894127 0 0) 0x7f820006cfa0 con 0x7f820006c680 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.872+0000 7f81fd59a640 1 -- 172.21.15.19:0/373790530 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e8003520 con 0x7f820006c680 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.872+0000 7f81fed9d640 1 -- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820015e180 msgr2=0x7f820006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.872+0000 7f81fed9d640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820015e180 0x7f820006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.872+0000 7f81fed9d640 1 -- 172.21.15.19:0/373790530 >> v1:172.21.15.19:6789/0 conn(0x7f820006c680 legacy=0x7f82000d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.872+0000 7f81fed9d640 1 -- 172.21.15.19:0/373790530 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000d0070 con 0x7f82000b0aa0 2024-03-04T08:52:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.873+0000 7f81fed9d640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f820006ca60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009d90 tx=0x7f81f802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6f25ce2c7997968 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.873+0000 7f81fd59a640 1 -- 172.21.15.19:0/373790530 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8039070 con 0x7f82000b0aa0 2024-03-04T08:52:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.873+0000 7f81fd59a640 1 -- 172.21.15.19:0/373790530 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f802cc50 con 0x7f82000b0aa0 2024-03-04T08:52:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.873+0000 7f81fd59a640 1 -- 172.21.15.19:0/373790530 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8034440 con 0x7f82000b0aa0 2024-03-04T08:52:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 -- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 msgr2=0x7f820006ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f820006ca60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009d90 tx=0x7f81f802bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 -- 172.21.15.19:0/373790530 shutdown_connections 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f820006ca60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 --2- 172.21.15.19:0/373790530 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820015e180 0x7f820006c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 -- 172.21.15.19:0/373790530 >> 172.21.15.19:0/373790530 conn(0x7f82000d1b20 msgr2=0x7f82000d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 -- 172.21.15.19:0/373790530 shutdown_connections 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.874+0000 7f82049e9640 1 -- 172.21.15.19:0/373790530 wait complete. 2024-03-04T08:52:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.875+0000 7f82049e9640 1 Processor -- start 2024-03-04T08:52:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.875+0000 7f82049e9640 1 -- start start 2024-03-04T08:52:17.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820006c680 0x7f82000b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f82000b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cfe30 con 0x7f820015e180 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cfcb0 con 0x7f82000b0aa0 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f82049e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820015efa0 con 0x7f820006c680 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f81fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f81fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55850/0 (socket says 172.21.15.19:55850) 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f81fed9d640 1 -- 172.21.15.19:0/2787539027 learned_addr learned my addr 172.21.15.19:0/2787539027 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:17.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f81fdd9b640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f82000b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.876+0000 7f81fe59c640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820006c680 0x7f82000b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 -- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820006c680 msgr2=0x7f82000b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820006c680 0x7f82000b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 -- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 msgr2=0x7f82000b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f82000b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 -- 172.21.15.19:0/2787539027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82001f7b90 con 0x7f820015e180 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81fed9d640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009d90 tx=0x7f81f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8039050 con 0x7f820015e180 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8045070 con 0x7f820015e180 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82001f7e70 con 0x7f820015e180 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8009450 con 0x7f820015e180 2024-03-04T08:52:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.877+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82000c6fa0 con 0x7f820015e180 2024-03-04T08:52:17.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.878+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82000c71a0 con 0x7f820015e180 2024-03-04T08:52:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.879+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81f803e610 con 0x7f820015e180 2024-03-04T08:52:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.879+0000 7f81eeffd640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 0x7f81e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.879+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f81f80acc10 con 0x7f820015e180 2024-03-04T08:52:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.879+0000 7f81fe59c640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 0x7f81e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.880+0000 7f81fe59c640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 0x7f81e006d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f81f0005880 tx=0x7f81f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:17.884+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f82000c71a0 con 0x7f820015e180 2024-03-04T08:52:18.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.103+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82001f8040 con 0x7f820015e180 2024-03-04T08:52:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.103+0000 7f81eeffd640 1 -- 172.21.15.19:0/2787539027 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4981 (secure 0 0 0) 0x7f81f807b370 con 0x7f820015e180 2024-03-04T08:52:18.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:18.100 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:51:37.211729+0000","modified":"2024-03-04T08:51:49.451927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/2471090824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":2471090824},{"type":"v1","addr":"172.21.15.19:6835","nonce":2471090824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":2}]} 2024-03-04T08:52:18.100 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 14 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 msgr2=0x7f81e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 0x7f81e006d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f81f0005880 tx=0x7f81f0009040 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 msgr2=0x7f82001f7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009d90 tx=0x7f81f8004a40 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 shutdown_connections 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f820015e180 0x7f82001f7140 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f81e006b4d0 0x7f81e006d990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f82000b0aa0 0x7f82000b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 --2- 172.21.15.19:0/2787539027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f820006c680 0x7f82000b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.105+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 >> 172.21.15.19:0/2787539027 conn(0x7f82000d1b20 msgr2=0x7f82000d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.106+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 shutdown_connections 2024-03-04T08:52:18.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.106+0000 7f82049e9640 1 -- 172.21.15.19:0/2787539027 wait complete. 2024-03-04T08:52:18.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.219+0000 7f4cf330f640 1 Processor -- start 2024-03-04T08:52:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.219+0000 7f4cf330f640 1 -- start start 2024-03-04T08:52:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf330f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cec15bb20 0x7f4cec0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf330f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec161980 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf330f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec161c60 con 0x7f4cec0cfff0 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf330f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec161f40 con 0x7f4cec15bb20 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf10ab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cec15bb20 0x7f4cec0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf18ac640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4cec0cd8c0 0x7f4cec0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52076/0 (socket says 172.21.15.19:52076) 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf18ac640 1 -- 172.21.15.19:0/161792850 learned_addr learned my addr 172.21.15.19:0/161792850 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf10ab640 1 -- 172.21.15.19:0/161792850 >> v1:172.21.15.204:6789/0 conn(0x7f4cec0cfff0 legacy=0x7f4cec0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf10ab640 1 -- 172.21.15.19:0/161792850 >> v1:172.21.15.19:6789/0 conn(0x7f4cec0cd8c0 legacy=0x7f4cec0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4ce3fff640 1 -- 172.21.15.19:0/161792850 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205998433 0 0) 0x7f4cec161980 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.220+0000 7f4cf10ab640 1 -- 172.21.15.19:0/161792850 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec162220 con 0x7f4cec15bb20 2024-03-04T08:52:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.221+0000 7f4cf10ab640 1 --2- 172.21.15.19:0/161792850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec15bb20 0x7f4cec0d1df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830677072ec94ef7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.221+0000 7f4ce3fff640 1 -- 172.21.15.19:0/161792850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8034070 con 0x7f4cec15bb20 2024-03-04T08:52:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4ce3fff640 1 -- 172.21.15.19:0/161792850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8030610 con 0x7f4cec15bb20 2024-03-04T08:52:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4ce3fff640 1 -- 172.21.15.19:0/161792850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80309e0 con 0x7f4cec15bb20 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 -- 172.21.15.19:0/161792850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec15bb20 msgr2=0x7f4cec0d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 --2- 172.21.15.19:0/161792850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec15bb20 0x7f4cec0d1df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802b960 comp rx=0 tx=0).stop 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 -- 172.21.15.19:0/161792850 shutdown_connections 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 --2- 172.21.15.19:0/161792850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec15bb20 0x7f4cec0d1df0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 -- 172.21.15.19:0/161792850 >> 172.21.15.19:0/161792850 conn(0x7f4cec09a9f0 msgr2=0x7f4cec09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 -- 172.21.15.19:0/161792850 shutdown_connections 2024-03-04T08:52:18.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.222+0000 7f4cf330f640 1 -- 172.21.15.19:0/161792850 wait complete. 2024-03-04T08:52:18.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.223+0000 7f4cf330f640 1 Processor -- start 2024-03-04T08:52:18.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.223+0000 7f4cf330f640 1 -- start start 2024-03-04T08:52:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 0x7f4cec14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cec15bb20 0x7f4cec14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0d2330 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0cf2d0 con 0x7f4cec15bb20 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf330f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0d24b0 con 0x7f4cec0cfff0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf10ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf10ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55854/0 (socket says 172.21.15.19:55854) 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf10ab640 1 -- 172.21.15.19:0/3811946849 learned_addr learned my addr 172.21.15.19:0/3811946849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.224+0000 7f4cf18ac640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cec15bb20 0x7f4cec14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf08aa640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 0x7f4cec14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 -- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 msgr2=0x7f4cec14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 0x7f4cec14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 -- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cec15bb20 msgr2=0x7f4cec14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cec15bb20 0x7f4cec14e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 -- 172.21.15.19:0/3811946849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec06cac0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf08aa640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 0x7f4cec14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf10ab640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098c0 tx=0x7f4ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8034040 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8039a10 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec06cda0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8039de0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.225+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec06d360 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.226+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec04f330 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.227+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ce8037070 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.227+0000 7f4ce1ffb640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 0x7f4cd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.227+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f4ce80ac4d0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.227+0000 7f4cf08aa640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 0x7f4cd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.228+0000 7f4cf08aa640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 0x7f4cd006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4cec09b2d0 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.231+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4ce807b1c0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.413+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cec0b7650 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.414+0000 7f4ce1ffb640 1 -- 172.21.15.19:0/3811946849 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f4ce807aac0 con 0x7f4cec0cd8c0 2024-03-04T08:52:18.410 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:18.411 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:51:51.049218+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:51:35.772177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-04T08:51:36.177235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-04T08:51:48.985080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 msgr2=0x7f4cd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 0x7f4cd006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4cec09b2d0 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 msgr2=0x7f4cec0c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098c0 tx=0x7f4ce80046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 shutdown_connections 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4cd006b4d0 0x7f4cd006d990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4cec15bb20 0x7f4cec14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4cec0cfff0 0x7f4cec14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 --2- 172.21.15.19:0/3811946849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cec0cd8c0 0x7f4cec0c55f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 >> 172.21.15.19:0/3811946849 conn(0x7f4cec09a9f0 msgr2=0x7f4cec0702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 shutdown_connections 2024-03-04T08:52:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.416+0000 7f4cf330f640 1 -- 172.21.15.19:0/3811946849 wait complete. 2024-03-04T08:52:18.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T08:52:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.538+0000 7fbd83cfb640 1 Processor -- start 2024-03-04T08:52:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 -- start start 2024-03-04T08:52:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 0x7fbd7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd7c0b0270 0x7fbd7c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 0x7fbd7c06c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0af4b0 con 0x7fbd7c0b0270 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0af790 con 0x7fbd7c0b1850 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd83cfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0afa70 con 0x7fbd7c1614a0 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.539+0000 7fbd81296640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd7c0b0270 0x7fbd7c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd7c0b0270 0x7fbd7c0b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55860/0 (socket says 172.21.15.19:55860) 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 -- 172.21.15.19:0/1444022849 learned_addr learned my addr 172.21.15.19:0/1444022849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd82298640 1 --2- 172.21.15.19:0/1444022849 >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 0x7fbd7c06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 -- 172.21.15.19:0/1444022849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 msgr2=0x7fbd7c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81a97640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 0x7fbd7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 0x7fbd7c06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 -- 172.21.15.19:0/1444022849 >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 msgr2=0x7fbd7c06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 --2- 172.21.15.19:0/1444022849 >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 0x7fbd7c06c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81296640 1 -- 172.21.15.19:0/1444022849 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c0afd50 con 0x7fbd7c0b0270 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd82298640 1 --2- 172.21.15.19:0/1444022849 >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 0x7fbd7c06c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.540+0000 7fbd81a97640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 0x7fbd7c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd81296640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b0270 0x7fbd7c0b1310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c071e20 tx=0x7fbd7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8ccafd8c95345f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd80a95640 1 -- 172.21.15.19:0/1444022849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7002e070 con 0x7fbd7c0b0270 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd80a95640 1 -- 172.21.15.19:0/1444022849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70037070 con 0x7fbd7c0b0270 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd80a95640 1 -- 172.21.15.19:0/1444022849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70031a00 con 0x7fbd7c0b0270 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1444022849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b0270 msgr2=0x7fbd7c0b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b0270 0x7fbd7c0b1310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c071e20 tx=0x7fbd7002b880 comp rx=0 tx=0).stop 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1444022849 shutdown_connections 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1444022849 >> v2:172.21.15.204:3300/0 conn(0x7fbd7c0b1850 0x7fbd7c06c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b0270 0x7fbd7c0b1310 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1444022849 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c1614a0 0x7fbd7c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1444022849 >> 172.21.15.19:0/1444022849 conn(0x7fbd7c09a9f0 msgr2=0x7fbd7c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1444022849 shutdown_connections 2024-03-04T08:52:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.541+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1444022849 wait complete. 2024-03-04T08:52:18.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.542+0000 7fbd83cfb640 1 Processor -- start 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 -- start start 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c0b0270 0x7fbd7c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd7c1614a0 0x7fbd7c1e99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b1c80 con 0x7fbd7c0b1850 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b06b0 con 0x7fbd7c1614a0 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd83cfb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b1e00 con 0x7fbd7c0b0270 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd81296640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd81296640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55868/0 (socket says 172.21.15.19:55868) 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.543+0000 7fbd81296640 1 -- 172.21.15.19:0/1163942330 learned_addr learned my addr 172.21.15.19:0/1163942330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81a97640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c0b0270 0x7fbd7c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd82298640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd7c1614a0 0x7fbd7c1e99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 -- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c0b0270 msgr2=0x7fbd7c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c0b0270 0x7fbd7c157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 -- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd7c1614a0 msgr2=0x7fbd7c1e99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd7c1614a0 0x7fbd7c1e99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 -- 172.21.15.19:0/1163942330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c15f2d0 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd81296640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbd70000c00 tx=0x7fbd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70032880 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70032a20 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c15dcf0 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70032e10 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.544+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c15e2b0 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.545+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c04f330 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.545+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd7004c060 con 0x7fbd7c0b1850 2024-03-04T08:52:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.546+0000 7fbd7a7fc640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 0x7fbd6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.546+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbd700abee0 con 0x7fbd7c0b1850 2024-03-04T08:52:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.546+0000 7fbd81a97640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 0x7fbd6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.547+0000 7fbd81a97640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 0x7fbd6806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400a910 tx=0x7fbd74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.554+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd70040070 con 0x7fbd7c0b1850 2024-03-04T08:52:18.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.774+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbd7c06e8e0 con 0x7fbd7c0b1850 2024-03-04T08:52:18.770 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-03-04T08:52:18.774+0000 7f9856575640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T08:52:18.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.776+0000 7fbd7a7fc640 1 -- 172.21.15.19:0/1163942330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd7007ac60 con 0x7fbd7c0b1850 2024-03-04T08:52:18.772 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T08:52:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 msgr2=0x7fbd6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 0x7fbd6806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400a910 tx=0x7fbd74008040 comp rx=0 tx=0).stop 2024-03-04T08:52:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 msgr2=0x7fbd7c15ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbd70000c00 tx=0x7fbd700046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 shutdown_connections 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd6806b4d0 0x7fbd6806d990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbd7c1614a0 0x7fbd7c1e99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd7c0b1850 0x7fbd7c15ed90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 --2- 172.21.15.19:0/1163942330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbd7c0b0270 0x7fbd7c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.778+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 >> 172.21.15.19:0/1163942330 conn(0x7fbd7c09a9f0 msgr2=0x7fbd7c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.779+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 shutdown_connections 2024-03-04T08:52:18.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.779+0000 7fbd83cfb640 1 -- 172.21.15.19:0/1163942330 wait complete. 2024-03-04T08:52:18.777 INFO:tasks.ceph.mds.a.smithi019.stderr: -3687> 2024-03-04T08:51:42.833+0000 7f1ec288a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:52:18.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T08:52:18.806 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-04T08:52:18.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.896+0000 7f6438da0640 1 Processor -- start 2024-03-04T08:52:18.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.896+0000 7f6438da0640 1 -- start start 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6438da0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f64340d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6438da0640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f64340d19d0 0x7f64340d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6438da0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340d0ae0 con 0x7f64340d2660 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6438da0640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340b3570 con 0x7f64340d19d0 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6438da0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340d0dc0 con 0x7f643415e010 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6433fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f64340d2660 0x7f64340ce650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52082/0 (socket says 172.21.15.19:52082) 2024-03-04T08:52:18.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6433fff640 1 -- 172.21.15.19:0/2814624385 learned_addr learned my addr 172.21.15.19:0/2814624385 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f64337fe640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f64340d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f6432ffd640 1 --2- 172.21.15.19:0/2814624385 >> v2:172.21.15.204:3300/0 conn(0x7f64340d19d0 0x7f64340d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856481021 0 0) 0x7f64340d0ae0 con 0x7f64340d2660 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.897+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f641c003520 con 0x7f64340d2660 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 487619744 0 0) 0x7f641c003520 con 0x7f64340d2660 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 msgr2=0x7f64340d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f64340d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 >> v2:172.21.15.204:3300/0 conn(0x7f64340d19d0 msgr2=0x7f64340d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 --2- 172.21.15.19:0/2814624385 >> v2:172.21.15.204:3300/0 conn(0x7f64340d19d0 0x7f64340d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340b2f20 con 0x7f64340d2660 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f642c0019f0 con 0x7f64340d2660 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 >> v1:172.21.15.19:6789/0 conn(0x7f64340d2660 legacy=0x7f64340ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f641c0039b0 0x7f641c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f641c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c004d40 0x7f641c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b3570 con 0x7f641c0039b0 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340d0dc0 con 0x7f641c004d40 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c00b9c0 con 0x7f643415e010 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f641c0039b0 0x7f641c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f6433fff640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c004d40 0x7f641c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f6432ffd640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f641c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 -- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 msgr2=0x7f641c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f643415e010 0x7f641c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 -- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c004d40 msgr2=0x7f641c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c004d40 0x7f641c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f64337fe640 1 -- 172.21.15.19:0/2814624385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c003520 con 0x7f641c0039b0 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.898+0000 7f6433fff640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c004d40 0x7f641c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.899+0000 7f64337fe640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f641c0039b0 0x7f641c003dd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6424009ac0 tx=0x7f641c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0bd4ed15612fe0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.899+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424039070 con 0x7f641c0039b0 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.899+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642402c6b0 con 0x7f641c0039b0 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.899+0000 7f64327fc640 1 -- 172.21.15.19:0/2814624385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424009690 con 0x7f641c0039b0 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 -- 172.21.15.19:0/2814624385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f641c0039b0 msgr2=0x7f641c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 --2- 172.21.15.19:0/2814624385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f641c0039b0 0x7f641c003dd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6424009ac0 tx=0x7f641c005830 comp rx=0 tx=0).stop 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6433fff640 1 -- 172.21.15.19:0/2814624385 reap_dead start 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 -- 172.21.15.19:0/2814624385 shutdown_connections 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 -- 172.21.15.19:0/2814624385 >> 172.21.15.19:0/2814624385 conn(0x7f643409ce10 msgr2=0x7f64340d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:18.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 -- 172.21.15.19:0/2814624385 shutdown_connections 2024-03-04T08:52:18.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.900+0000 7f6438da0640 1 -- 172.21.15.19:0/2814624385 wait complete. 2024-03-04T08:52:18.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.901+0000 7f6438da0640 1 Processor -- start 2024-03-04T08:52:18.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.901+0000 7f6438da0640 1 -- start start 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c0039b0 0x7f64340cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6434161020 0x7f64341f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b4b90 con 0x7f643415bb50 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b4a10 con 0x7f641c0039b0 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6438da0640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b4d10 con 0x7f6434161020 2024-03-04T08:52:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55902/0 (socket says 172.21.15.19:55902) 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 -- 172.21.15.19:0/3666716095 learned_addr learned my addr 172.21.15.19:0/3666716095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6432ffd640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6434161020 0x7f64341f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f64337fe640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c0039b0 0x7f64340cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 -- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6434161020 msgr2=0x7f64341f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6434161020 0x7f64341f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 -- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c0039b0 msgr2=0x7f64340cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c0039b0 0x7f64340cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 -- 172.21.15.19:0/3666716095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64341f6cf0 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.902+0000 7f6433fff640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f643406b3c0 tx=0x7f642c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.903+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c00eda0 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.903+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c014430 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.903+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64341f6f90 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.903+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c014820 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.903+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64341f7550 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.904+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6434068f10 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.904+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f642c0149c0 con 0x7f643415bb50 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.904+0000 7f641bfff640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 0x7f642006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.904+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6190+0+0 (secure 0 0 0) 0x7f642c08a370 con 0x7f643415bb50 2024-03-04T08:52:18.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.905+0000 7f64337fe640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 0x7f642006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:18.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.905+0000 7f64337fe640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 0x7f642006d9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6424036000 tx=0x7f6424030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:18.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:18.909+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f642c058f70 con 0x7f643415bb50 2024-03-04T08:52:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.129+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f64340747a0 con 0x7f643415bb50 2024-03-04T08:52:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.785+0000 7f641bfff640 1 -- 172.21.15.19:0/3666716095 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f642c058870 con 0x7f643415bb50 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 msgr2=0x7f642006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 0x7f642006d9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6424036000 tx=0x7f6424030000 comp rx=0 tx=0).stop 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 msgr2=0x7f643415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f643406b3c0 tx=0x7f642c00e530 comp rx=0 tx=0).stop 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 shutdown_connections 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f643415bb50 0x7f643415bfe0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6434161020 0x7f64341f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f642006b500 0x7f642006d9c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 --2- 172.21.15.19:0/3666716095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f641c0039b0 0x7f64340cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.787+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 >> 172.21.15.19:0/3666716095 conn(0x7f643409ce10 msgr2=0x7f643406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.788+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 shutdown_connections 2024-03-04T08:52:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.788+0000 7f6438da0640 1 -- 172.21.15.19:0/3666716095 wait complete. 2024-03-04T08:52:19.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T08:52:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.960+0000 7fe0a173a640 1 Processor -- start 2024-03-04T08:52:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.960+0000 7fe0a173a640 1 -- start start 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe0a173a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 0x7fe09c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe0a173a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c15f7c0 con 0x7fe09c0cfe00 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe0a173a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0ccc60 con 0x7fe09c15f290 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe0a173a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0ccf40 con 0x7fe09c15e180 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe09c0cfe00 0x7fe09c0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52094/0 (socket says 172.21.15.19:52094) 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09b7fe640 1 -- 172.21.15.19:0/4135971136 learned_addr learned my addr 172.21.15.19:0/4135971136 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09affd640 1 --2- 172.21.15.19:0/4135971136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 0x7fe09c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842354462 0 0) 0x7fe09c15f7c0 con 0x7fe09c0cfe00 2024-03-04T08:52:19.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe084003520 con 0x7fe09c0cfe00 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919058297 0 0) 0x7fe09c0ccc60 con 0x7fe09c15f290 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe09c15f7c0 con 0x7fe09c15f290 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09affd640 1 -- 172.21.15.19:0/4135971136 >> v1:172.21.15.204:6789/0 conn(0x7fe09c15f290 legacy=0x7fe09c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09affd640 1 -- 172.21.15.19:0/4135971136 >> v1:172.21.15.19:6789/0 conn(0x7fe09c0cfe00 legacy=0x7fe09c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397541257 0 0) 0x7fe084003520 con 0x7fe09c0cfe00 2024-03-04T08:52:19.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.961+0000 7fe09affd640 1 -- 172.21.15.19:0/4135971136 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0cd220 con 0x7fe09c15e180 2024-03-04T08:52:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.962+0000 7fe09affd640 1 --2- 172.21.15.19:0/4135971136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 0x7fe09c0cd740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097d0 tx=0x7fe08c02b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e70545b67c6c82 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.962+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c037070 con 0x7fe09c15e180 2024-03-04T08:52:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.962+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c030510 con 0x7fe09c15e180 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.962+0000 7fe099ffb640 1 -- 172.21.15.19:0/4135971136 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940019f0 con 0x7fe09c15e180 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 -- 172.21.15.19:0/4135971136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 msgr2=0x7fe09c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 --2- 172.21.15.19:0/4135971136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 0x7fe09c0cd740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097d0 tx=0x7fe08c02b770 comp rx=0 tx=0).stop 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 -- 172.21.15.19:0/4135971136 shutdown_connections 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 --2- 172.21.15.19:0/4135971136 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15e180 0x7fe09c0cd740 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 -- 172.21.15.19:0/4135971136 >> 172.21.15.19:0/4135971136 conn(0x7fe09c0d1b20 msgr2=0x7fe09c0d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 -- 172.21.15.19:0/4135971136 shutdown_connections 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.963+0000 7fe0a173a640 1 -- 172.21.15.19:0/4135971136 wait complete. 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.964+0000 7fe0a173a640 1 Processor -- start 2024-03-04T08:52:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.964+0000 7fe0a173a640 1 -- start start 2024-03-04T08:52:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe09c15e180 0x7fe09c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 0x7fe09c161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0b2ee0 con 0x7fe09c0cfe00 2024-03-04T08:52:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0cc910 con 0x7fe09c15e180 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe0a173a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c15e560 con 0x7fe09c15f290 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55912/0 (socket says 172.21.15.19:55912) 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 -- 172.21.15.19:0/1635942334 learned_addr learned my addr 172.21.15.19:0/1635942334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09b7fe640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 0x7fe09c161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09a7fc640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe09c15e180 0x7fe09c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 -- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 msgr2=0x7fe09c161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 0x7fe09c161cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 -- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe09c15e180 msgr2=0x7fe09c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe09c15e180 0x7fe09c0c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09affd640 1 -- 172.21.15.19:0/1635942334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c158ed0 con 0x7fe09c0cfe00 2024-03-04T08:52:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.965+0000 7fe09b7fe640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 0x7fe09c161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe09affd640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097d0 tx=0x7fe08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c042070 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c03e870 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0b6540 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c037040 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.966+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0c5740 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.967+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c04f330 con 0x7fe09c0cfe00 2024-03-04T08:52:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.967+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe08c045070 con 0x7fe09c0cfe00 2024-03-04T08:52:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.968+0000 7fe0837fe640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 0x7fe08806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.968+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6190+0+0 (secure 0 0 0) 0x7fe08c0ac170 con 0x7fe09c0cfe00 2024-03-04T08:52:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.968+0000 7fe09a7fc640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 0x7fe08806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:19.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.969+0000 7fe09a7fc640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 0x7fe08806d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b7950 tx=0x7fe090009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:19.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:19.972+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe08c07af20 con 0x7fe09c0cfe00 2024-03-04T08:52:20.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.155+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe09c072d80 con 0x7fe09c0cfe00 2024-03-04T08:52:20.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.786+0000 7fe0837fe640 1 -- 172.21.15.19:0/1635942334 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe08c07a820 con 0x7fe09c0cfe00 2024-03-04T08:52:20.783 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 msgr2=0x7fe08806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 0x7fe08806d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b7950 tx=0x7fe090009040 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 msgr2=0x7fe09c158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097d0 tx=0x7fe08c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 shutdown_connections 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe09c15f290 0x7fe09c161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe08806b4d0 0x7fe08806d990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe09c15e180 0x7fe09c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 --2- 172.21.15.19:0/1635942334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe09c0cfe00 0x7fe09c158990 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 >> 172.21.15.19:0/1635942334 conn(0x7fe09c0d1b20 msgr2=0x7fe09c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:20.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 shutdown_connections 2024-03-04T08:52:20.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.789+0000 7fe0a173a640 1 -- 172.21.15.19:0/1635942334 wait complete. 2024-03-04T08:52:20.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.920+0000 7f567fdae640 1 Processor -- start 2024-03-04T08:52:20.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.920+0000 7f567fdae640 1 -- start start 2024-03-04T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567fdae640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f567815ac00 0x7f567806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567fdae640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5678070d10 0x7f567815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567fdae640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780711c0 con 0x7f56780708b0 2024-03-04T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567fdae640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780cdc10 con 0x7f567815ac00 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567fdae640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567815afe0 con 0x7f5678070d10 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f567815ac00 0x7f567806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f567815ac00 0x7f567806c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55922/0 (socket says 172.21.15.19:55922) 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 -- 172.21.15.19:0/2897482379 learned_addr learned my addr 172.21.15.19:0/2897482379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 -- 172.21.15.19:0/2897482379 >> v2:172.21.15.204:3300/0 conn(0x7f5678070d10 msgr2=0x7f567815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 --2- 172.21.15.19:0/2897482379 >> v2:172.21.15.204:3300/0 conn(0x7f5678070d10 0x7f567815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 -- 172.21.15.19:0/2897482379 >> v1:172.21.15.204:6789/0 conn(0x7f56780708b0 legacy=0x7f567815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.921+0000 7f567db4a640 1 -- 172.21.15.19:0/2897482379 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780cd000 con 0x7f567815ac00 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.922+0000 7f567db4a640 1 --2- 172.21.15.19:0/2897482379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806c910 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f56780cc0a0 tx=0x7f567002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ccaabce68b8081 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.922+0000 7f567cb48640 1 -- 172.21.15.19:0/2897482379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567003b070 con 0x7f567815ac00 2024-03-04T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.922+0000 7f567cb48640 1 -- 172.21.15.19:0/2897482379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567002ee00 con 0x7f567815ac00 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.922+0000 7f567cb48640 1 -- 172.21.15.19:0/2897482379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670036660 con 0x7f567815ac00 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 -- 172.21.15.19:0/2897482379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 msgr2=0x7f567806c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 --2- 172.21.15.19:0/2897482379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806c910 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f56780cc0a0 tx=0x7f567002e050 comp rx=0 tx=0).stop 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 -- 172.21.15.19:0/2897482379 shutdown_connections 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 --2- 172.21.15.19:0/2897482379 >> v2:172.21.15.204:3300/0 conn(0x7f5678070d10 0x7f567815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 --2- 172.21.15.19:0/2897482379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806c910 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 -- 172.21.15.19:0/2897482379 >> 172.21.15.19:0/2897482379 conn(0x7f56780b1650 msgr2=0x7f56780b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 -- 172.21.15.19:0/2897482379 shutdown_connections 2024-03-04T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.923+0000 7f567fdae640 1 -- 172.21.15.19:0/2897482379 wait complete. 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.924+0000 7f567fdae640 1 Processor -- start 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.924+0000 7f567fdae640 1 -- start start 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 0x7f56780aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5678070d10 0x7f567815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cd8a0 con 0x7f567815ac00 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780cd5c0 con 0x7f5678070d10 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567fdae640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567806ce50 con 0x7f56780708b0 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55924/0 (socket says 172.21.15.19:55924) 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 -- 172.21.15.19:0/964308696 learned_addr learned my addr 172.21.15.19:0/964308696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567d349640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5678070d10 0x7f567815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567db4a640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 0x7f56780aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 -- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 msgr2=0x7f56780aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 0x7f56780aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 -- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5678070d10 msgr2=0x7f567815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5678070d10 0x7f567815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:20.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 -- 172.21.15.19:0/964308696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780b2810 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567db4a640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 0x7f56780aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.925+0000 7f567e34b640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f566800b970 tx=0x7f566800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.926+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668019070 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.926+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800cb60 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.926+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780b2af0 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.926+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668014440 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.926+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56780b30b0 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.927+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804f330 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.927+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f566801c070 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.928+0000 7f56767fc640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 0x7f566406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.928+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5752+0+0 (secure 0 0 0) 0x7f5668089f70 con 0x7f567815ac00 2024-03-04T08:52:20.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.928+0000 7f567db4a640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 0x7f566406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:20.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.928+0000 7f567db4a640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 0x7f566406d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5670038000 tx=0x7f5670008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:20.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:20.932+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5668058dc0 con 0x7f567815ac00 2024-03-04T08:52:21.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.115+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56780cee30 con 0x7f567815ac00 2024-03-04T08:52:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.791+0000 7f56767fc640 1 -- 172.21.15.19:0/964308696 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56680586c0 con 0x7f567815ac00 2024-03-04T08:52:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-03-04T08:52:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.795+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 msgr2=0x7f566406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.795+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 0x7f566406d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5670038000 tx=0x7f5670008040 comp rx=0 tx=0).stop 2024-03-04T08:52:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.795+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 msgr2=0x7f567806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.795+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f566800b970 tx=0x7f566800be30 comp rx=0 tx=0).stop 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 shutdown_connections 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567815ac00 0x7f567806d410 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f566406b4d0 0x7f566406d990 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5678070d10 0x7f567815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 --2- 172.21.15.19:0/964308696 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f56780708b0 0x7f56780aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 >> 172.21.15.19:0/964308696 conn(0x7f56780b1650 msgr2=0x7f56780ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 shutdown_connections 2024-03-04T08:52:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.798+0000 7f567fdae640 1 -- 172.21.15.19:0/964308696 wait complete. 2024-03-04T08:52:21.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-03-04T08:52:21.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.925+0000 7efc2cc29640 1 Processor -- start 2024-03-04T08:52:21.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.925+0000 7efc2cc29640 1 -- start start 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2cc29640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efc28161440 0x7efc280b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2cc29640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc280d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2cc29640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc280cf520 con 0x7efc280d1300 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2cc29640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc280cf2d0 con 0x7efc28161440 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2cc29640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b6b00 con 0x7efc28161820 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc26d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc280d1300 0x7efc280d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52108/0 (socket says 172.21.15.19:52108) 2024-03-04T08:52:21.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc26d9d640 1 -- 172.21.15.19:0/1364381768 learned_addr learned my addr 172.21.15.19:0/1364381768 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2659c640 1 --2- 172.21.15.19:0/1364381768 >> v2:172.21.15.204:3300/0 conn(0x7efc28161440 0x7efc280b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc25d9b640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc280d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123382027 0 0) 0x7efc280cf520 con 0x7efc280d1300 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc10003520 con 0x7efc280d1300 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703764418 0 0) 0x7efc10003520 con 0x7efc280d1300 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 msgr2=0x7efc280d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc280d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 >> v2:172.21.15.204:3300/0 conn(0x7efc28161440 msgr2=0x7efc280b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 --2- 172.21.15.19:0/1364381768 >> v2:172.21.15.204:3300/0 conn(0x7efc28161440 0x7efc280b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280cf800 con 0x7efc280d1300 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7efc200019f0 con 0x7efc280d1300 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 >> v1:172.21.15.19:6789/0 conn(0x7efc280d1300 legacy=0x7efc280d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.926+0000 7efc2559a640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2559a640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc10004d40 0x7efc100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280cf2d0 con 0x7efc100039b0 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b6b00 con 0x7efc10004d40 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1000b9c0 con 0x7efc28161820 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc25d9b640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc26d9d640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc10004d40 0x7efc100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 -- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 msgr2=0x7efc10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc28161820 0x7efc10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 -- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc10004d40 msgr2=0x7efc100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc10004d40 0x7efc100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.927+0000 7efc2659c640 1 -- 172.21.15.19:0/1364381768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10003520 con 0x7efc100039b0 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2659c640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ac0 tx=0x7efc10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118631673c12920c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18039070 con 0x7efc100039b0 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1802c710 con 0x7efc100039b0 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2559a640 1 -- 172.21.15.19:0/1364381768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18009690 con 0x7efc100039b0 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 -- 172.21.15.19:0/1364381768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc100039b0 msgr2=0x7efc10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1364381768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc100039b0 0x7efc10003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ac0 tx=0x7efc10005830 comp rx=0 tx=0).stop 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc26d9d640 1 -- 172.21.15.19:0/1364381768 reap_dead start 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 -- 172.21.15.19:0/1364381768 shutdown_connections 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 -- 172.21.15.19:0/1364381768 >> 172.21.15.19:0/1364381768 conn(0x7efc280d3cb0 msgr2=0x7efc280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 -- 172.21.15.19:0/1364381768 shutdown_connections 2024-03-04T08:52:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.928+0000 7efc2cc29640 1 -- 172.21.15.19:0/1364381768 wait complete. 2024-03-04T08:52:21.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 Processor -- start 2024-03-04T08:52:21.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 -- start start 2024-03-04T08:52:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc100039b0 0x7efc280c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc280b8de0 0x7efc2814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b7fa0 con 0x7efc280b9260 2024-03-04T08:52:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b5120 con 0x7efc100039b0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.930+0000 7efc2cc29640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b8120 con 0x7efc280b8de0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55948/0 (socket says 172.21.15.19:55948) 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 -- 172.21.15.19:0/1834272874 learned_addr learned my addr 172.21.15.19:0/1834272874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc2659c640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc100039b0 0x7efc280c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc25d9b640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc280b8de0 0x7efc2814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 -- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc280b8de0 msgr2=0x7efc2814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc280b8de0 0x7efc2814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 -- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc100039b0 msgr2=0x7efc280c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc100039b0 0x7efc280c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 -- 172.21.15.19:0/1834272874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280c8bc0 con 0x7efc280b9260 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc26d9d640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efc20002230 tx=0x7efc2000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000ee20 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20018070 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc280c8e60 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20013660 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.931+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc280c9420 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.932+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2804f330 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.933+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc20013800 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.933+0000 7efc16ffd640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 0x7efc0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.933+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5338+0+0 (secure 0 0 0) 0x7efc2008a3f0 con 0x7efc280b9260 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.933+0000 7efc2659c640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 0x7efc0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.934+0000 7efc2659c640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 0x7efc0806d9c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc18036000 tx=0x7efc18030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:21.938+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efc20059470 con 0x7efc280b9260 2024-03-04T08:52:22.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.121+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc280d3380 con 0x7efc280b9260 2024-03-04T08:52:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.796+0000 7efc16ffd640 1 -- 172.21.15.19:0/1834272874 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v41) v1 ==== 160+0+0 (secure 0 0 0) 0x7efc20058d70 con 0x7efc280b9260 2024-03-04T08:52:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'data_new' removed 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.799+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 msgr2=0x7efc0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.799+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 0x7efc0806d9c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc18036000 tx=0x7efc18030000 comp rx=0 tx=0).stop 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.799+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 msgr2=0x7efc2814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.799+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efc20002230 tx=0x7efc2000e530 comp rx=0 tx=0).stop 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 shutdown_connections 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc280b9260 0x7efc2814e220 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc280b8de0 0x7efc2814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc0806b500 0x7efc0806d9c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 --2- 172.21.15.19:0/1834272874 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc100039b0 0x7efc280c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 >> 172.21.15.19:0/1834272874 conn(0x7efc280d3cb0 msgr2=0x7efc280d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 shutdown_connections 2024-03-04T08:52:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.800+0000 7efc2cc29640 1 -- 172.21.15.19:0/1834272874 wait complete. 2024-03-04T08:52:22.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-04T08:52:22.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.922+0000 7f971eb0c640 1 Processor -- start 2024-03-04T08:52:22.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.922+0000 7f971eb0c640 1 -- start start 2024-03-04T08:52:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971eb0c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9718145590 0x7f971806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971eb0c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f971806f6e0 0x7f97180cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971eb0c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971806b970 con 0x7f971806b4f0 2024-03-04T08:52:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971eb0c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9718145970 con 0x7f9718145590 2024-03-04T08:52:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971eb0c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9718160110 con 0x7f971806f6e0 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9718145590 0x7f971806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f9717fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f971806b4f0 0x7f971806efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52114/0 (socket says 172.21.15.19:52114) 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9718145590 0x7f971806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55954/0 (socket says 172.21.15.19:55954) 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f9717fff640 1 -- 172.21.15.19:0/429769010 learned_addr learned my addr 172.21.15.19:0/429769010 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 -- 172.21.15.19:0/429769010 >> v2:172.21.15.204:3300/0 conn(0x7f971806f6e0 msgr2=0x7f97180cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 --2- 172.21.15.19:0/429769010 >> v2:172.21.15.204:3300/0 conn(0x7f971806f6e0 0x7f97180cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 -- 172.21.15.19:0/429769010 >> v1:172.21.15.19:6789/0 conn(0x7f971806b4f0 legacy=0x7f971806efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f971c8a8640 1 -- 172.21.15.19:0/429769010 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971815f7e0 con 0x7f9718145590 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.923+0000 7f97177fe640 1 -- 172.21.15.19:0/429769010 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200402462 0 0) 0x7f971806b970 con 0x7f971806b4f0 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.924+0000 7f971c8a8640 1 --2- 172.21.15.19:0/429769010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971806afb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9718073170 tx=0x7f971002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e501b0d68ffe9e8b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.924+0000 7f97177fe640 1 -- 172.21.15.19:0/429769010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710039070 con 0x7f9718145590 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.924+0000 7f97177fe640 1 -- 172.21.15.19:0/429769010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971002cc90 con 0x7f9718145590 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.924+0000 7f97177fe640 1 -- 172.21.15.19:0/429769010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710034660 con 0x7f9718145590 2024-03-04T08:52:22.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 -- 172.21.15.19:0/429769010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 msgr2=0x7f971806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 --2- 172.21.15.19:0/429769010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971806afb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9718073170 tx=0x7f971002bee0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 -- 172.21.15.19:0/429769010 shutdown_connections 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 --2- 172.21.15.19:0/429769010 >> v2:172.21.15.204:3300/0 conn(0x7f971806f6e0 0x7f97180cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 --2- 172.21.15.19:0/429769010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971806afb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 -- 172.21.15.19:0/429769010 >> 172.21.15.19:0/429769010 conn(0x7f97180b2660 msgr2=0x7f97180b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 -- 172.21.15.19:0/429769010 shutdown_connections 2024-03-04T08:52:22.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.925+0000 7f971eb0c640 1 -- 172.21.15.19:0/429769010 wait complete. 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.926+0000 7f971eb0c640 1 Processor -- start 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.926+0000 7f971eb0c640 1 -- start start 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f971806b4f0 0x7f971813d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f971806f6e0 0x7f97180cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97181605a0 con 0x7f9718145590 2024-03-04T08:52:22.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971815fda0 con 0x7f971806f6e0 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971eb0c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971815a720 con 0x7f971806b4f0 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55958/0 (socket says 172.21.15.19:55958) 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 -- 172.21.15.19:0/3156892359 learned_addr learned my addr 172.21.15.19:0/3156892359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f9717fff640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f971806f6e0 0x7f97180cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 -- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f971806b4f0 msgr2=0x7f971813d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f971806b4f0 0x7f971813d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 -- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f971806f6e0 msgr2=0x7f97180cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f971806f6e0 0x7f97180cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.927+0000 7f971d0a9640 1 -- 172.21.15.19:0/3156892359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180ce700 con 0x7f9718145590 2024-03-04T08:52:22.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f971d0a9640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f970800b3f0 tx=0x7f970800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708015020 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708011850 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97180ce9e0 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708011c40 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.928+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97180cefa0 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.929+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97180cf380 con 0x7f9718145590 2024-03-04T08:52:22.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.929+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9708018020 con 0x7f9718145590 2024-03-04T08:52:22.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.929+0000 7f97157fa640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 0x7f970406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:22.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.930+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9708089e30 con 0x7f9718145590 2024-03-04T08:52:22.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.930+0000 7f971c8a8640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 0x7f970406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:22.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.930+0000 7f971c8a8640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 0x7f970406d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9710036000 tx=0x7f971002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:22.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:22.934+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f97180cf380 con 0x7f9718145590 2024-03-04T08:52:23.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.118+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f97180733b0 con 0x7f9718145590 2024-03-04T08:52:23.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.121+0000 7f97157fa640 1 -- 172.21.15.19:0/3156892359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f970801f020 con 0x7f9718145590 2024-03-04T08:52:23.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 msgr2=0x7f970406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 0x7f970406d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9710036000 tx=0x7f971002e000 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 msgr2=0x7f971815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f970800b3f0 tx=0x7f970800b8b0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 shutdown_connections 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9718145590 0x7f971815aa70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f970406b4d0 0x7f970406d990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f971806f6e0 0x7f97180cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 --2- 172.21.15.19:0/3156892359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f971806b4f0 0x7f971813d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 >> 172.21.15.19:0/3156892359 conn(0x7f97180b2660 msgr2=0x7f97180b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 shutdown_connections 2024-03-04T08:52:23.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.123+0000 7f971eb0c640 1 -- 172.21.15.19:0/3156892359 wait complete. 2024-03-04T08:52:23.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-03-04T08:52:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.235+0000 7f64b59ac640 1 Processor -- start 2024-03-04T08:52:23.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.235+0000 7f64b59ac640 1 -- start start 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 0x7f64b00d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b00ce1b0 0x7f64b00ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b006ca90 con 0x7f64b00ce1b0 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00d09e0 con 0x7f64b00d00c0 2024-03-04T08:52:23.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64b59ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b015e380 con 0x7f64b00cf850 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b00ce1b0 0x7f64b00ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64b00ce1b0 0x7f64b00ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55964/0 (socket says 172.21.15.19:55964) 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 -- 172.21.15.19:0/1436197995 learned_addr learned my addr 172.21.15.19:0/1436197995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64aeffd640 1 --2- 172.21.15.19:0/1436197995 >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 0x7f64b00d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 -- 172.21.15.19:0/1436197995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 msgr2=0x7f64b00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 --2- 172.21.15.19:0/1436197995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 -- 172.21.15.19:0/1436197995 >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 msgr2=0x7f64b00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 --2- 172.21.15.19:0/1436197995 >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 0x7f64b00d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64af7fe640 1 -- 172.21.15.19:0/1436197995 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00cdc10 con 0x7f64b00ce1b0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.236+0000 7f64aeffd640 1 --2- 172.21.15.19:0/1436197995 >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 0x7f64b00d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.237+0000 7f64af7fe640 1 --2- 172.21.15.19:0/1436197995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00ce1b0 0x7f64b00ce640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64b00d1a40 tx=0x7f64a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f3782b86e2c964 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.237+0000 7f64adffb640 1 -- 172.21.15.19:0/1436197995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a002ca70 con 0x7f64b00ce1b0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.237+0000 7f64adffb640 1 -- 172.21.15.19:0/1436197995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a002cc10 con 0x7f64b00ce1b0 2024-03-04T08:52:23.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.237+0000 7f64adffb640 1 -- 172.21.15.19:0/1436197995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00343f0 con 0x7f64b00ce1b0 2024-03-04T08:52:23.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 -- 172.21.15.19:0/1436197995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00ce1b0 msgr2=0x7f64b00ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 --2- 172.21.15.19:0/1436197995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00ce1b0 0x7f64b00ce640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64b00d1a40 tx=0x7f64a002bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 -- 172.21.15.19:0/1436197995 shutdown_connections 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 --2- 172.21.15.19:0/1436197995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00ce1b0 0x7f64b00ce640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 --2- 172.21.15.19:0/1436197995 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 --2- 172.21.15.19:0/1436197995 >> v2:172.21.15.204:3300/0 conn(0x7f64b00d00c0 0x7f64b00d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 -- 172.21.15.19:0/1436197995 >> 172.21.15.19:0/1436197995 conn(0x7f64b00b35a0 msgr2=0x7f64b00b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 -- 172.21.15.19:0/1436197995 shutdown_connections 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.238+0000 7f64b59ac640 1 -- 172.21.15.19:0/1436197995 wait complete. 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.239+0000 7f64b59ac640 1 Processor -- start 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.239+0000 7f64b59ac640 1 -- start start 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 0x7f64b00c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b006c720 con 0x7f64b00d00c0 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b006c440 con 0x7f64b00ce1b0 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00cd900 con 0x7f64b00cf850 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55980/0 (socket says 172.21.15.19:55980) 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 -- 172.21.15.19:0/3036017654 learned_addr learned my addr 172.21.15.19:0/3036017654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64aeffd640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 0x7f64b00c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64ae7fc640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 -- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 msgr2=0x7f64b00c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 -- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 msgr2=0x7f64b00c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 0x7f64b00c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 -- 172.21.15.19:0/3036017654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b01f3b20 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64aeffd640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 0x7f64b00c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64af7fe640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009e20 tx=0x7f64a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0043020 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a003e450 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0009510 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.240+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b01f3e00 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.241+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b01f43c0 con 0x7f64b00d00c0 2024-03-04T08:52:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.241+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b004f330 con 0x7f64b00d00c0 2024-03-04T08:52:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.242+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64a0046020 con 0x7f64b00d00c0 2024-03-04T08:52:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.242+0000 7f6497fff640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.242+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f64a00ac770 con 0x7f64b00d00c0 2024-03-04T08:52:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.242+0000 7f64aeffd640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.243+0000 7f64aeffd640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 0x7f649c06d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64b015db90 tx=0x7f64a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.247+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f64a004d030 con 0x7f64b00d00c0 2024-03-04T08:52:23.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.498+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f64b00c6780 con 0x7f64b00d00c0 2024-03-04T08:52:23.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.797+0000 7f6497fff640 1 -- 172.21.15.19:0/3036017654 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v112) v1 ==== 147+0+0 (secure 0 0 0) 0x7f64a007ba40 con 0x7f64b00d00c0 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.799+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 msgr2=0x7f649c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.799+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 0x7f649c06d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64b015db90 tx=0x7f64a8008040 comp rx=0 tx=0).stop 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.799+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 msgr2=0x7f64b00c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.799+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009e20 tx=0x7f64a0004a40 comp rx=0 tx=0).stop 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 shutdown_connections 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b00d00c0 0x7f64b00c99c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f64b00cf850 0x7f64b00c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 --2- 172.21.15.19:0/3036017654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f64b00ce1b0 0x7f64b00c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 >> 172.21.15.19:0/3036017654 conn(0x7f64b00b35a0 msgr2=0x7f64b006fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 shutdown_connections 2024-03-04T08:52:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.800+0000 7f64b59ac640 1 -- 172.21.15.19:0/3036017654 wait complete. 2024-03-04T08:52:23.808 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-03-04T08:52:23.808 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:52:23.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 Processor -- start 2024-03-04T08:52:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 -- start start 2024-03-04T08:52:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f040415dfe0 0x7f04040cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04040d29c0 0x7f04040b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04040b3430 con 0x7f04040cf830 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04040b31e0 con 0x7f040415dfe0 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f0408a88640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04040b3d60 con 0x7f04040d29c0 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f040259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f040415dfe0 0x7f04040cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f040259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f040415dfe0 0x7f04040cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55984/0 (socket says 172.21.15.19:55984) 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.915+0000 7f040259c640 1 -- 172.21.15.19:0/3197056112 learned_addr learned my addr 172.21.15.19:0/3197056112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f0402d9d640 1 --2- 172.21.15.19:0/3197056112 >> v2:172.21.15.204:3300/0 conn(0x7f04040d29c0 0x7f04040b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f040259c640 1 -- 172.21.15.19:0/3197056112 >> v2:172.21.15.204:3300/0 conn(0x7f04040d29c0 msgr2=0x7f04040b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f040259c640 1 --2- 172.21.15.19:0/3197056112 >> v2:172.21.15.204:3300/0 conn(0x7f04040d29c0 0x7f04040b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f040259c640 1 -- 172.21.15.19:0/3197056112 >> v1:172.21.15.204:6789/0 conn(0x7f04040cf830 legacy=0x7f04040d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f040259c640 1 -- 172.21.15.19:0/3197056112 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040b3710 con 0x7f040415dfe0 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.916+0000 7f040259c640 1 --2- 172.21.15.19:0/3197056112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f040415dfe0 0x7f04040cf2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f04040b3cd0 tx=0x7f03f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f55500796d2e2a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0401d9b640 1 -- 172.21.15.19:0/3197056112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4034070 con 0x7f040415dfe0 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0401d9b640 1 -- 172.21.15.19:0/3197056112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4030860 con 0x7f040415dfe0 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0401d9b640 1 -- 172.21.15.19:0/3197056112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4030c30 con 0x7f040415dfe0 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 -- 172.21.15.19:0/3197056112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f040415dfe0 msgr2=0x7f04040cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 --2- 172.21.15.19:0/3197056112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f040415dfe0 0x7f04040cf2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f04040b3cd0 tx=0x7f03f402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 -- 172.21.15.19:0/3197056112 shutdown_connections 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 --2- 172.21.15.19:0/3197056112 >> v2:172.21.15.204:3300/0 conn(0x7f04040d29c0 0x7f04040b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 --2- 172.21.15.19:0/3197056112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f040415dfe0 0x7f04040cf2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 -- 172.21.15.19:0/3197056112 >> 172.21.15.19:0/3197056112 conn(0x7f04040d3cd0 msgr2=0x7f04040d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 -- 172.21.15.19:0/3197056112 shutdown_connections 2024-03-04T08:52:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.917+0000 7f0408a88640 1 -- 172.21.15.19:0/3197056112 wait complete. 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 Processor -- start 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 -- start start 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04040cf830 0x7f04040cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f040415dfe0 0x7f04040c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04040d1df0 con 0x7f04040d29c0 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04040d1c70 con 0x7f04040cf830 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f0408a88640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040415e3c0 con 0x7f040415dfe0 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f03fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f03fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55994/0 (socket says 172.21.15.19:55994) 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f03fbfff640 1 -- 172.21.15.19:0/2827257302 learned_addr learned my addr 172.21.15.19:0/2827257302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.919+0000 7f040259c640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04040cf830 0x7f04040cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f0402d9d640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f040415dfe0 0x7f04040c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 -- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f040415dfe0 msgr2=0x7f04040c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f040415dfe0 0x7f04040c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 -- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04040cf830 msgr2=0x7f04040cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04040cf830 0x7f04040cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 -- 172.21.15.19:0/2827257302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040415fef0 con 0x7f04040d29c0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03fbfff640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c440 tx=0x7f03ec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0052d0 con 0x7f04040d29c0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec005470 con 0x7f04040d29c0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec007240 con 0x7f04040d29c0 2024-03-04T08:52:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04040cdcf0 con 0x7f04040d29c0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.920+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0404160190 con 0x7f04040d29c0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.921+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0404160390 con 0x7f04040d29c0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.921+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f03ec0073e0 con 0x7f04040d29c0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.922+0000 7f03faffd640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 0x7f03e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.922+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03ec089390 con 0x7f04040d29c0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.922+0000 7f040259c640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 0x7f03e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.923+0000 7f040259c640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 0x7f03e406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f03f4036000 tx=0x7f03f403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:23.926+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0404160390 con 0x7f04040d29c0 2024-03-04T08:52:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.108+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f040406a1b0 con 0x7f04040d29c0 2024-03-04T08:52:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.109+0000 7f03faffd640 1 -- 172.21.15.19:0/2827257302 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13008 (secure 0 0 0) 0x7f03ec057e40 con 0x7f04040d29c0 2024-03-04T08:52:24.105 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:24.105 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:22.792681+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/2471090824":"2024-03-05T08:52:18.775504+0000","172.21.15.19:6833/2471090824":"2024-03-05T08:52:18.775504+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 msgr2=0x7f03e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 0x7f03e406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f03f4036000 tx=0x7f03f403b040 comp rx=0 tx=0).stop 2024-03-04T08:52:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 msgr2=0x7f04040b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c440 tx=0x7f03ec001e70 comp rx=0 tx=0).stop 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 shutdown_connections 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f040415dfe0 0x7f04040c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04040d29c0 0x7f04040b4f50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f03e406b4d0 0x7f03e406d990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 --2- 172.21.15.19:0/2827257302 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04040cf830 0x7f04040cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 >> 172.21.15.19:0/2827257302 conn(0x7f04040d3cd0 msgr2=0x7f04040cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 shutdown_connections 2024-03-04T08:52:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.111+0000 7f0408a88640 1 -- 172.21.15.19:0/2827257302 wait complete. 2024-03-04T08:52:24.118 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:24.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.226+0000 7f460a9b6640 1 Processor -- start 2024-03-04T08:52:24.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.226+0000 7f460a9b6640 1 -- start start 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f460a9b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46040d4860 0x7f46040d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f460a9b6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f46040b0e30 0x7f46040b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f460a9b6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46041618b0 con 0x7f46041614d0 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f460a9b6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46040d4cc0 con 0x7f46040b0e30 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f460a9b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040cf400 con 0x7f46040d4860 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f4603fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f46041614d0 0x7f46040d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52122/0 (socket says 172.21.15.19:52122) 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f4603fff640 1 -- 172.21.15.19:0/2580559674 learned_addr learned my addr 172.21.15.19:0/2580559674 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:24.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f4608f53640 1 --2- 172.21.15.19:0/2580559674 >> v2:172.21.15.204:3300/0 conn(0x7f46040b0e30 0x7f46040b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.227+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46040d4860 0x7f46040d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22397337 0 0) 0x7f46041618b0 con 0x7f46041614d0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f0003520 con 0x7f46041614d0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287432059 0 0) 0x7f45f0003520 con 0x7f46041614d0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46040d4860 msgr2=0x7f46040d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46040d4860 0x7f46040d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 >> v2:172.21.15.204:3300/0 conn(0x7f46040b0e30 msgr2=0x7f46040b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 --2- 172.21.15.19:0/2580559674 >> v2:172.21.15.204:3300/0 conn(0x7f46040b0e30 0x7f46040b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040cf6a0 con 0x7f46041614d0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f45f4001670 con 0x7f46041614d0 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 >> v1:172.21.15.19:6789/0 conn(0x7f46041614d0 legacy=0x7f46040d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f00039b0 0x7f45f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45f00043a0 0x7f45f0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f0004ef0 0x7f45f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040d4cc0 con 0x7f45f00043a0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040cf400 con 0x7f45f0004ef0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f000bf00 con 0x7f45f00039b0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f46040d4860 0x7f46040d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4608f53640 1 --2- 172.21.15.19:0/2580559674 >> v2:172.21.15.204:3300/0 conn(0x7f46040b0e30 0x7f46040b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45f00043a0 0x7f45f0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4603fff640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f00039b0 0x7f45f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f4608f53640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f0004ef0 0x7f45f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 -- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f00039b0 msgr2=0x7f45f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f45f00039b0 0x7f45f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 -- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f0004ef0 msgr2=0x7f45f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f0004ef0 0x7f45f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.228+0000 7f46037fe640 1 -- 172.21.15.19:0/2580559674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0003520 con 0x7f45f00043a0 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.229+0000 7f46037fe640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45f00043a0 0x7f45f0004880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009b00 tx=0x7f45f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb145101f962ce7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.229+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0097d0 con 0x7f45f00043a0 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.229+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec004030 con 0x7f45f00043a0 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.229+0000 7f4602ffd640 1 -- 172.21.15.19:0/2580559674 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec004400 con 0x7f45f00043a0 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 -- 172.21.15.19:0/2580559674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45f00043a0 msgr2=0x7f45f0004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 --2- 172.21.15.19:0/2580559674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45f00043a0 0x7f45f0004880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009b00 tx=0x7f45f0005830 comp rx=0 tx=0).stop 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f4608f53640 1 -- 172.21.15.19:0/2580559674 reap_dead start 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 -- 172.21.15.19:0/2580559674 shutdown_connections 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 -- 172.21.15.19:0/2580559674 >> 172.21.15.19:0/2580559674 conn(0x7f46040d3d40 msgr2=0x7f46040d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 -- 172.21.15.19:0/2580559674 shutdown_connections 2024-03-04T08:52:24.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.230+0000 7f460a9b6640 1 -- 172.21.15.19:0/2580559674 wait complete. 2024-03-04T08:52:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.231+0000 7f460a9b6640 1 Processor -- start 2024-03-04T08:52:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.231+0000 7f460a9b6640 1 -- start start 2024-03-04T08:52:24.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 0x7f46040cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 0x7f46040cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040b0910 con 0x7f4604152e30 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040cfc60 con 0x7f45f00043a0 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f460a9b6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040d2020 con 0x7f460415c370 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56022/0 (socket says 172.21.15.19:56022) 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 -- 172.21.15.19:0/1298414508 learned_addr learned my addr 172.21.15.19:0/1298414508 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 -- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 msgr2=0x7f46040cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f46037fe640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 0x7f46040cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4603fff640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 0x7f46040cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 0x7f46040cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 -- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 msgr2=0x7f46040cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 0x7f46040cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 -- 172.21.15.19:0/1298414508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040cb640 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f46037fe640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 0x7f46040cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4603fff640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 0x7f46040cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.232+0000 7f4608f53640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46040b2a70 tx=0x7f45fc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.233+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc003990 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.233+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc003b30 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.233+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46040cb920 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.233+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004020 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.233+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46040cbee0 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.234+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4604068ff0 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.234+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45fc0041c0 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.234+0000 7f4600ff9640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 0x7f45e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.235+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f45fc08acd0 con 0x7f4604152e30 2024-03-04T08:52:24.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.235+0000 7f4603fff640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 0x7f45e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.235+0000 7f4603fff640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 0x7f45e406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001470 tx=0x7f45f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.239+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f45fc019030 con 0x7f4604152e30 2024-03-04T08:52:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.423+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46040d11a0 con 0x7f4604152e30 2024-03-04T08:52:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.423+0000 7f4600ff9640 1 -- 172.21.15.19:0/1298414508 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45fc010040 con 0x7f4604152e30 2024-03-04T08:52:24.420 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 msgr2=0x7f45e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 0x7f45e406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f45f4001470 tx=0x7f45f4009040 comp rx=0 tx=0).stop 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 msgr2=0x7f46041532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f46040b2a70 tx=0x7f45fc00f580 comp rx=0 tx=0).stop 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 shutdown_connections 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4604152e30 0x7f46041532e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f460415c370 0x7f46040cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f45e406b4d0 0x7f45e406d990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 --2- 172.21.15.19:0/1298414508 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f45f00043a0 0x7f46040cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 >> 172.21.15.19:0/1298414508 conn(0x7f46040d3d40 msgr2=0x7f46040d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:24.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 shutdown_connections 2024-03-04T08:52:24.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.426+0000 7f460a9b6640 1 -- 172.21.15.19:0/1298414508 wait complete. 2024-03-04T08:52:24.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-03-04T08:52:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.538+0000 7f61dc264640 1 Processor -- start 2024-03-04T08:52:24.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61dc264640 1 -- start start 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61dc264640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61d40b35d0 0x7f61d40b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61dc264640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d406e260 con 0x7f61d40cf4d0 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61dc264640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d406e540 con 0x7f61d40b39b0 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61dc264640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40ce030 con 0x7f61d40b35d0 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.539+0000 7f61da000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61d40b35d0 0x7f61d40b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.540+0000 7f61da000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61d40b35d0 0x7f61d40b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56034/0 (socket says 172.21.15.19:56034) 2024-03-04T08:52:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.540+0000 7f61da000640 1 -- 172.21.15.19:0/1285689609 learned_addr learned my addr 172.21.15.19:0/1285689609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.540+0000 7f61da000640 1 -- 172.21.15.19:0/1285689609 >> v1:172.21.15.204:6789/0 conn(0x7f61d40b39b0 legacy=0x7f61d406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.540+0000 7f61da000640 1 -- 172.21.15.19:0/1285689609 >> v1:172.21.15.19:6789/0 conn(0x7f61d40cf4d0 legacy=0x7f61d4165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.540+0000 7f61da000640 1 -- 172.21.15.19:0/1285689609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d406e820 con 0x7f61d40b35d0 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61da000640 1 --2- 172.21.15.19:0/1285689609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d40b5890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd9bc30783fa2ed server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61d8ffe640 1 -- 172.21.15.19:0/1285689609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0034070 con 0x7f61d40b35d0 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61d8ffe640 1 -- 172.21.15.19:0/1285689609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0030860 con 0x7f61d40b35d0 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61d8ffe640 1 -- 172.21.15.19:0/1285689609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0030c30 con 0x7f61d40b35d0 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61dc264640 1 -- 172.21.15.19:0/1285689609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 msgr2=0x7f61d40b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61dc264640 1 --2- 172.21.15.19:0/1285689609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d40b5890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61dc264640 1 -- 172.21.15.19:0/1285689609 shutdown_connections 2024-03-04T08:52:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61dc264640 1 --2- 172.21.15.19:0/1285689609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d40b5890 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.541+0000 7f61dc264640 1 -- 172.21.15.19:0/1285689609 >> 172.21.15.19:0/1285689609 conn(0x7f61d40b1b70 msgr2=0x7f61d40b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:24.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.542+0000 7f61dc264640 1 -- 172.21.15.19:0/1285689609 shutdown_connections 2024-03-04T08:52:24.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.542+0000 7f61dc264640 1 -- 172.21.15.19:0/1285689609 wait complete. 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.543+0000 7f61dc264640 1 Processor -- start 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.543+0000 7f61dc264640 1 -- start start 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.543+0000 7f61dc264640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d40b39b0 0x7f61d4130780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d40cf4d0 0x7f61d4140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4145a90 con 0x7f61d40b35d0 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40b3e40 con 0x7f61d40cf4d0 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4145c10 con 0x7f61d40b39b0 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56046/0 (socket says 172.21.15.19:56046) 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 -- 172.21.15.19:0/354234862 learned_addr learned my addr 172.21.15.19:0/354234862 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 -- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d40b39b0 msgr2=0x7f61d4130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d40b39b0 0x7f61d4130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 -- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d40cf4d0 msgr2=0x7f61d4140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da801640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d40cf4d0 0x7f61d4140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d40cf4d0 0x7f61d4140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 -- 172.21.15.19:0/354234862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4130cc0 con 0x7f61d40b35d0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61da000640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0034040 con 0x7f61d40b35d0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00433f0 con 0x7f61d40b35d0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d4130f50 con 0x7f61d40b35d0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00437e0 con 0x7f61d40b35d0 2024-03-04T08:52:24.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.544+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d4131510 con 0x7f61d40b35d0 2024-03-04T08:52:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.545+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d404f330 con 0x7f61d40b35d0 2024-03-04T08:52:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.546+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f61d004a060 con 0x7f61d40b35d0 2024-03-04T08:52:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.546+0000 7f61ca7fc640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 0x7f61b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.546+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61d00ac1e0 con 0x7f61d40b35d0 2024-03-04T08:52:24.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.546+0000 7f61d97ff640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 0x7f61b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:24.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.547+0000 7f61d97ff640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 0x7f61b806d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006fd0 tx=0x7f61c4006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.550+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f61d003e070 con 0x7f61d40b35d0 2024-03-04T08:52:24.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:24.801+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f61d4068480 con 0x7f61d40b35d0 2024-03-04T08:52:25.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.804+0000 7f61ca7fc640 1 -- 172.21.15.19:0/354234862 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v114) v1 ==== 137+0+0 (secure 0 0 0) 0x7f61d007b360 con 0x7f61d40b35d0 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 msgr2=0x7f61b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 0x7f61b806d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006fd0 tx=0x7f61c4006bc0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 msgr2=0x7f61d41e5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d00046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 shutdown_connections 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f61b806b4d0 0x7f61b806d990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f61d40cf4d0 0x7f61d4140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f61d40b39b0 0x7f61d4130780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 --2- 172.21.15.19:0/354234862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61d40b35d0 0x7f61d41e5210 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 >> 172.21.15.19:0/354234862 conn(0x7f61d40b1b70 msgr2=0x7f61d40b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:25.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 shutdown_connections 2024-03-04T08:52:25.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.807+0000 7f61dc264640 1 -- 172.21.15.19:0/354234862 wait complete. 2024-03-04T08:52:25.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-04T08:52:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.931+0000 7fe53bcf4640 1 Processor -- start 2024-03-04T08:52:25.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.931+0000 7fe53bcf4640 1 -- start start 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53bcf4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe53415def0 0x7fe5340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53bcf4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe53406cab0 0x7fe5340ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53bcf4640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53406d030 con 0x7fe5340ce880 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53bcf4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340cecf0 con 0x7fe53415def0 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53bcf4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cf1c0 con 0x7fe53406cab0 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe539a90640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe53415def0 0x7fe5340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe539a90640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe53415def0 0x7fe5340b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56048/0 (socket says 172.21.15.19:56048) 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe539a90640 1 -- 172.21.15.19:0/1765566850 learned_addr learned my addr 172.21.15.19:0/1765566850 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe53928f640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe53406cab0 0x7fe5340ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.932+0000 7fe539a90640 1 -- 172.21.15.19:0/1765566850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe53406cab0 msgr2=0x7fe5340ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:25.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.933+0000 7fe539a90640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe53406cab0 0x7fe5340ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.933+0000 7fe539a90640 1 -- 172.21.15.19:0/1765566850 >> v1:172.21.15.204:6789/0 conn(0x7fe5340ce880 legacy=0x7fe5340cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:25.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.933+0000 7fe539a90640 1 -- 172.21.15.19:0/1765566850 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53406d310 con 0x7fe53415def0 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.933+0000 7fe539a90640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53415def0 0x7fe5340b41b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009870 tx=0x7fe52c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7200cd4d5ebbfe server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.933+0000 7fe538a8e640 1 -- 172.21.15.19:0/1765566850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c02f840 con 0x7fe53415def0 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe538a8e640 1 -- 172.21.15.19:0/1765566850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c02f9e0 con 0x7fe53415def0 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe538a8e640 1 -- 172.21.15.19:0/1765566850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c02fdb0 con 0x7fe53415def0 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 -- 172.21.15.19:0/1765566850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53415def0 msgr2=0x7fe5340b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53415def0 0x7fe5340b41b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009870 tx=0x7fe52c02ba20 comp rx=0 tx=0).stop 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 -- 172.21.15.19:0/1765566850 shutdown_connections 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe53406cab0 0x7fe5340ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/1765566850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53415def0 0x7fe5340b41b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 -- 172.21.15.19:0/1765566850 >> 172.21.15.19:0/1765566850 conn(0x7fe5340b3690 msgr2=0x7fe5340b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 -- 172.21.15.19:0/1765566850 shutdown_connections 2024-03-04T08:52:25.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.934+0000 7fe53bcf4640 1 -- 172.21.15.19:0/1765566850 wait complete. 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.935+0000 7fe53bcf4640 1 Processor -- start 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.935+0000 7fe53bcf4640 1 -- start start 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 0x7fe5340b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe53415def0 0x7fe5340b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cc3f0 con 0x7fe53406cab0 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cc760 con 0x7fe53415def0 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53bcf4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415e2d0 con 0x7fe5340ce880 2024-03-04T08:52:25.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56062/0 (socket says 172.21.15.19:56062) 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 -- 172.21.15.19:0/2609260659 learned_addr learned my addr 172.21.15.19:0/2609260659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53928f640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 0x7fe5340b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53a291640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe53415def0 0x7fe5340b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 -- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 msgr2=0x7fe5340b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 0x7fe5340b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 -- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe53415def0 msgr2=0x7fe5340b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe53415def0 0x7fe5340b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe539a90640 1 -- 172.21.15.19:0/2609260659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534145fe0 con 0x7fe53406cab0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.936+0000 7fe53928f640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 0x7fe5340b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe539a90640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe52c000c00 tx=0x7fe52c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c037c90 con 0x7fe53406cab0 2024-03-04T08:52:25.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c046070 con 0x7fe53406cab0 2024-03-04T08:52:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53415f130 con 0x7fe53406cab0 2024-03-04T08:52:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c041640 con 0x7fe53406cab0 2024-03-04T08:52:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.937+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5340b7610 con 0x7fe53406cab0 2024-03-04T08:52:25.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.938+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53409fcf0 con 0x7fe53406cab0 2024-03-04T08:52:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.938+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe52c040070 con 0x7fe53406cab0 2024-03-04T08:52:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.939+0000 7fe5327fc640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 0x7fe52006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.939+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe52c0ac550 con 0x7fe53406cab0 2024-03-04T08:52:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.939+0000 7fe53928f640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 0x7fe52006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:25.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.940+0000 7fe53928f640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 0x7fe52006d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe5340d0e30 tx=0x7fe528008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:25.943+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe52c033030 con 0x7fe53406cab0 2024-03-04T08:52:26.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.126+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe534068ff0 con 0x7fe53406cab0 2024-03-04T08:52:26.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.129+0000 7fe5327fc640 1 -- 172.21.15.19:0/2609260659 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe52c07b6d0 con 0x7fe53406cab0 2024-03-04T08:52:26.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 msgr2=0x7fe52006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 0x7fe52006d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe5340d0e30 tx=0x7fe528008040 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 msgr2=0x7fe5341f3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe52c000c00 tx=0x7fe52c004730 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 shutdown_connections 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fe52006b4d0 0x7fe52006d990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fe53415def0 0x7fe5340b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fe5340ce880 0x7fe5340b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 --2- 172.21.15.19:0/2609260659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53406cab0 0x7fe5341f3ad0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 >> 172.21.15.19:0/2609260659 conn(0x7fe5340b3690 msgr2=0x7fe5340b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 shutdown_connections 2024-03-04T08:52:26.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.131+0000 7fe53bcf4640 1 -- 172.21.15.19:0/2609260659 wait complete. 2024-03-04T08:52:26.140 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-04T08:52:26.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:26.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:26.218 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-04T08:52:26.219 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:26.219 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:26.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:52:26.234 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:26.234 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:26.276 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:26.277 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:26.277 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:26.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:52:26.291 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:26.291 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:26.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:26.334 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-04T08:52:26.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:26.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.439+0000 7fa9dd422640 1 Processor -- start 2024-03-04T08:52:26.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.439+0000 7fa9dd422640 1 -- start start 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9dd422640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9dd422640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 0x7fa9d80d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9dd422640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d815e470 con 0x7fa9d815e090 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9dd422640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d80d18f0 con 0x7fa9d80d0650 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9dd422640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80b3cf0 con 0x7fa9d80d2920 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9d67fc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9d77fe640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 0x7fa9d80d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9d6ffd640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa9d815e090 0x7fa9d80b35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:38518/0 (socket says 172.21.15.19:38518) 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.440+0000 7fa9d6ffd640 1 -- 172.21.15.19:0/1058139320 learned_addr learned my addr 172.21.15.19:0/1058139320 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.441+0000 7fa9d67fc640 1 -- 172.21.15.19:0/1058139320 >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 msgr2=0x7fa9d80d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.441+0000 7fa9d67fc640 1 --2- 172.21.15.19:0/1058139320 >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 0x7fa9d80d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.441+0000 7fa9d67fc640 1 -- 172.21.15.19:0/1058139320 >> v1:172.21.15.204:6789/0 conn(0x7fa9d815e090 legacy=0x7fa9d80b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.441+0000 7fa9d67fc640 1 -- 172.21.15.19:0/1058139320 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80d1b90 con 0x7fa9d80d2920 2024-03-04T08:52:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.441+0000 7fa9d77fe640 1 --2- 172.21.15.19:0/1058139320 >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 0x7fa9d80d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9d67fc640 1 --2- 172.21.15.19:0/1058139320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80d47a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0097a0 tx=0x7fa9cc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b253420a26fbb1a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9d5ffb640 1 -- 172.21.15.19:0/1058139320 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc035020 con 0x7fa9d80d2920 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9d5ffb640 1 -- 172.21.15.19:0/1058139320 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc031830 con 0x7fa9d80d2920 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9d5ffb640 1 -- 172.21.15.19:0/1058139320 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc031c00 con 0x7fa9d80d2920 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 -- 172.21.15.19:0/1058139320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 msgr2=0x7fa9d80d47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 --2- 172.21.15.19:0/1058139320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80d47a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0097a0 tx=0x7fa9cc02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 -- 172.21.15.19:0/1058139320 shutdown_connections 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 --2- 172.21.15.19:0/1058139320 >> v2:172.21.15.204:3300/0 conn(0x7fa9d80d0650 0x7fa9d80d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 --2- 172.21.15.19:0/1058139320 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80d47a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 -- 172.21.15.19:0/1058139320 >> 172.21.15.19:0/1058139320 conn(0x7fa9d80d3c80 msgr2=0x7fa9d80d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:26.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 -- 172.21.15.19:0/1058139320 shutdown_connections 2024-03-04T08:52:26.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.442+0000 7fa9dd422640 1 -- 172.21.15.19:0/1058139320 wait complete. 2024-03-04T08:52:26.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 Processor -- start 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 -- start start 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 0x7fa9d80b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80b2df0 con 0x7fa9d815e090 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80cee30 con 0x7fa9d80d0650 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9dd422640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80ce800 con 0x7fa9d80d2920 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56066/0 (socket says 172.21.15.19:56066) 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.444+0000 7fa9d77fe640 1 -- 172.21.15.19:0/2117244783 learned_addr learned my addr 172.21.15.19:0/2117244783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d6ffd640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 0x7fa9d80b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d67fc640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 -- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 msgr2=0x7fa9d80a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 -- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 msgr2=0x7fa9d80b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 0x7fa9d80b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 -- 172.21.15.19:0/2117244783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80b7c30 con 0x7fa9d815e090 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d6ffd640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 0x7fa9d80b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9d77fe640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e8b0 tx=0x7fa9d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0017070 con 0x7fa9d815e090 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d0004020 con 0x7fa9d815e090 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80b7f10 con 0x7fa9d815e090 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00043f0 con 0x7fa9d815e090 2024-03-04T08:52:26.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.445+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d80b84d0 con 0x7fa9d815e090 2024-03-04T08:52:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.446+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d804f330 con 0x7fa9d815e090 2024-03-04T08:52:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.447+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9d000c940 con 0x7fa9d815e090 2024-03-04T08:52:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.447+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 0x7fa9c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.447+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9d008a070 con 0x7fa9d815e090 2024-03-04T08:52:26.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.447+0000 7fa9d6ffd640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 0x7fa9c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.448+0000 7fa9d6ffd640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 0x7fa9c406d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80012e0 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.451+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa9d0059200 con 0x7fa9d815e090 2024-03-04T08:52:26.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.669+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9d80d1230 con 0x7fa9d815e090 2024-03-04T08:52:26.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.670+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/2117244783 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3698 (secure 0 0 0) 0x7fa9d0058b00 con 0x7fa9d815e090 2024-03-04T08:52:26.666 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:26.666 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/1860553533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1860553533},{"type":"v1","addr":"172.21.15.204:6836","nonce":1860553533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6834/870825602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":870825602},{"type":"v1","addr":"172.21.15.19:6834","nonce":870825602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3861905124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3861905124},{"type":"v1","addr":"172.21.15.204:6837","nonce":3861905124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/581202289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6833","nonce":581202289},{"type":"v1","addr":"172.21.15.19:6835","nonce":581202289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2024-03-04T08:52:26.666 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 msgr2=0x7fa9c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 0x7fa9c406d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80012e0 tx=0x7fa9c8009040 comp rx=0 tx=0).stop 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 msgr2=0x7fa9d80b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000e8b0 tx=0x7fa9d000ed70 comp rx=0 tx=0).stop 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 shutdown_connections 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d815e090 0x7fa9d80b8fa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa9d80d2920 0x7fa9d80a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa9c406b4d0 0x7fa9c406d990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 --2- 172.21.15.19:0/2117244783 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa9d80d0650 0x7fa9d80b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.671+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 >> 172.21.15.19:0/2117244783 conn(0x7fa9d80d3c80 msgr2=0x7fa9d80b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:26.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.672+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 shutdown_connections 2024-03-04T08:52:26.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.672+0000 7fa9dd422640 1 -- 172.21.15.19:0/2117244783 wait complete. 2024-03-04T08:52:26.679 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-04T08:52:26.679 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-04T08:52:26.679 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-04T08:52:26.679 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:26.680 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-04T08:52:26.680 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-04T08:52:26.680 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-04T08:52:26.680 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:26.680 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-04T08:52:26.680 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-04T08:52:26.681 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-04T08:52:26.681 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:26.681 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-04T08:52:26.681 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-04T08:52:26.681 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-04T08:52:26.681 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:26.689 INFO:tasks.ceph.mds.a:Stopped 2024-03-04T08:52:26.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-04T08:52:26.690 INFO:tasks.ceph.mds.c:Stopped 2024-03-04T08:52:26.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-04T08:52:26.692 INFO:tasks.ceph.mds.b:Stopped 2024-03-04T08:52:26.692 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-04T08:52:26.693 INFO:tasks.ceph.mds.d:Stopped 2024-03-04T08:52:26.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-04T08:52:26.732 INFO:tasks.ceph.mds.a:Started 2024-03-04T08:52:26.732 INFO:tasks.ceph.mds.c:Started 2024-03-04T08:52:26.732 DEBUG:teuthology.parallel:result is None 2024-03-04T08:52:26.733 DEBUG:teuthology.parallel:result is None 2024-03-04T08:52:26.735 INFO:tasks.ceph.mds.b:Started 2024-03-04T08:52:26.735 DEBUG:teuthology.parallel:result is None 2024-03-04T08:52:26.735 INFO:tasks.ceph.mds.d:Started 2024-03-04T08:52:26.736 DEBUG:teuthology.parallel:result is None 2024-03-04T08:52:26.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-04T08:52:26.807 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-04T08:52:26.808 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-04T08:52:26.819 INFO:tasks.ceph.mds.d.smithi204.stdout:starting mds.d at 2024-03-04T08:52:26.819 INFO:tasks.ceph.mds.b.smithi204.stdout:starting mds.b at 2024-03-04T08:52:26.819 INFO:tasks.ceph.mds.d.smithi204.stderr:2024-03-04T08:52:26.822+0000 7f0286ad8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.847+0000 7f289a4fb640 1 Processor -- start 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 -- start start 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28940b4c00 0x7f28940b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b28a0 0x7f28940b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289415d510 con 0x7f289415e540 2024-03-04T08:52:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289415e0b0 con 0x7f28940b4c00 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f289a4fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289415d780 con 0x7f28940b28a0 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f2893fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28940b4c00 0x7f28940b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f2893fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28940b4c00 0x7f28940b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56094/0 (socket says 172.21.15.19:56094) 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.848+0000 7f2893fff640 1 -- 172.21.15.19:0/60888956 learned_addr learned my addr 172.21.15.19:0/60888956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.849+0000 7f28937fe640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b28a0 0x7f28940b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.849+0000 7f2893fff640 1 -- 172.21.15.19:0/60888956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b28a0 msgr2=0x7f28940b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.849+0000 7f2893fff640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b28a0 0x7f28940b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.849+0000 7f2893fff640 1 -- 172.21.15.19:0/60888956 >> v1:172.21.15.19:6789/0 conn(0x7f289415e540 legacy=0x7f289415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.849+0000 7f2893fff640 1 -- 172.21.15.19:0/60888956 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289415da60 con 0x7f28940b4c00 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f2893fff640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28940b4c00 0x7f28940b4fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2884009870 tx=0x7f288402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6721c9a399f4a5cb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f2892ffd640 1 -- 172.21.15.19:0/60888956 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402f830 con 0x7f28940b4c00 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f2892ffd640 1 -- 172.21.15.19:0/60888956 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288402f9d0 con 0x7f28940b4c00 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f2892ffd640 1 -- 172.21.15.19:0/60888956 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402fda0 con 0x7f28940b4c00 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 -- 172.21.15.19:0/60888956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28940b4c00 msgr2=0x7f28940b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28940b4c00 0x7f28940b4fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2884009870 tx=0x7f288402ba10 comp rx=0 tx=0).stop 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 -- 172.21.15.19:0/60888956 shutdown_connections 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b28a0 0x7f28940b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 --2- 172.21.15.19:0/60888956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28940b4c00 0x7f28940b4fe0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 -- 172.21.15.19:0/60888956 >> 172.21.15.19:0/60888956 conn(0x7f289409a9f0 msgr2=0x7f289409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 -- 172.21.15.19:0/60888956 shutdown_connections 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.850+0000 7f289a4fb640 1 -- 172.21.15.19:0/60888956 wait complete. 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.851+0000 7f289a4fb640 1 Processor -- start 2024-03-04T08:52:26.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.852+0000 7f289a4fb640 1 -- start start 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.852+0000 7f289a4fb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28940b28a0 0x7f289414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.852+0000 7f289a4fb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b4c00 0x7f289406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.852+0000 7f289a4fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f289a4fb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940b33a0 con 0x7f289415e540 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f289a4fb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940b3220 con 0x7f28940b28a0 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f289a4fb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289415f090 con 0x7f28940b4c00 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56100/0 (socket says 172.21.15.19:56100) 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 -- 172.21.15.19:0/3613929941 learned_addr learned my addr 172.21.15.19:0/3613929941 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2893fff640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28940b28a0 0x7f289414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f28937fe640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b4c00 0x7f289406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 -- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b4c00 msgr2=0x7f289406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b4c00 0x7f289406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 -- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28940b28a0 msgr2=0x7f289414fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28940b28a0 0x7f289414fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 -- 172.21.15.19:0/3613929941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894156e20 con 0x7f289415e540 2024-03-04T08:52:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2898a98640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c6b0 tx=0x7f288c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c003b70 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c003d30 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2894150310 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c005310 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.853+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2894151a20 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.855+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289404f330 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.855+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f288c0054b0 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.855+0000 7f2890ff9640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 0x7f287406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.856+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f288c089bc0 con 0x7f289415e540 2024-03-04T08:52:26.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.856+0000 7f2893fff640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 0x7f287406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:26.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.856+0000 7f2893fff640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 0x7f287406d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2884036000 tx=0x7f2884008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:26.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:26.860+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f288c0586f0 con 0x7f289415e540 2024-03-04T08:52:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.054+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f289415b130 con 0x7f289415e540 2024-03-04T08:52:27.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.815+0000 7f2890ff9640 1 -- 172.21.15.19:0/3613929941 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f288c05c790 con 0x7f289415e540 2024-03-04T08:52:27.814 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 msgr2=0x7f287406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 0x7f287406d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2884036000 tx=0x7f2884008030 comp rx=0 tx=0).stop 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 msgr2=0x7f289406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c6b0 tx=0x7f288c00cb70 comp rx=0 tx=0).stop 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 shutdown_connections 2024-03-04T08:52:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289415e540 0x7f289406fee0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f28940b4c00 0x7f289406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f287406b500 0x7f287406d9c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 --2- 172.21.15.19:0/3613929941 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f28940b28a0 0x7f289414fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 >> 172.21.15.19:0/3613929941 conn(0x7f289409a9f0 msgr2=0x7f2894159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 shutdown_connections 2024-03-04T08:52:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.819+0000 7f289a4fb640 1 -- 172.21.15.19:0/3613929941 wait complete. 2024-03-04T08:52:27.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-04T08:52:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 Processor -- start 2024-03-04T08:52:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 -- start start 2024-03-04T08:52:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 0x7fb66815e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb66815bf30 0x7fb66815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66815f2d0 con 0x7fb66813dc10 2024-03-04T08:52:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.946+0000 7fb66cd3e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680cf3f0 con 0x7fb66815bf30 2024-03-04T08:52:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb66cd3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66815b210 con 0x7fb6680b3060 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb666d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb66815bf30 0x7fb66815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb66659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb66813dc10 0x7fb6680b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44932/0 (socket says 172.21.15.19:44932) 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb66659c640 1 -- 172.21.15.19:0/2187389341 learned_addr learned my addr 172.21.15.19:0/2187389341 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb665d9b640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 0x7fb66815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb666d9d640 1 -- 172.21.15.19:0/2187389341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 msgr2=0x7fb66815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb666d9d640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 0x7fb66815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb666d9d640 1 -- 172.21.15.19:0/2187389341 >> v1:172.21.15.19:6789/0 conn(0x7fb66813dc10 legacy=0x7fb6680b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb666d9d640 1 -- 172.21.15.19:0/2187389341 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66815f580 con 0x7fb66815bf30 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb66559a640 1 -- 172.21.15.19:0/2187389341 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297435314 0 0) 0x7fb66815f2d0 con 0x7fb66813dc10 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.947+0000 7fb665d9b640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 0x7fb66815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb666d9d640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66815bf30 0x7fb66815ed90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb658009d90 tx=0x7fb65802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b0825323b8da16 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66559a640 1 -- 172.21.15.19:0/2187389341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658039070 con 0x7fb66815bf30 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66559a640 1 -- 172.21.15.19:0/2187389341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65802cbc0 con 0x7fb66815bf30 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66559a640 1 -- 172.21.15.19:0/2187389341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658034440 con 0x7fb66815bf30 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 -- 172.21.15.19:0/2187389341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66815bf30 msgr2=0x7fb66815ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66815bf30 0x7fb66815ed90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb658009d90 tx=0x7fb65802be10 comp rx=0 tx=0).stop 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 -- 172.21.15.19:0/2187389341 shutdown_connections 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66815bf30 0x7fb66815ed90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/2187389341 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb6680b3060 0x7fb66815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.948+0000 7fb66cd3e640 1 -- 172.21.15.19:0/2187389341 >> 172.21.15.19:0/2187389341 conn(0x7fb6680cf8a0 msgr2=0x7fb6680cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.949+0000 7fb66cd3e640 1 -- 172.21.15.19:0/2187389341 shutdown_connections 2024-03-04T08:52:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.949+0000 7fb66cd3e640 1 -- 172.21.15.19:0/2187389341 wait complete. 2024-03-04T08:52:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.950+0000 7fb66cd3e640 1 Processor -- start 2024-03-04T08:52:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.950+0000 7fb66cd3e640 1 -- start start 2024-03-04T08:52:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 0x7fb668144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 0x7fb66813faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66813dff0 con 0x7fb66813dc10 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66815b730 con 0x7fb6680b3060 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680cd7a0 con 0x7fb66815bf30 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49418/0 (socket says 172.21.15.19:49418) 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 -- 172.21.15.19:0/3184823802 learned_addr learned my addr 172.21.15.19:0/3184823802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66659c640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 0x7fb668144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb666d9d640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 0x7fb66813faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 -- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 msgr2=0x7fb66813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 0x7fb66813faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 -- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 msgr2=0x7fb668144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 0x7fb668144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 -- 172.21.15.19:0/3184823802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668136c20 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66659c640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 0x7fb668144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb666d9d640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 0x7fb66813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb665d9b640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c820 tx=0x7fb65c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c015070 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c007a30 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb668136660 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c007e00 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.951+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66813f2f0 con 0x7fb66813dc10 2024-03-04T08:52:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.952+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6680b0d90 con 0x7fb66813dc10 2024-03-04T08:52:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.953+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb65c018070 con 0x7fb66813dc10 2024-03-04T08:52:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.953+0000 7fb656ffd640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 0x7fb64806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.953+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb65c089e00 con 0x7fb66813dc10 2024-03-04T08:52:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.953+0000 7fb66659c640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 0x7fb64806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.954+0000 7fb66659c640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 0x7fb64806d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb660000f60 tx=0x7fb660009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:27.957+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb6680b0d90 con 0x7fb66813dc10 2024-03-04T08:52:28.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.206+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb66804f330 con 0x7fb66813dc10 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.206+0000 7fb656ffd640 1 -- 172.21.15.19:0/3184823802 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fb65c059060 con 0x7fb66813dc10 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlEcsCNRAAUzvzvhMN8gnJosuFxLUHqw==", 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:52:28.203 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VluQXtBRAA/wYzOXPS2Bqlh3VAhyOUpg==", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:52:28.204 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+Vlhoe6ABAAPzUP1YdMlMQU37qwqLT+ZA==", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-03-04T08:52:28.205 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlBRJSDRAAiwMfg88SW040cRjdKJXhRw==", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAui+VlznMiORAAT96nxm14OosHC+bHoPIiZA==", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.206 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAxi+VlbqD6NxAA4wfoo2B1x13CFMDPmsd8Ug==", 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-03-04T08:52:28.207 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA0i+Vlter/NhAAXGwCH0THZXPTM1FEfDfeOg==", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA3i+VlOmJ/NRAANQB/YtVOIXxHaetd8eAdFA==", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.208 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA+i+Vl9O8cABAAFSW2Lc4RkhNVvsVjK9BwiA==", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBAi+VltIXWOhAAST+2+h/CZPskEGl4eXF7PQ==", 2024-03-04T08:52:28.209 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBDi+VlBaMsORAAhhbWAiewRqh4N8TXwIjEKw==", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.210 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQBGi+VlktANNxAAtgoiE83zRaXvMj7mxC628g==", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A==", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.211 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow r", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rw pool=cephfs_data" 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+Vl1OrLGhAAZjajTghTwwRQZNoho6abMQ==", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.212 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VlPhBaFxAAaXF8WPorbi12hfYUPT8lrg==", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAri+VllNueIBAArPKtzKxHFoo5VMzuo8+H9Q==", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-04T08:52:28.213 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlSFPgFhAAqqyBWyvE91NmqyoC5qK7ng==", 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:52:28.214 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VldzSdMRAA+XTSL+TEsO9GpImB5ikozw==", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:28.215 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAqi+VlVdUzLBAA+L2IVB+rX+am60b8e5H4cQ==", 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-04T08:52:28.216 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 msgr2=0x7fb64806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 0x7fb64806d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb660000f60 tx=0x7fb660009040 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 msgr2=0x7fb668135c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c820 tx=0x7fb65c00cc20 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 shutdown_connections 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb66815bf30 0x7fb66813faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb66813dc10 0x7fb668135c00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb64806b4d0 0x7fb64806d990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 --2- 172.21.15.19:0/3184823802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb6680b3060 0x7fb668144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 >> 172.21.15.19:0/3184823802 conn(0x7fb6680cf8a0 msgr2=0x7fb668070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 shutdown_connections 2024-03-04T08:52:28.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.209+0000 7fb66cd3e640 1 -- 172.21.15.19:0/3184823802 wait complete. 2024-03-04T08:52:28.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:28.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.323+0000 7fca7e634640 1 Processor -- start 2024-03-04T08:52:28.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7e634640 1 -- start start 2024-03-04T08:52:28.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7e634640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fca7806c6d0 0x7fca7815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7e634640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cd450 con 0x7fca78066d90 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7e634640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cd730 con 0x7fca780b4f70 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7e634640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7815e9f0 con 0x7fca7806c6d0 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.324+0000 7fca7cbd1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca78066d90 0x7fca780ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44940/0 (socket says 172.21.15.19:44940) 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca7cbd1640 1 -- 172.21.15.19:0/2661673221 learned_addr learned my addr 172.21.15.19:0/2661673221 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca777fe640 1 --2- 172.21.15.19:0/2661673221 >> v2:172.21.15.204:3300/0 conn(0x7fca7806c6d0 0x7fca7815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca76ffd640 1 -- 172.21.15.19:0/2661673221 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317884105 0 0) 0x7fca780cd450 con 0x7fca78066d90 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca76ffd640 1 -- 172.21.15.19:0/2661673221 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca60003520 con 0x7fca78066d90 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca777fe640 1 -- 172.21.15.19:0/2661673221 >> v1:172.21.15.204:6789/0 conn(0x7fca780b4f70 legacy=0x7fca780b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca777fe640 1 -- 172.21.15.19:0/2661673221 >> v1:172.21.15.19:6789/0 conn(0x7fca78066d90 legacy=0x7fca780ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.325+0000 7fca777fe640 1 -- 172.21.15.19:0/2661673221 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7815e680 con 0x7fca7806c6d0 2024-03-04T08:52:28.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca777fe640 1 --2- 172.21.15.19:0/2661673221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7806c6d0 0x7fca7815ee80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097a0 tx=0x7fca6c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7b7ff0ae2e1d31 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca76ffd640 1 -- 172.21.15.19:0/2661673221 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c034070 con 0x7fca7806c6d0 2024-03-04T08:52:28.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca76ffd640 1 -- 172.21.15.19:0/2661673221 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c030610 con 0x7fca7806c6d0 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca76ffd640 1 -- 172.21.15.19:0/2661673221 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0309c0 con 0x7fca7806c6d0 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca7e634640 1 -- 172.21.15.19:0/2661673221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7806c6d0 msgr2=0x7fca7815ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.326+0000 7fca7e634640 1 --2- 172.21.15.19:0/2661673221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7806c6d0 0x7fca7815ee80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097a0 tx=0x7fca6c02b960 comp rx=0 tx=0).stop 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.327+0000 7fca7e634640 1 -- 172.21.15.19:0/2661673221 shutdown_connections 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.327+0000 7fca7e634640 1 --2- 172.21.15.19:0/2661673221 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca7806c6d0 0x7fca7815ee80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.327+0000 7fca7e634640 1 -- 172.21.15.19:0/2661673221 >> 172.21.15.19:0/2661673221 conn(0x7fca780724d0 msgr2=0x7fca780728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.327+0000 7fca7e634640 1 -- 172.21.15.19:0/2661673221 shutdown_connections 2024-03-04T08:52:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.327+0000 7fca7e634640 1 -- 172.21.15.19:0/2661673221 wait complete. 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.328+0000 7fca7e634640 1 Processor -- start 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.328+0000 7fca7e634640 1 -- start start 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 0x7fca7814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 0x7fca780b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78161ad0 con 0x7fca78066d90 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780cda10 con 0x7fca781e78f0 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca78161c50 con 0x7fca780b4f70 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49428/0 (socket says 172.21.15.19:49428) 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 -- 172.21.15.19:0/3049294363 learned_addr learned my addr 172.21.15.19:0/3049294363 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7cbd1640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 0x7fca780b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca777fe640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 0x7fca7814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 -- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 msgr2=0x7fca7814b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 0x7fca7814b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 -- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 msgr2=0x7fca780b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 0x7fca780b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 -- 172.21.15.19:0/3049294363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca781e8260 con 0x7fca78066d90 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7cbd1640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 0x7fca780b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca777fe640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 0x7fca7814b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca77fff640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c3c0 tx=0x7fca6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680052d0 con 0x7fca78066d90 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68005490 con 0x7fca78066d90 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca780ad220 con 0x7fca78066d90 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68007260 con 0x7fca78066d90 2024-03-04T08:52:28.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.329+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7814b630 con 0x7fca78066d90 2024-03-04T08:52:28.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.330+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7804f330 con 0x7fca78066d90 2024-03-04T08:52:28.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.331+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca68007400 con 0x7fca78066d90 2024-03-04T08:52:28.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.331+0000 7fca74ff9640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 0x7fca6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.331+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca68089380 con 0x7fca78066d90 2024-03-04T08:52:28.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.331+0000 7fca777fe640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 0x7fca6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.332+0000 7fca777fe640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 0x7fca6406d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fca6c036000 tx=0x7fca6c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.335+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fca68058560 con 0x7fca78066d90 2024-03-04T08:52:28.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.516+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca780b1860 con 0x7fca78066d90 2024-03-04T08:52:28.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.516+0000 7fca74ff9640 1 -- 172.21.15.19:0/3049294363 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12879 (secure 0 0 0) 0x7fca68057e60 con 0x7fca78066d90 2024-03-04T08:52:28.513 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:28.513 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":45,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:27.826885+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 msgr2=0x7fca6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 0x7fca6406d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fca6c036000 tx=0x7fca6c008030 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 msgr2=0x7fca7814a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c3c0 tx=0x7fca6800c880 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 shutdown_connections 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fca6406b4d0 0x7fca6406d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca781e78f0 0x7fca780b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fca780b4f70 0x7fca7814b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 --2- 172.21.15.19:0/3049294363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca78066d90 0x7fca7814a710 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 >> 172.21.15.19:0/3049294363 conn(0x7fca780724d0 msgr2=0x7fca7806e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 shutdown_connections 2024-03-04T08:52:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.518+0000 7fca7e634640 1 -- 172.21.15.19:0/3049294363 wait complete. 2024-03-04T08:52:28.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:28.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:28.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.636+0000 7f7ab19f7640 1 Processor -- start 2024-03-04T08:52:28.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.636+0000 7f7ab19f7640 1 -- start start 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7ab19f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7aac0719e0 0x7f7aac0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7ab19f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 0x7f7aac1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7ab19f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac0b3320 con 0x7f7aac15a220 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7ab19f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac0cf610 con 0x7f7aac0719e0 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7ab19f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac0728d0 con 0x7f7aac0cfa90 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7aac0719e0 0x7f7aac0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaaffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7aac15a220 0x7f7aac0712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44942/0 (socket says 172.21.15.19:44942) 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaaffd640 1 -- 172.21.15.19:0/3665828231 learned_addr learned my addr 172.21.15.19:0/3665828231 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7aac0719e0 0x7f7aac0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49438/0 (socket says 172.21.15.19:49438) 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 -- 172.21.15.19:0/3665828231 >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 msgr2=0x7f7aac1651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aab7fe640 1 --2- 172.21.15.19:0/3665828231 >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 0x7f7aac1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aa9ffb640 1 -- 172.21.15.19:0/3665828231 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549492083 0 0) 0x7f7aac0b3320 con 0x7f7aac15a220 2024-03-04T08:52:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 --2- 172.21.15.19:0/3665828231 >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 0x7f7aac1651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 -- 172.21.15.19:0/3665828231 >> v1:172.21.15.19:6789/0 conn(0x7f7aac15a220 legacy=0x7f7aac0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aaa7fc640 1 -- 172.21.15.19:0/3665828231 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0b3590 con 0x7f7aac0719e0 2024-03-04T08:52:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.637+0000 7f7aab7fe640 1 --2- 172.21.15.19:0/3665828231 >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 0x7f7aac1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.638+0000 7f7aaa7fc640 1 --2- 172.21.15.19:0/3665828231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac0cf0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0aeed0 tx=0x7f7a9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859aef8ae75f721f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.638+0000 7f7aa9ffb640 1 -- 172.21.15.19:0/3665828231 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a940315a0 con 0x7f7aac0719e0 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.638+0000 7f7aa9ffb640 1 -- 172.21.15.19:0/3665828231 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a94037070 con 0x7f7aac0719e0 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.638+0000 7f7aa9ffb640 1 -- 172.21.15.19:0/3665828231 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94031960 con 0x7f7aac0719e0 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3665828231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 msgr2=0x7f7aac0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3665828231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac0cf0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0aeed0 tx=0x7f7a9402b840 comp rx=0 tx=0).stop 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3665828231 shutdown_connections 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3665828231 >> v2:172.21.15.204:3300/0 conn(0x7f7aac0cfa90 0x7f7aac1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3665828231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac0cf0d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3665828231 >> 172.21.15.19:0/3665828231 conn(0x7f7aac06b190 msgr2=0x7f7aac06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3665828231 shutdown_connections 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.639+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3665828231 wait complete. 2024-03-04T08:52:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.640+0000 7f7ab19f7640 1 Processor -- start 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.640+0000 7f7ab19f7640 1 -- start start 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7aac0cfa90 0x7f7aac1f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7aac15a220 0x7f7aac1f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac072530 con 0x7f7aac0719e0 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac072030 con 0x7f7aac15a220 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7ab19f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0726b0 con 0x7f7aac0cfa90 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49442/0 (socket says 172.21.15.19:49442) 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 -- 172.21.15.19:0/3331952128 learned_addr learned my addr 172.21.15.19:0/3331952128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aab7fe640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7aac15a220 0x7f7aac1f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaa7fc640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7aac0cfa90 0x7f7aac1f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 -- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7aac0cfa90 msgr2=0x7f7aac1f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7aac0cfa90 0x7f7aac1f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 -- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7aac15a220 msgr2=0x7f7aac1f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7aac15a220 0x7f7aac1f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.641+0000 7f7aaaffd640 1 -- 172.21.15.19:0/3331952128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac1f49d0 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7aaaffd640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c7f0 tx=0x7f7a9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c018070 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00a640 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac1f4cb0 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00aa30 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.642+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac1f5270 con 0x7f7aac0719e0 2024-03-04T08:52:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.643+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac0732b0 con 0x7f7aac0719e0 2024-03-04T08:52:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.643+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a9c01b070 con 0x7f7aac0719e0 2024-03-04T08:52:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.644+0000 7f7aa3fff640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 0x7f7a8c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.644+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a9c0894c0 con 0x7f7aac0719e0 2024-03-04T08:52:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.644+0000 7f7aaa7fc640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 0x7f7a8c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.644+0000 7f7aaa7fc640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 0x7f7a8c06d9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a94036000 tx=0x7f7a9403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.648+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7a9c058690 con 0x7f7aac0719e0 2024-03-04T08:52:28.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.828+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7aac0ae7f0 con 0x7f7aac0719e0 2024-03-04T08:52:28.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.828+0000 7f7aa3fff640 1 -- 172.21.15.19:0/3331952128 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a9c057f90 con 0x7f7aac0719e0 2024-03-04T08:52:28.825 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 msgr2=0x7f7a8c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 0x7f7a8c06d9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a94036000 tx=0x7f7a9403d040 comp rx=0 tx=0).stop 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 msgr2=0x7f7aac153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c7f0 tx=0x7f7a9c00ccb0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 shutdown_connections 2024-03-04T08:52:28.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7a8c06b500 0x7f7a8c06d9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7aac15a220 0x7f7aac1f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7aac0cfa90 0x7f7aac1f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 --2- 172.21.15.19:0/3331952128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7aac0719e0 0x7f7aac153880 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 >> 172.21.15.19:0/3331952128 conn(0x7f7aac06b190 msgr2=0x7f7aac159330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 shutdown_connections 2024-03-04T08:52:28.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.831+0000 7f7ab19f7640 1 -- 172.21.15.19:0/3331952128 wait complete. 2024-03-04T08:52:28.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T08:52:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.943+0000 7f21327a2640 1 Processor -- start 2024-03-04T08:52:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.943+0000 7f21327a2640 1 -- start start 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.943+0000 7f21327a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 0x7f212c0cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.943+0000 7f21327a2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212c0d0bf0 0x7f212c1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f21327a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0b6ac0 con 0x7f212c0cf6e0 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f21327a2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c0b73f0 con 0x7f212c0d0bf0 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f21327a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b6da0 con 0x7f212c15dd90 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2131fa1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212c0d0bf0 0x7f212c1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2130f9f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f212c0cf6e0 0x7f212c0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44954/0 (socket says 172.21.15.19:44954) 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2130f9f640 1 -- 172.21.15.19:0/2132517374 learned_addr learned my addr 172.21.15.19:0/2132517374 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f21317a0640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 0x7f212c0cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2131fa1640 1 -- 172.21.15.19:0/2132517374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 msgr2=0x7f212c0cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2131fa1640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 0x7f212c0cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2131fa1640 1 -- 172.21.15.19:0/2132517374 >> v1:172.21.15.19:6789/0 conn(0x7f212c0cf6e0 legacy=0x7f212c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2131fa1640 1 -- 172.21.15.19:0/2132517374 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0b7080 con 0x7f212c0d0bf0 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f2123fff640 1 -- 172.21.15.19:0/2132517374 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602618289 0 0) 0x7f212c0b6ac0 con 0x7f212c0cf6e0 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.944+0000 7f21317a0640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 0x7f212c0cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f2131fa1640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1679a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2124009d90 tx=0x7f212402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0be309b09e1d50 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f2123fff640 1 -- 172.21.15.19:0/2132517374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124039070 con 0x7f212c0d0bf0 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f2123fff640 1 -- 172.21.15.19:0/2132517374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212402cc50 con 0x7f212c0d0bf0 2024-03-04T08:52:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f2123fff640 1 -- 172.21.15.19:0/2132517374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124034440 con 0x7f212c0d0bf0 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 -- 172.21.15.19:0/2132517374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 msgr2=0x7f212c1679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1679a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2124009d90 tx=0x7f212402bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 -- 172.21.15.19:0/2132517374 shutdown_connections 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1679a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 --2- 172.21.15.19:0/2132517374 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c15dd90 0x7f212c0cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.945+0000 7f21327a2640 1 -- 172.21.15.19:0/2132517374 >> 172.21.15.19:0/2132517374 conn(0x7f212c09ce30 msgr2=0x7f212c0d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.946+0000 7f21327a2640 1 -- 172.21.15.19:0/2132517374 shutdown_connections 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.946+0000 7f21327a2640 1 -- 172.21.15.19:0/2132517374 wait complete. 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 Processor -- start 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 -- start start 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c0cf6e0 0x7f212c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 0x7f212c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b9890 con 0x7f212c0d0bf0 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c15e170 con 0x7f212c15dd90 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f21327a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b9a10 con 0x7f212c0cf6e0 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.947+0000 7f2130f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49468/0 (socket says 172.21.15.19:49468) 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 -- 172.21.15.19:0/1895863507 learned_addr learned my addr 172.21.15.19:0/1895863507 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2131fa1640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 0x7f212c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f21317a0640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c0cf6e0 0x7f212c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 -- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c0cf6e0 msgr2=0x7f212c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c0cf6e0 0x7f212c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 -- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 msgr2=0x7f212c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 0x7f212c15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 -- 172.21.15.19:0/1895863507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c152490 con 0x7f212c0d0bf0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2131fa1640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 0x7f212c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2130f9f640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c4d0 tx=0x7f211c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c018070 con 0x7f212c0d0bf0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c007500 con 0x7f212c0d0bf0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c004a20 con 0x7f212c0d0bf0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c15fd20 con 0x7f212c0d0bf0 2024-03-04T08:52:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.948+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c1602e0 con 0x7f212c0d0bf0 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.949+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c068f80 con 0x7f212c0d0bf0 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.950+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f211c01b070 con 0x7f212c0d0bf0 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.950+0000 7f2121ffb640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.950+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f211c0891b0 con 0x7f212c0d0bf0 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.950+0000 7f21317a0640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.951+0000 7f21317a0640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 0x7f211006d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f212800a950 tx=0x7f2128008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:28.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:28.954+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f211c058380 con 0x7f212c0d0bf0 2024-03-04T08:52:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.135+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f212c0b8e80 con 0x7f212c0d0bf0 2024-03-04T08:52:29.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.135+0000 7f2121ffb640 1 -- 172.21.15.19:0/1895863507 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+65 (secure 0 0 0) 0x7f211c057c80 con 0x7f212c0d0bf0 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:29.132 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 msgr2=0x7f211006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 0x7f211006d990 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f212800a950 tx=0x7f2128008040 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 msgr2=0x7f212c1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c4d0 tx=0x7f211c00c990 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 shutdown_connections 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f211006b4d0 0x7f211006d990 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212c15dd90 0x7f212c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212c0d0bf0 0x7f212c1f46b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 --2- 172.21.15.19:0/1895863507 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212c0cf6e0 0x7f212c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 >> 172.21.15.19:0/1895863507 conn(0x7f212c09ce30 msgr2=0x7f212c0b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 shutdown_connections 2024-03-04T08:52:29.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.137+0000 7f21327a2640 1 -- 172.21.15.19:0/1895863507 wait complete. 2024-03-04T08:52:29.144 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T08:52:29.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T08:52:29.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.253+0000 7f7df23e9640 1 Processor -- start 2024-03-04T08:52:29.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.253+0000 7f7df23e9640 1 -- start start 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7df23e9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dec0d1d90 0x7f7dec0d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7df23e9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec0cfb30 con 0x7f7dec15dff0 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7df23e9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec0b3320 con 0x7f7dec0d2760 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7df23e9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0b3600 con 0x7f7dec0d1d90 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7deb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dec0d1d90 0x7f7dec0d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7deb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dec0d1d90 0x7f7dec0d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49480/0 (socket says 172.21.15.19:49480) 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7debfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7dec15dff0 0x7f7dec0cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44960/0 (socket says 172.21.15.19:44960) 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.254+0000 7f7deb7fe640 1 -- 172.21.15.19:0/233423455 learned_addr learned my addr 172.21.15.19:0/233423455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.255+0000 7f7deb7fe640 1 -- 172.21.15.19:0/233423455 >> v1:172.21.15.204:6789/0 conn(0x7f7dec0d2760 legacy=0x7f7dec0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.255+0000 7f7deb7fe640 1 -- 172.21.15.19:0/233423455 >> v1:172.21.15.19:6789/0 conn(0x7f7dec15dff0 legacy=0x7f7dec0cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.255+0000 7f7deb7fe640 1 -- 172.21.15.19:0/233423455 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0b38e0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.255+0000 7f7deaffd640 1 -- 172.21.15.19:0/233423455 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891823564 0 0) 0x7f7dec0cfb30 con 0x7f7dec15dff0 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.255+0000 7f7deb7fe640 1 --2- 172.21.15.19:0/233423455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0d2220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009870 tx=0x7f7de002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa844051972860cf server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7deaffd640 1 -- 172.21.15.19:0/233423455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de002f840 con 0x7f7dec0d1d90 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7deaffd640 1 -- 172.21.15.19:0/233423455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de002f9e0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7deaffd640 1 -- 172.21.15.19:0/233423455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de002fdb0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 -- 172.21.15.19:0/233423455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 msgr2=0x7f7dec0d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 --2- 172.21.15.19:0/233423455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0d2220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009870 tx=0x7f7de002ba20 comp rx=0 tx=0).stop 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 -- 172.21.15.19:0/233423455 shutdown_connections 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 --2- 172.21.15.19:0/233423455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0d2220 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 -- 172.21.15.19:0/233423455 >> 172.21.15.19:0/233423455 conn(0x7f7dec0d3d50 msgr2=0x7f7dec0d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 -- 172.21.15.19:0/233423455 shutdown_connections 2024-03-04T08:52:29.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.256+0000 7f7df23e9640 1 -- 172.21.15.19:0/233423455 wait complete. 2024-03-04T08:52:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.257+0000 7f7df23e9640 1 Processor -- start 2024-03-04T08:52:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.257+0000 7f7df23e9640 1 -- start start 2024-03-04T08:52:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dec0d2760 0x7f7dec0b9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dec15dff0 0x7f7dec14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15e550 con 0x7f7dec0d1d90 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15e3d0 con 0x7f7dec15dff0 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df23e9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0b4510 con 0x7f7dec0d2760 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49488/0 (socket says 172.21.15.19:49488) 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 -- 172.21.15.19:0/740191084 learned_addr learned my addr 172.21.15.19:0/740191084 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 -- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dec0d2760 msgr2=0x7f7dec0b9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dec0d2760 0x7f7dec0b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 -- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dec15dff0 msgr2=0x7f7dec14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7df0986640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dec15dff0 0x7f7dec14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.258+0000 7f7debfff640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dec15dff0 0x7f7dec14b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7debfff640 1 -- 172.21.15.19:0/740191084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0cb190 con 0x7f7dec0d1d90 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7debfff640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c430 tx=0x7f7ddc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0074e0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0047e0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec15f780 con 0x7f7dec0d1d90 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc004bd0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.259+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec15fd40 con 0x7f7dec0d1d90 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.260+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec0b6540 con 0x7f7dec0d1d90 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.260+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ddc011070 con 0x7f7dec0d1d90 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.261+0000 7f7de8ff9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.261+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ddc089ae0 con 0x7f7dec0d1d90 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.261+0000 7f7deb7fe640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.261+0000 7f7deb7fe640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 0x7f7dd806d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7de0036000 tx=0x7f7de0039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.265+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7dec0b6540 con 0x7f7dec0d1d90 2024-03-04T08:52:29.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.445+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7dec04f330 con 0x7f7dec0d1d90 2024-03-04T08:52:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.820+0000 7f7de8ff9640 1 -- 172.21.15.19:0/740191084 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7ddc00e280 con 0x7f7dec0d1d90 2024-03-04T08:52:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-03-04T08:52:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 msgr2=0x7f7dd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 0x7f7dd806d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7de0036000 tx=0x7f7de0039040 comp rx=0 tx=0).stop 2024-03-04T08:52:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 msgr2=0x7f7dec0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c430 tx=0x7f7ddc00c8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 shutdown_connections 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7dec15dff0 0x7f7dec14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7dec0d2760 0x7f7dec0b9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 --2- 172.21.15.19:0/740191084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dec0d1d90 0x7f7dec0cdda0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 >> 172.21.15.19:0/740191084 conn(0x7f7dec0d3d50 msgr2=0x7f7dec0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 shutdown_connections 2024-03-04T08:52:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.822+0000 7f7df23e9640 1 -- 172.21.15.19:0/740191084 wait complete. 2024-03-04T08:52:29.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T08:52:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 Processor -- start 2024-03-04T08:52:29.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 -- start start 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd47c0cea50 0x7fd47c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd47c06cab0 0x7fd47c0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c06d030 con 0x7fd47c15def0 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c0cf1c0 con 0x7fd47c06cab0 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd481ab5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c0cc760 con 0x7fd47c0cea50 2024-03-04T08:52:29.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.946+0000 7fd47bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd47c06cab0 0x7fd47c0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd47c06cab0 0x7fd47c0ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49492/0 (socket says 172.21.15.19:49492) 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 -- 172.21.15.19:0/2917211206 learned_addr learned my addr 172.21.15.19:0/2917211206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47affd640 1 --2- 172.21.15.19:0/2917211206 >> v2:172.21.15.204:3300/0 conn(0x7fd47c0cea50 0x7fd47c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 -- 172.21.15.19:0/2917211206 >> v2:172.21.15.204:3300/0 conn(0x7fd47c0cea50 msgr2=0x7fd47c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 --2- 172.21.15.19:0/2917211206 >> v2:172.21.15.204:3300/0 conn(0x7fd47c0cea50 0x7fd47c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 -- 172.21.15.19:0/2917211206 >> v1:172.21.15.204:6789/0 conn(0x7fd47c15def0 legacy=0x7fd47c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.947+0000 7fd47bfff640 1 -- 172.21.15.19:0/2917211206 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c06d310 con 0x7fd47c06cab0 2024-03-04T08:52:29.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd47bfff640 1 --2- 172.21.15.19:0/2917211206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c06cab0 0x7fd47c0ccbf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0b3660 tx=0x7fd47402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e3bfecdf0e26cd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd47a7fc640 1 -- 172.21.15.19:0/2917211206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47402cb20 con 0x7fd47c06cab0 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd47a7fc640 1 -- 172.21.15.19:0/2917211206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47402ccc0 con 0x7fd47c06cab0 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd47a7fc640 1 -- 172.21.15.19:0/2917211206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474034610 con 0x7fd47c06cab0 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 -- 172.21.15.19:0/2917211206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c06cab0 msgr2=0x7fd47c0ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2917211206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c06cab0 0x7fd47c0ccbf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0b3660 tx=0x7fd47402bf80 comp rx=0 tx=0).stop 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 -- 172.21.15.19:0/2917211206 shutdown_connections 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2917211206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c06cab0 0x7fd47c0ccbf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2917211206 >> v2:172.21.15.204:3300/0 conn(0x7fd47c0cea50 0x7fd47c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 -- 172.21.15.19:0/2917211206 >> 172.21.15.19:0/2917211206 conn(0x7fd47c0b3690 msgr2=0x7fd47c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 -- 172.21.15.19:0/2917211206 shutdown_connections 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.948+0000 7fd481ab5640 1 -- 172.21.15.19:0/2917211206 wait complete. 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 Processor -- start 2024-03-04T08:52:29.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 -- start start 2024-03-04T08:52:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 0x7fd47c09d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 0x7fd47c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c15e2d0 con 0x7fd47c0cea50 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0cc3f0 con 0x7fd47c15def0 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.950+0000 7fd481ab5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c15e450 con 0x7fd47c06cab0 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49502/0 (socket says 172.21.15.19:49502) 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 -- 172.21.15.19:0/2000067901 learned_addr learned my addr 172.21.15.19:0/2000067901 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47bfff640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 0x7fd47c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47b7fe640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 0x7fd47c09d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 -- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 msgr2=0x7fd47c09d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 0x7fd47c09d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 -- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 msgr2=0x7fd47c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 0x7fd47c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 -- 172.21.15.19:0/2000067901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c09d8e0 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47bfff640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 0x7fd47c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47b7fe640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 0x7fd47c09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd47affd640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e9b0 tx=0x7fd47000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470017070 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47000c9a0 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47000cd90 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c09dbc0 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.951+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c09e180 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.952+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c09fcf0 con 0x7fd47c0cea50 2024-03-04T08:52:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.953+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd47001a070 con 0x7fd47c0cea50 2024-03-04T08:52:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.953+0000 7fd463fff640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 0x7fd46806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.953+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd47008a320 con 0x7fd47c0cea50 2024-03-04T08:52:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.953+0000 7fd47b7fe640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 0x7fd46806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:29.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.954+0000 7fd47b7fe640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 0x7fd46806d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0015e0 tx=0x7fd46c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:29.957+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd470059410 con 0x7fd47c0cea50 2024-03-04T08:52:30.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.138+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd47c068ff0 con 0x7fd47c0cea50 2024-03-04T08:52:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.822+0000 7fd463fff640 1 -- 172.21.15.19:0/2000067901 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd470058d10 con 0x7fd47c0cea50 2024-03-04T08:52:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.827+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 msgr2=0x7fd46806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.827+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 0x7fd46806d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0015e0 tx=0x7fd46c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.827+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 msgr2=0x7fd47c09e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.827+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e9b0 tx=0x7fd47000ee70 comp rx=0 tx=0).stop 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 shutdown_connections 2024-03-04T08:52:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd46806b4d0 0x7fd46806d990 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0015e0 tx=0x7fd46c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd47c15def0 0x7fd47c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd47c0cea50 0x7fd47c09e980 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 --2- 172.21.15.19:0/2000067901 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd47c06cab0 0x7fd47c09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.828+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 >> 172.21.15.19:0/2000067901 conn(0x7fd47c0b3690 msgr2=0x7fd47c0b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.829+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 shutdown_connections 2024-03-04T08:52:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.829+0000 7fd481ab5640 1 -- 172.21.15.19:0/2000067901 wait complete. 2024-03-04T08:52:30.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T08:52:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.961+0000 7f473671e640 1 Processor -- start 2024-03-04T08:52:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.961+0000 7f473671e640 1 -- start start 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f473671e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f473015e270 0x7f47300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f473671e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47300b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f473671e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473006b050 con 0x7f4730066d00 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f473671e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473015e650 con 0x7f473015e270 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f473671e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300afdf0 con 0x7f47300b5f80 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f4734cbb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4730066d00 0x7f47300cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44962/0 (socket says 172.21.15.19:44962) 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f4734cbb640 1 -- 172.21.15.19:0/2456669060 learned_addr learned my addr 172.21.15.19:0/2456669060 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472f7fe640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47300b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472ffff640 1 --2- 172.21.15.19:0/2456669060 >> v2:172.21.15.204:3300/0 conn(0x7f473015e270 0x7f47300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677285753 0 0) 0x7f473006b050 con 0x7f4730066d00 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4718003520 con 0x7f4730066d00 2024-03-04T08:52:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 435320129 0 0) 0x7f4718003520 con 0x7f4730066d00 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 msgr2=0x7f47300b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47300b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 >> v2:172.21.15.204:3300/0 conn(0x7f473015e270 msgr2=0x7f47300b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 --2- 172.21.15.19:0/2456669060 >> v2:172.21.15.204:3300/0 conn(0x7f473015e270 0x7f47300b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473006b330 con 0x7f4730066d00 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f47280019f0 con 0x7f4730066d00 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 >> v1:172.21.15.19:6789/0 conn(0x7f4730066d00 legacy=0x7f47300cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4718003f30 0x7f4718004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718004d40 0x7f47180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471800b9c0 con 0x7f4718004d40 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471800bb40 con 0x7f4718003f30 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.962+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471800bcc0 con 0x7f47300b5f80 2024-03-04T08:52:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f4734cbb640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718004d40 0x7f47180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472f7fe640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4718003f30 0x7f4718004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 -- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4718003f30 msgr2=0x7f4718004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4718003f30 0x7f4718004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 -- 172.21.15.19:0/2456669060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718004d40 msgr2=0x7f47180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718004d40 0x7f47180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f472ffff640 1 -- 172.21.15.19:0/2456669060 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718003520 con 0x7f47300b5f80 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.963+0000 7f4734cbb640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4718004d40 0x7f47180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f472ffff640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47180039b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4724009ac0 tx=0x7f4718005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407ef2031a8ac69f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724039070 con 0x7f47300b5f80 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472402c710 con 0x7f47300b5f80 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f472effd640 1 -- 172.21.15.19:0/2456669060 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724009690 con 0x7f47300b5f80 2024-03-04T08:52:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 -- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 msgr2=0x7f47180039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 --2- 172.21.15.19:0/2456669060 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f47300b5f80 0x7f47180039b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4724009ac0 tx=0x7f4718005830 comp rx=0 tx=0).stop 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f4734cbb640 1 -- 172.21.15.19:0/2456669060 reap_dead start 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 -- 172.21.15.19:0/2456669060 shutdown_connections 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 -- 172.21.15.19:0/2456669060 >> 172.21.15.19:0/2456669060 conn(0x7f47300725d0 msgr2=0x7f47300729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 -- 172.21.15.19:0/2456669060 shutdown_connections 2024-03-04T08:52:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.964+0000 7f473671e640 1 -- 172.21.15.19:0/2456669060 wait complete. 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.966+0000 7f473671e640 1 Processor -- start 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.966+0000 7f473671e640 1 -- start start 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f473015b6a0 0x7f4730152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47300c97c0 0x7f47300c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b0c70 con 0x7f47300b5f80 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b0990 con 0x7f47300c97c0 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b1100 con 0x7f473015b6a0 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49520/0 (socket says 172.21.15.19:49520) 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 -- 172.21.15.19:0/2258758081 learned_addr learned my addr 172.21.15.19:0/2258758081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f4734cbb640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47300c97c0 0x7f47300c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472f7fe640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f473015b6a0 0x7f4730152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 -- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f473015b6a0 msgr2=0x7f4730152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f473015b6a0 0x7f4730152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 -- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47300c97c0 msgr2=0x7f47300c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47300c97c0 0x7f47300c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 -- 172.21.15.19:0/2258758081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4730161780 con 0x7f47300b5f80 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472ffff640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4724000c00 tx=0x7f4724004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724039050 con 0x7f47300b5f80 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724045070 con 0x7f47300b5f80 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300c8720 con 0x7f47300b5f80 2024-03-04T08:52:30.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47240044e0 con 0x7f47300b5f80 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.967+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47300c8ce0 con 0x7f47300b5f80 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.968+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473004f330 con 0x7f47300b5f80 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.969+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4724003a50 con 0x7f47300b5f80 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.969+0000 7f472cff9640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 0x7f471c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.970+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f47240ac2a0 con 0x7f47300b5f80 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.970+0000 7f472f7fe640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 0x7f471c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:30.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.970+0000 7f472f7fe640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 0x7f471c06d9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47300b2eb0 tx=0x7f4720008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:30.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:30.974+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f472407b180 con 0x7f47300b5f80 2024-03-04T08:52:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.191+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47300d1070 con 0x7f47300b5f80 2024-03-04T08:52:31.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.852+0000 7f472cff9640 1 -- 172.21.15.19:0/2258758081 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f472407aa80 con 0x7f47300b5f80 2024-03-04T08:52:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 7 and data pool 8 2024-03-04T08:52:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.860+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 msgr2=0x7f471c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.860+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 0x7f471c06d9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47300b2eb0 tx=0x7f4720008040 comp rx=0 tx=0).stop 2024-03-04T08:52:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.860+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 msgr2=0x7f473015e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.860+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4724000c00 tx=0x7f4724004730 comp rx=0 tx=0).stop 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 shutdown_connections 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f471c06b500 0x7f471c06d9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f47300c97c0 0x7f47300c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f473015b6a0 0x7f4730152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 --2- 172.21.15.19:0/2258758081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47300b5f80 0x7f473015e650 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.861+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 >> 172.21.15.19:0/2258758081 conn(0x7f47300725d0 msgr2=0x7f47300c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.865+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 shutdown_connections 2024-03-04T08:52:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.865+0000 7f473671e640 1 -- 172.21.15.19:0/2258758081 wait complete. 2024-03-04T08:52:31.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:31.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 Processor -- start 2024-03-04T08:52:31.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 -- start start 2024-03-04T08:52:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc44c06c6d0 0x7fc44c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c066d90 0x7fc44c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c0cd450 con 0x7fc44c0b4f70 2024-03-04T08:52:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44c15e9f0 con 0x7fc44c06c6d0 2024-03-04T08:52:31.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.985+0000 7fc451039640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0cda10 con 0x7fc44c066d90 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc44c06c6d0 0x7fc44c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc44c06c6d0 0x7fc44c15ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49532/0 (socket says 172.21.15.19:49532) 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 -- 172.21.15.19:0/3962979985 learned_addr learned my addr 172.21.15.19:0/3962979985 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc44b59e640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c066d90 0x7fc44c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 -- 172.21.15.19:0/3962979985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c066d90 msgr2=0x7fc44c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c066d90 0x7fc44c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 -- 172.21.15.19:0/3962979985 >> v1:172.21.15.204:6789/0 conn(0x7fc44c0b4f70 legacy=0x7fc44c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.986+0000 7fc443fff640 1 -- 172.21.15.19:0/3962979985 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0cd730 con 0x7fc44c06c6d0 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc443fff640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c06c6d0 0x7fc44c15ee80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbefb9a89f5045e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc44a59c640 1 -- 172.21.15.19:0/3962979985 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434034070 con 0x7fc44c06c6d0 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc44a59c640 1 -- 172.21.15.19:0/3962979985 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc434030840 con 0x7fc44c06c6d0 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc44a59c640 1 -- 172.21.15.19:0/3962979985 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434030c10 con 0x7fc44c06c6d0 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 -- 172.21.15.19:0/3962979985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c06c6d0 msgr2=0x7fc44c15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c06c6d0 0x7fc44c15ee80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402b980 comp rx=0 tx=0).stop 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 -- 172.21.15.19:0/3962979985 shutdown_connections 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c066d90 0x7fc44c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 --2- 172.21.15.19:0/3962979985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c06c6d0 0x7fc44c15ee80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 -- 172.21.15.19:0/3962979985 >> 172.21.15.19:0/3962979985 conn(0x7fc44c0724d0 msgr2=0x7fc44c0728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.987+0000 7fc451039640 1 -- 172.21.15.19:0/3962979985 shutdown_connections 2024-03-04T08:52:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.988+0000 7fc451039640 1 -- 172.21.15.19:0/3962979985 wait complete. 2024-03-04T08:52:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 Processor -- start 2024-03-04T08:52:31.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 -- start start 2024-03-04T08:52:31.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc44c066d90 0x7fc44c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c0b4f70 0x7fc44c0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0cd090 con 0x7fc44c0adf30 2024-03-04T08:52:31.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c15f3c0 con 0x7fc44c066d90 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.989+0000 7fc451039640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0cd210 con 0x7fc44c0b4f70 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49536/0 (socket says 172.21.15.19:49536) 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 -- 172.21.15.19:0/229210384 learned_addr learned my addr 172.21.15.19:0/229210384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44ad9d640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc44c066d90 0x7fc44c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc443fff640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c0b4f70 0x7fc44c0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 -- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c0b4f70 msgr2=0x7fc44c0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c0b4f70 0x7fc44c0ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 -- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc44c066d90 msgr2=0x7fc44c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc44c066d90 0x7fc44c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 -- 172.21.15.19:0/229210384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0ae4b0 con 0x7fc44c0adf30 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc44b59e640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc44400efc0 tx=0x7fc44400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444018020 con 0x7fc44c0adf30 2024-03-04T08:52:31.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444014480 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444014870 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c0ae790 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.990+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c0aed50 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.991+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c04f330 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.992+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc444005d10 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.992+0000 7fc4437fe640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 0x7fc42c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.992+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc44408af10 con 0x7fc44c0adf30 2024-03-04T08:52:31.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.992+0000 7fc44ad9d640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 0x7fc42c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:31.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.993+0000 7fc44ad9d640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 0x7fc42c06d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc44c1560e0 tx=0x7fc43c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:31.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:31.997+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc444022030 con 0x7fc44c0adf30 2024-03-04T08:52:32.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.182+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc44c0b1860 con 0x7fc44c0adf30 2024-03-04T08:52:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.183+0000 7fc4437fe640 1 -- 172.21.15.19:0/229210384 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16670 (secure 0 0 0) 0x7fc444010040 con 0x7fc44c0adf30 2024-03-04T08:52:32.179 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:32.180 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":48,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:31.192822+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 msgr2=0x7fc42c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 0x7fc42c06d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc44c1560e0 tx=0x7fc43c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 msgr2=0x7fc44c0cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc44400efc0 tx=0x7fc44400c490 comp rx=0 tx=0).stop 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 shutdown_connections 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc44c0adf30 0x7fc44c0cb8f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc44c0b4f70 0x7fc44c0ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc42c06b500 0x7fc42c06d9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 --2- 172.21.15.19:0/229210384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc44c066d90 0x7fc44c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 >> 172.21.15.19:0/229210384 conn(0x7fc44c0724d0 msgr2=0x7fc44c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 shutdown_connections 2024-03-04T08:52:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.185+0000 7fc451039640 1 -- 172.21.15.19:0/229210384 wait complete. 2024-03-04T08:52:32.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:32.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.297+0000 7f505f955640 1 Processor -- start 2024-03-04T08:52:32.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.297+0000 7f505f955640 1 -- start start 2024-03-04T08:52:32.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505f955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f50580d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505f955640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580d09e0 con 0x7f505806cf20 2024-03-04T08:52:32.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505f955640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505815e380 con 0x7f50580cf850 2024-03-04T08:52:32.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505f955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505806ca90 con 0x7f50580d00c0 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505def2640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f505806cf20 0x7f505806d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44978/0 (socket says 172.21.15.19:44978) 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505def2640 1 -- 172.21.15.19:0/1412735780 learned_addr learned my addr 172.21.15.19:0/1412735780 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923344759 0 0) 0x7f50580d09e0 con 0x7f505806cf20 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5044003520 con 0x7f505806cf20 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.298+0000 7f505d6f1640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f50580d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412195491 0 0) 0x7f5044003520 con 0x7f505806cf20 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 msgr2=0x7f50580d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f50580d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 >> v1:172.21.15.204:6789/0 conn(0x7f50580cf850 legacy=0x7f50580cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580cdc10 con 0x7f505806cf20 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f50540019f0 con 0x7f505806cf20 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 >> v1:172.21.15.19:6789/0 conn(0x7f505806cf20 legacy=0x7f505806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50440039e0 0x7f5044003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f5044004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5044004d40 0x7f50440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505806ca90 con 0x7f5044004d40 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504400ba70 con 0x7f50440039e0 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504400bc70 con 0x7f50580d00c0 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5044004d40 0x7f50440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505d6f1640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50440039e0 0x7f5044003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505cef0640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f5044004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 -- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 msgr2=0x7f5044004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50580d00c0 0x7f5044004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 -- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50440039e0 msgr2=0x7f5044003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50440039e0 0x7f5044003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.299+0000 7f505def2640 1 -- 172.21.15.19:0/1412735780 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044003520 con 0x7f5044004d40 2024-03-04T08:52:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f505def2640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5044004d40 0x7f50440051c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5054002230 tx=0x7f5044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b5fdba5b72d5eb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400a4a0 con 0x7f5044004d40 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5054034650 con 0x7f5044004d40 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f504ffff640 1 -- 172.21.15.19:0/1412735780 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054034a40 con 0x7f5044004d40 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f505f955640 1 -- 172.21.15.19:0/1412735780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5044004d40 msgr2=0x7f50440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f505f955640 1 --2- 172.21.15.19:0/1412735780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5044004d40 0x7f50440051c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5054002230 tx=0x7f5044005830 comp rx=0 tx=0).stop 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.300+0000 7f505def2640 1 -- 172.21.15.19:0/1412735780 reap_dead start 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.301+0000 7f505f955640 1 -- 172.21.15.19:0/1412735780 shutdown_connections 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.301+0000 7f505f955640 1 -- 172.21.15.19:0/1412735780 >> 172.21.15.19:0/1412735780 conn(0x7f50580b35a0 msgr2=0x7f50580b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.301+0000 7f505f955640 1 -- 172.21.15.19:0/1412735780 shutdown_connections 2024-03-04T08:52:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.301+0000 7f505f955640 1 -- 172.21.15.19:0/1412735780 wait complete. 2024-03-04T08:52:32.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 Processor -- start 2024-03-04T08:52:32.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 -- start start 2024-03-04T08:52:32.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 0x7f50581f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 0x7f50580b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505806c720 con 0x7f50580c69c0 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.302+0000 7f505f955640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505806c440 con 0x7f50580b29b0 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505f955640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50580b1030 con 0x7f5044004d40 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49562/0 (socket says 172.21.15.19:49562) 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 -- 172.21.15.19:0/4030619502 learned_addr learned my addr 172.21.15.19:0/4030619502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505d6f1640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 0x7f50581f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505cef0640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 0x7f50580b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 -- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 msgr2=0x7f50581f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 0x7f50581f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 -- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 msgr2=0x7f50580b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 0x7f50580b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 -- 172.21.15.19:0/4030619502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580c8890 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505d6f1640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 0x7f50581f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505cef0640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 0x7f50580b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505def2640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f505402cc40 tx=0x7f5054001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400a480 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5054044070 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50580c77f0 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.303+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054034800 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.304+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50580c7db0 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.305+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50580b3370 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.305+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f50540349a0 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.305+0000 7f504dffb640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 0x7f503c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.305+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50540ac540 con 0x7f50580c69c0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.306+0000 7f505d6f1640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 0x7f503c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.306+0000 7f505d6f1640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 0x7f503c06d9c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5050009bc0 tx=0x7f5050008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.310+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f505407b330 con 0x7f50580c69c0 2024-03-04T08:52:32.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.493+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50580d0d90 con 0x7f50580c69c0 2024-03-04T08:52:32.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.494+0000 7f504dffb640 1 -- 172.21.15.19:0/4030619502 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16670 (secure 0 0 0) 0x7f505407ac30 con 0x7f50580c69c0 2024-03-04T08:52:32.491 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:32.491 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":48,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:31.192822+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 msgr2=0x7f503c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 0x7f503c06d9c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5050009bc0 tx=0x7f5050008040 comp rx=0 tx=0).stop 2024-03-04T08:52:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 msgr2=0x7f50580c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f505402cc40 tx=0x7f5054001dc0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 shutdown_connections 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50580c69c0 0x7f50580c6e40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f503c06b500 0x7f503c06d9c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50580b29b0 0x7f50580b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 --2- 172.21.15.19:0/4030619502 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5044004d40 0x7f50581f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 >> 172.21.15.19:0/4030619502 conn(0x7f50580b35a0 msgr2=0x7f505806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 shutdown_connections 2024-03-04T08:52:32.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.496+0000 7f505f955640 1 -- 172.21.15.19:0/4030619502 wait complete. 2024-03-04T08:52:32.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T08:52:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.612+0000 7f90f317a640 1 Processor -- start 2024-03-04T08:52:32.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.612+0000 7f90f317a640 1 -- start start 2024-03-04T08:52:32.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f317a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 0x7f90ec0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f317a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec06d030 con 0x7f90ec0cea50 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f317a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec06d310 con 0x7f90ec06cab0 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f317a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0cf1c0 con 0x7f90ec15def0 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f1717640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f90ec0cea50 0x7f90ec0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44980/0 (socket says 172.21.15.19:44980) 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f1717640 1 -- 172.21.15.19:0/732557224 learned_addr learned my addr 172.21.15.19:0/732557224 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f0f16640 1 --2- 172.21.15.19:0/732557224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 0x7f90ec0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716933224 0 0) 0x7f90ec06d030 con 0x7f90ec0cea50 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90dc003520 con 0x7f90ec0cea50 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f0f16640 1 -- 172.21.15.19:0/732557224 >> v1:172.21.15.204:6789/0 conn(0x7f90ec06cab0 legacy=0x7f90ec0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f0f16640 1 -- 172.21.15.19:0/732557224 >> v1:172.21.15.19:6789/0 conn(0x7f90ec0cea50 legacy=0x7f90ec0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526355737 0 0) 0x7f90ec06d310 con 0x7f90ec06cab0 2024-03-04T08:52:32.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.613+0000 7f90f0f16640 1 -- 172.21.15.19:0/732557224 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0cc110 con 0x7f90ec15def0 2024-03-04T08:52:32.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.614+0000 7f90f0f16640 1 --2- 172.21.15.19:0/732557224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 0x7f90ec0b41b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90e00097d0 tx=0x7f90e002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5b4b3c7de7298f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.614+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0034070 con 0x7f90ec15def0 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.614+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0030880 con 0x7f90ec15def0 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.614+0000 7f90eb7fe640 1 -- 172.21.15.19:0/732557224 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0030c30 con 0x7f90ec15def0 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 -- 172.21.15.19:0/732557224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 msgr2=0x7f90ec0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 --2- 172.21.15.19:0/732557224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 0x7f90ec0b41b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90e00097d0 tx=0x7f90e002b9c0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 -- 172.21.15.19:0/732557224 shutdown_connections 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 --2- 172.21.15.19:0/732557224 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec15def0 0x7f90ec0b41b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 -- 172.21.15.19:0/732557224 >> 172.21.15.19:0/732557224 conn(0x7f90ec0b3690 msgr2=0x7f90ec0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 -- 172.21.15.19:0/732557224 shutdown_connections 2024-03-04T08:52:32.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.615+0000 7f90f317a640 1 -- 172.21.15.19:0/732557224 wait complete. 2024-03-04T08:52:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.616+0000 7f90f317a640 1 Processor -- start 2024-03-04T08:52:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.616+0000 7f90f317a640 1 -- start start 2024-03-04T08:52:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90ec06cab0 0x7f90ec159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec0cea50 0x7f90ec0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15e2d0 con 0x7f90ec15def0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0cc760 con 0x7f90ec06cab0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f317a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15e450 con 0x7f90ec0cea50 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49574/0 (socket says 172.21.15.19:49574) 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 -- 172.21.15.19:0/3770140515 learned_addr learned my addr 172.21.15.19:0/3770140515 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 -- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec0cea50 msgr2=0x7f90ec0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec0cea50 0x7f90ec0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 -- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90ec06cab0 msgr2=0x7f90ec159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90ec06cab0 0x7f90ec159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.617+0000 7f90f1717640 1 -- 172.21.15.19:0/3770140515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0c7040 con 0x7f90ec15def0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90f1717640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f90e400cae0 tx=0x7f90e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4017070 con 0x7f90ec15def0 2024-03-04T08:52:32.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400ac40 con 0x7f90ec15def0 2024-03-04T08:52:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4012640 con 0x7f90ec15def0 2024-03-04T08:52:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0c7320 con 0x7f90ec15def0 2024-03-04T08:52:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.618+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0c78e0 con 0x7f90ec15def0 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.619+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec15e740 con 0x7f90ec15def0 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.619+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90e401a070 con 0x7f90ec15def0 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.619+0000 7f90e97fa640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 0x7f90d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.620+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e4089f80 con 0x7f90ec15def0 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.620+0000 7f90f0f16640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 0x7f90d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.620+0000 7f90f0f16640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 0x7f90d006d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90e0036000 tx=0x7f90e0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:32.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.624+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f90ec15e740 con 0x7f90ec15def0 2024-03-04T08:52:32.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:32.844+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f90ec09fcf0 con 0x7f90ec15def0 2024-03-04T08:52:33.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.846+0000 7f90e97fa640 1 -- 172.21.15.19:0/3770140515 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f90e4058e90 con 0x7f90ec15def0 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 msgr2=0x7f90d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 0x7f90d006d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90e0036000 tx=0x7f90e0030000 comp rx=0 tx=0).stop 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 msgr2=0x7f90ec0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f90e400cae0 tx=0x7f90e400a060 comp rx=0 tx=0).stop 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 shutdown_connections 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ec15def0 0x7f90ec0c7e60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f90ec0cea50 0x7f90ec0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f90d006b4d0 0x7f90d006d990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 --2- 172.21.15.19:0/3770140515 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f90ec06cab0 0x7f90ec159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 >> 172.21.15.19:0/3770140515 conn(0x7f90ec0b3690 msgr2=0x7f90ec06f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:33.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 shutdown_connections 2024-03-04T08:52:33.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.849+0000 7f90f317a640 1 -- 172.21.15.19:0/3770140515 wait complete. 2024-03-04T08:52:33.857 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-04T08:52:33.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-04T08:52:33.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.969+0000 7f0e5ff5e640 1 Processor -- start 2024-03-04T08:52:33.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.970+0000 7f0e5ff5e640 1 -- start start 2024-03-04T08:52:33.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ff5e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0e580d10c0 0x7f0e580d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ff5e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580cfa50 con 0x7f0e5815ecd0 2024-03-04T08:52:33.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ff5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580d0a30 con 0x7f0e580d14a0 2024-03-04T08:52:33.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ff5e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5815c050 con 0x7f0e580d10c0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5e4fb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0e5815ecd0 0x7f0e580cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44984/0 (socket says 172.21.15.19:44984) 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5e4fb640 1 -- 172.21.15.19:0/98780807 learned_addr learned my addr 172.21.15.19:0/98780807 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/98780807 >> v2:172.21.15.204:3300/0 conn(0x7f0e580d10c0 0x7f0e580d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625259700 0 0) 0x7f0e580cfa50 con 0x7f0e5815ecd0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003520 con 0x7f0e5815ecd0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648812246 0 0) 0x7f0e44003520 con 0x7f0e5815ecd0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.971+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 >> v2:172.21.15.204:3300/0 conn(0x7f0e580d10c0 msgr2=0x7f0e580d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 --2- 172.21.15.19:0/98780807 >> v2:172.21.15.204:3300/0 conn(0x7f0e580d10c0 0x7f0e580d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 >> v1:172.21.15.204:6789/0 conn(0x7f0e580d14a0 legacy=0x7f0e5815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580b45c0 con 0x7f0e5815ecd0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f0e500019f0 con 0x7f0e5815ecd0 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 >> v1:172.21.15.19:6789/0 conn(0x7f0e5815ecd0 legacy=0x7f0e580cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e440039b0 0x7f0e44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 0x7f0e44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e440051c0 0x7f0e4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400c030 con 0x7f0e44004800 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400c1e0 con 0x7f0e440039b0 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400c3e0 con 0x7f0e440051c0 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 0x7f0e44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e440039b0 0x7f0e44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5e4fb640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e440051c0 0x7f0e4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e440051c0 msgr2=0x7f0e4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e440051c0 0x7f0e4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e440039b0 msgr2=0x7f0e44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e440039b0 0x7f0e44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/98780807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44003520 con 0x7f0e44004800 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5e4fb640 1 -- 172.21.15.19:0/98780807 reap_dead start 2024-03-04T08:52:33.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.972+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e440039b0 0x7f0e44003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 0x7f0e44004c80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0e48001750 tx=0x7f0e44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa054f8afd770da server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48001370 con 0x7f0e44004800 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480052d0 con 0x7f0e44004800 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5ccf8640 1 -- 172.21.15.19:0/98780807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48003830 con 0x7f0e44004800 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 msgr2=0x7f0e44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.973+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 0x7f0e44004c80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0e48001750 tx=0x7f0e44005830 comp rx=0 tx=0).stop 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.974+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/98780807 shutdown_connections 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.974+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/98780807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e44004800 0x7f0e44004c80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.974+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/98780807 >> 172.21.15.19:0/98780807 conn(0x7f0e580b3800 msgr2=0x7f0e580b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.974+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/98780807 shutdown_connections 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.974+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/98780807 wait complete. 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.975+0000 7f0e5ff5e640 1 Processor -- start 2024-03-04T08:52:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.975+0000 7f0e5ff5e640 1 -- start start 2024-03-04T08:52:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e44004800 0x7f0e581f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 0x7f0e580ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5815f440 con 0x7f0e581517f0 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580d0060 con 0x7f0e44004800 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580cfcf0 con 0x7f0e580b0610 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49584/0 (socket says 172.21.15.19:49584) 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/2026939330 learned_addr learned my addr 172.21.15.19:0/2026939330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e44004800 0x7f0e581f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5e4fb640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 0x7f0e580ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 msgr2=0x7f0e580ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 0x7f0e580ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e44004800 msgr2=0x7f0e581f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e44004800 0x7f0e581f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 -- 172.21.15.19:0/2026939330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580b5aa0 con 0x7f0e581517f0 2024-03-04T08:52:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5e4fb640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 0x7f0e580ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5d4f9640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005040 tx=0x7f0e48001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48041020 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48005480 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580b5d80 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48007a30 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.976+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580b6340 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.977+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5809fe60 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.978+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e48044020 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.978+0000 7f0e4e7fc640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 0x7f0e3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.978+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e480abb30 con 0x7f0e581517f0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.978+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 0x7f0e3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:33.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.979+0000 7f0e5dcfa640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 0x7f0e3c06d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e580686a0 tx=0x7f0e54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:33.983+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0e4804b030 con 0x7f0e581517f0 2024-03-04T08:52:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.200+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e580b09f0 con 0x7f0e581517f0 2024-03-04T08:52:34.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.862+0000 7f0e4e7fc640 1 -- 172.21.15.19:0/2026939330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e48006e20 con 0x7f0e581517f0 2024-03-04T08:52:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 msgr2=0x7f0e3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 0x7f0e3c06d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e580686a0 tx=0x7f0e54008040 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 msgr2=0x7f0e580b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005040 tx=0x7f0e48001120 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 shutdown_connections 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0e580b0610 0x7f0e580ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e581517f0 0x7f0e580b00d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0e3c06b4d0 0x7f0e3c06d990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 --2- 172.21.15.19:0/2026939330 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0e44004800 0x7f0e581f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 >> 172.21.15.19:0/2026939330 conn(0x7f0e580b3800 msgr2=0x7f0e581607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 shutdown_connections 2024-03-04T08:52:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.864+0000 7f0e5ff5e640 1 -- 172.21.15.19:0/2026939330 wait complete. 2024-03-04T08:52:34.871 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-04T08:52:34.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.976+0000 7f16ed78c640 1 Processor -- start 2024-03-04T08:52:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.976+0000 7f16ed78c640 1 -- start start 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16ed78c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16e815ddf0 0x7f16e80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16ed78c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e80d0de0 0x7f16e80cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16ed78c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80d18d0 con 0x7f16e815e1d0 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16ed78c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80d27c0 con 0x7f16e815ddf0 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16ed78c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80b7b60 con 0x7f16e80d0de0 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16e815ddf0 0x7f16e80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16e815ddf0 0x7f16e80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49596/0 (socket says 172.21.15.19:49596) 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16dffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f16e815e1d0 0x7f16e80d06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44990/0 (socket says 172.21.15.19:44990) 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 -- 172.21.15.19:0/850805947 learned_addr learned my addr 172.21.15.19:0/850805947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 -- 172.21.15.19:0/850805947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e80d0de0 msgr2=0x7f16e80cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 --2- 172.21.15.19:0/850805947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e80d0de0 0x7f16e80cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 -- 172.21.15.19:0/850805947 >> v1:172.21.15.19:6789/0 conn(0x7f16e815e1d0 legacy=0x7f16e80d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e67fc640 1 -- 172.21.15.19:0/850805947 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944661739 0 0) 0x7f16e80d18d0 con 0x7f16e815e1d0 2024-03-04T08:52:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.977+0000 7f16e6ffd640 1 -- 172.21.15.19:0/850805947 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80d1bb0 con 0x7f16e815ddf0 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.978+0000 7f16e6ffd640 1 --2- 172.21.15.19:0/850805947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815ddf0 0x7f16e80cf440 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009870 tx=0x7f16d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3fa0a38f99d004 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.978+0000 7f16e67fc640 1 -- 172.21.15.19:0/850805947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8034070 con 0x7f16e815ddf0 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.978+0000 7f16e67fc640 1 -- 172.21.15.19:0/850805947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8030860 con 0x7f16e815ddf0 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.978+0000 7f16e67fc640 1 -- 172.21.15.19:0/850805947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8030c30 con 0x7f16e815ddf0 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 -- 172.21.15.19:0/850805947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815ddf0 msgr2=0x7f16e80cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 --2- 172.21.15.19:0/850805947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815ddf0 0x7f16e80cf440 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009870 tx=0x7f16d802b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 -- 172.21.15.19:0/850805947 shutdown_connections 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 --2- 172.21.15.19:0/850805947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e80d0de0 0x7f16e80cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 --2- 172.21.15.19:0/850805947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815ddf0 0x7f16e80cf440 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 -- 172.21.15.19:0/850805947 >> 172.21.15.19:0/850805947 conn(0x7f16e809cff0 msgr2=0x7f16e80d3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 -- 172.21.15.19:0/850805947 shutdown_connections 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.979+0000 7f16ed78c640 1 -- 172.21.15.19:0/850805947 wait complete. 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.981+0000 7f16ed78c640 1 Processor -- start 2024-03-04T08:52:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.981+0000 7f16ed78c640 1 -- start start 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16e80d0de0 0x7f16e81f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e815ddf0 0x7f16e80c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80d2450 con 0x7f16e815e1d0 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80d2170 con 0x7f16e80d0de0 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16ed78c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80d2c50 con 0x7f16e815ddf0 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.982+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49606/0 (socket says 172.21.15.19:49606) 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 -- 172.21.15.19:0/2073451096 learned_addr learned my addr 172.21.15.19:0/2073451096 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16dffff640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e815ddf0 0x7f16e80c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e6ffd640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16e80d0de0 0x7f16e81f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 -- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e815ddf0 msgr2=0x7f16e80c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e815ddf0 0x7f16e80c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 -- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16e80d0de0 msgr2=0x7f16e81f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16e80d0de0 0x7f16e81f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 -- 172.21.15.19:0/2073451096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e815f4e0 con 0x7f16e815e1d0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16e77fe640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16e000ba10 tx=0x7f16e000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0019070 con 0x7f16e815e1d0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000cb20 con 0x7f16e815e1d0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e815f7c0 con 0x7f16e815e1d0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0014440 con 0x7f16e815e1d0 2024-03-04T08:52:34.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.983+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e815fd80 con 0x7f16e815e1d0 2024-03-04T08:52:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.984+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e804f330 con 0x7f16e815e1d0 2024-03-04T08:52:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.985+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f16e001c070 con 0x7f16e815e1d0 2024-03-04T08:52:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.985+0000 7f16df7fe640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.985+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e0089d50 con 0x7f16e815e1d0 2024-03-04T08:52:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.985+0000 7f16e6ffd640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.986+0000 7f16e6ffd640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 0x7f16c806d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16d8036000 tx=0x7f16d8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:34.989+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f16e008d030 con 0x7f16e815e1d0 2024-03-04T08:52:35.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.295+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16e815c0c0 con 0x7f16e815e1d0 2024-03-04T08:52:35.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.295+0000 7f16df7fe640 1 -- 172.21.15.19:0/2073451096 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f16e0058610 con 0x7f16e815e1d0 2024-03-04T08:52:35.292 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:35.292 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:35.293 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 msgr2=0x7f16c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 0x7f16c806d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16d8036000 tx=0x7f16d8008030 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 msgr2=0x7f16e80c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16e000ba10 tx=0x7f16e000bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 shutdown_connections 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16e815e1d0 0x7f16e80c7d20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f16e815ddf0 0x7f16e80c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 --2- 172.21.15.19:0/2073451096 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f16e80d0de0 0x7f16e81f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 >> 172.21.15.19:0/2073451096 conn(0x7f16e809cff0 msgr2=0x7f16e806cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:35.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 shutdown_connections 2024-03-04T08:52:35.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.297+0000 7f16ed78c640 1 -- 172.21.15.19:0/2073451096 wait complete. 2024-03-04T08:52:35.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.409+0000 7f04c8f3a640 1 Processor -- start 2024-03-04T08:52:35.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.409+0000 7f04c8f3a640 1 -- start start 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c8f3a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f04c415bb20 0x7f04c40d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c8f3a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04c40cd8c0 0x7f04c40d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c8f3a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c4161980 con 0x7f04c40cfff0 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c8f3a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c4161c60 con 0x7f04c40cd8c0 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c8f3a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c4161f40 con 0x7f04c415bb20 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c2d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04c40cd8c0 0x7f04c40d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c2d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04c40cd8c0 0x7f04c40d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49612/0 (socket says 172.21.15.19:49612) 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.410+0000 7f04c2d9d640 1 -- 172.21.15.19:0/1455374993 learned_addr learned my addr 172.21.15.19:0/1455374993 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.411+0000 7f04c259c640 1 --2- 172.21.15.19:0/1455374993 >> v2:172.21.15.204:3300/0 conn(0x7f04c415bb20 0x7f04c40d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.411+0000 7f04c2d9d640 1 -- 172.21.15.19:0/1455374993 >> v2:172.21.15.204:3300/0 conn(0x7f04c415bb20 msgr2=0x7f04c40d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.411+0000 7f04c2d9d640 1 --2- 172.21.15.19:0/1455374993 >> v2:172.21.15.204:3300/0 conn(0x7f04c415bb20 0x7f04c40d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.411+0000 7f04c2d9d640 1 -- 172.21.15.19:0/1455374993 >> v1:172.21.15.204:6789/0 conn(0x7f04c40cfff0 legacy=0x7f04c40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:35.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.411+0000 7f04c2d9d640 1 -- 172.21.15.19:0/1455374993 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4162220 con 0x7f04c40cd8c0 2024-03-04T08:52:35.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c2d9d640 1 --2- 172.21.15.19:0/1455374993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c40cd8c0 0x7f04c40d04a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f04c40d2bc0 tx=0x7f04b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa30b1993d2f967 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c159a640 1 -- 172.21.15.19:0/1455374993 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4035020 con 0x7f04c40cd8c0 2024-03-04T08:52:35.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c159a640 1 -- 172.21.15.19:0/1455374993 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4031870 con 0x7f04c40cd8c0 2024-03-04T08:52:35.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c159a640 1 -- 172.21.15.19:0/1455374993 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4031c40 con 0x7f04c40cd8c0 2024-03-04T08:52:35.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c8f3a640 1 -- 172.21.15.19:0/1455374993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c40cd8c0 msgr2=0x7f04c40d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.412+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/1455374993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c40cd8c0 0x7f04c40d04a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f04c40d2bc0 tx=0x7f04b402b910 comp rx=0 tx=0).stop 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 -- 172.21.15.19:0/1455374993 shutdown_connections 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/1455374993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c40cd8c0 0x7f04c40d04a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/1455374993 >> v2:172.21.15.204:3300/0 conn(0x7f04c415bb20 0x7f04c40d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 -- 172.21.15.19:0/1455374993 >> 172.21.15.19:0/1455374993 conn(0x7f04c409a9f0 msgr2=0x7f04c409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 -- 172.21.15.19:0/1455374993 shutdown_connections 2024-03-04T08:52:35.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.413+0000 7f04c8f3a640 1 -- 172.21.15.19:0/1455374993 wait complete. 2024-03-04T08:52:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.414+0000 7f04c8f3a640 1 Processor -- start 2024-03-04T08:52:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.414+0000 7f04c8f3a640 1 -- start start 2024-03-04T08:52:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 0x7f04c4154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 0x7f04c41e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40d24b0 con 0x7f04c415bb20 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40d2330 con 0x7f04c40cfff0 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c8f3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40d1980 con 0x7f04c40cd8c0 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49626/0 (socket says 172.21.15.19:49626) 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 -- 172.21.15.19:0/2027881715 learned_addr learned my addr 172.21.15.19:0/2027881715 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c1d9b640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 0x7f04c41e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 -- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 msgr2=0x7f04c4154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c259c640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 0x7f04c4154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 0x7f04c4154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 -- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 msgr2=0x7f04c41e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 0x7f04c41e77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 -- 172.21.15.19:0/2027881715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4160720 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c1d9b640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 0x7f04c41e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c259c640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 0x7f04c4154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04c2d9d640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009960 tx=0x7f04b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.415+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4040070 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.416+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b403a420 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.416+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c4160a00 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.416+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4035040 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.416+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4160fc0 con 0x7f04c415bb20 2024-03-04T08:52:35.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.417+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c404f330 con 0x7f04c415bb20 2024-03-04T08:52:35.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.417+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04b4038020 con 0x7f04c415bb20 2024-03-04T08:52:35.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.418+0000 7f04b2ffd640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 0x7f04a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.418+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b40ac110 con 0x7f04c415bb20 2024-03-04T08:52:35.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.418+0000 7f04c259c640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 0x7f04a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.418+0000 7f04c259c640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 0x7f04a406d9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04c406e430 tx=0x7f04bc007420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.422+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f04b407b020 con 0x7f04c415bb20 2024-03-04T08:52:35.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.604+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04c406ef90 con 0x7f04c415bb20 2024-03-04T08:52:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.605+0000 7f04b2ffd640 1 -- 172.21.15.19:0/2027881715 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f04b407a920 con 0x7f04c415bb20 2024-03-04T08:52:35.601 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:35.601 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 msgr2=0x7f04a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 0x7f04a406d9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04c406e430 tx=0x7f04bc007420 comp rx=0 tx=0).stop 2024-03-04T08:52:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 msgr2=0x7f04c41e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009960 tx=0x7f04b40046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 shutdown_connections 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04c415bb20 0x7f04c41e7d20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f04a406b500 0x7f04a406d9c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f04c40cfff0 0x7f04c41e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 --2- 172.21.15.19:0/2027881715 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f04c40cd8c0 0x7f04c4154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 >> 172.21.15.19:0/2027881715 conn(0x7f04c409a9f0 msgr2=0x7f04c40ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 shutdown_connections 2024-03-04T08:52:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.607+0000 7f04c8f3a640 1 -- 172.21.15.19:0/2027881715 wait complete. 2024-03-04T08:52:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T08:52:35.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:52:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.719+0000 7f85f2eb8640 1 Processor -- start 2024-03-04T08:52:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.719+0000 7f85f2eb8640 1 -- start start 2024-03-04T08:52:35.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f2eb8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec0d4760 0x7f85ec0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f2eb8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85ec0d0a80 0x7f85ec0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f2eb8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0d25d0 con 0x7f85ec0b4170 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f2eb8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec0d4bf0 con 0x7f85ec0d0a80 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f2eb8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0ce9e0 con 0x7f85ec0d4760 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85ec0d0a80 0x7f85ec0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85ec0d0a80 0x7f85ec0cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49628/0 (socket says 172.21.15.19:49628) 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f0c54640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f85ec0b4170 0x7f85ec0d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44998/0 (socket says 172.21.15.19:44998) 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 -- 172.21.15.19:0/388632494 learned_addr learned my addr 172.21.15.19:0/388632494 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85ebfff640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec0d4760 0x7f85ec0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 -- 172.21.15.19:0/388632494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec0d4760 msgr2=0x7f85ec0b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec0d4760 0x7f85ec0b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 -- 172.21.15.19:0/388632494 >> v1:172.21.15.19:6789/0 conn(0x7f85ec0b4170 legacy=0x7f85ec0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.720+0000 7f85f1455640 1 -- 172.21.15.19:0/388632494 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0d2870 con 0x7f85ec0d0a80 2024-03-04T08:52:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.721+0000 7f85f1455640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0cee70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009e50 tx=0x7f85e402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2380d5e830b434c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.721+0000 7f85eb7fe640 1 -- 172.21.15.19:0/388632494 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e402cb00 con 0x7f85ec0d0a80 2024-03-04T08:52:35.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.721+0000 7f85eb7fe640 1 -- 172.21.15.19:0/388632494 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e402cca0 con 0x7f85ec0d0a80 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.721+0000 7f85eb7fe640 1 -- 172.21.15.19:0/388632494 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4034610 con 0x7f85ec0d0a80 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 -- 172.21.15.19:0/388632494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0d0a80 msgr2=0x7f85ec0cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0cee70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009e50 tx=0x7f85e402bf60 comp rx=0 tx=0).stop 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 -- 172.21.15.19:0/388632494 shutdown_connections 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0cee70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/388632494 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec0d4760 0x7f85ec0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 -- 172.21.15.19:0/388632494 >> 172.21.15.19:0/388632494 conn(0x7f85ec0d3c40 msgr2=0x7f85ec0d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 -- 172.21.15.19:0/388632494 shutdown_connections 2024-03-04T08:52:35.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.722+0000 7f85f2eb8640 1 -- 172.21.15.19:0/388632494 wait complete. 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.723+0000 7f85f2eb8640 1 Processor -- start 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.723+0000 7f85f2eb8640 1 -- start start 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec158ff0 0x7f85ec1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b4dd0 con 0x7f85ec0b4170 2024-03-04T08:52:35.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b4550 con 0x7f85ec0d0a80 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0b4f50 con 0x7f85ec158ff0 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49642/0 (socket says 172.21.15.19:49642) 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 -- 172.21.15.19:0/2814701201 learned_addr learned my addr 172.21.15.19:0/2814701201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f1455640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec158ff0 0x7f85ec1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85ebfff640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 -- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec158ff0 msgr2=0x7f85ec1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec158ff0 0x7f85ec1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 -- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85ec0d0a80 msgr2=0x7f85ec0b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 -- 172.21.15.19:0/2814701201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0b7dd0 con 0x7f85ec0b4170 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f0c54640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c430 tx=0x7f85e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00074e0 con 0x7f85ec0b4170 2024-03-04T08:52:35.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0007680 con 0x7f85ec0b4170 2024-03-04T08:52:35.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004a00 con 0x7f85ec0b4170 2024-03-04T08:52:35.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.724+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0b80b0 con 0x7f85ec0b4170 2024-03-04T08:52:35.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.725+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0b8670 con 0x7f85ec0b4170 2024-03-04T08:52:35.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.726+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec04f330 con 0x7f85ec0b4170 2024-03-04T08:52:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.726+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85e001a020 con 0x7f85ec0b4170 2024-03-04T08:52:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.727+0000 7f85e97fa640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 0x7f85d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.727+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85e0089a10 con 0x7f85ec0b4170 2024-03-04T08:52:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.727+0000 7f85ebfff640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 0x7f85d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:35.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.727+0000 7f85ebfff640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 0x7f85d006d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f85d8006fd0 tx=0x7f85d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:35.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.731+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f85e0058890 con 0x7f85ec0b4170 2024-03-04T08:52:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.909+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85ec0733b0 con 0x7f85d006b500 2024-03-04T08:52:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.916+0000 7f85e97fa640 1 -- 172.21.15.19:0/2814701201 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251902 (secure 0 0 0) 0x7f85ec0733b0 con 0x7f85d006b500 2024-03-04T08:52:35.915 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 msgr2=0x7f85d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 0x7f85d006d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f85d8006fd0 tx=0x7f85d8008040 comp rx=0 tx=0).stop 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 msgr2=0x7f85ec157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c430 tx=0x7f85e000c8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 shutdown_connections 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85ec158ff0 0x7f85ec1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d006b500 0x7f85d006d9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85ec0d0a80 0x7f85ec0b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 --2- 172.21.15.19:0/2814701201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ec0b4170 0x7f85ec157230 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 >> 172.21.15.19:0/2814701201 conn(0x7f85ec0d3c40 msgr2=0x7f85ec0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 shutdown_connections 2024-03-04T08:52:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:35.918+0000 7f85f2eb8640 1 -- 172.21.15.19:0/2814701201 wait complete. 2024-03-04T08:52:35.926 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-03-04T08:52:35.164593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230068,"kb_used_data":5568,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744652,"statfs":{"total":773094113280,"available":772858523648,"internally_reserved":0,"allocated":5701632,"data_stored":3036095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.338406"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851865+0000","last_change":"2024-03-04T08:52:31.851980+0000","last_active":"2024-03-04T08:52:32.851865+0000","last_peered":"2024-03-04T08:52:32.851865+0000","last_clean":"2024-03-04T08:52:32.851865+0000","last_became_active":"2024-03-04T08:52:31.851665+0000","last_became_peered":"2024-03-04T08:52:31.851665+0000","last_unstale":"2024-03-04T08:52:32.851865+0000","last_undegraded":"2024-03-04T08:52:32.851865+0000","last_fullsized":"2024-03-04T08:52:32.851865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:37.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856914+0000","last_change":"2024-03-04T08:52:31.852613+0000","last_active":"2024-03-04T08:52:31.856914+0000","last_peered":"2024-03-04T08:52:31.856914+0000","last_clean":"2024-03-04T08:52:31.856914+0000","last_became_active":"2024-03-04T08:52:31.852146+0000","last_became_peered":"2024-03-04T08:52:31.852146+0000","last_unstale":"2024-03-04T08:52:31.856914+0000","last_undegraded":"2024-03-04T08:52:31.856914+0000","last_fullsized":"2024-03-04T08:52:31.856914+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:14.911748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868934+0000","last_change":"2024-03-04T08:52:31.861686+0000","last_active":"2024-03-04T08:52:31.868934+0000","last_peered":"2024-03-04T08:52:31.868934+0000","last_clean":"2024-03-04T08:52:31.868934+0000","last_became_active":"2024-03-04T08:52:31.860973+0000","last_became_peered":"2024-03-04T08:52:31.860973+0000","last_unstale":"2024-03-04T08:52:31.868934+0000","last_undegraded":"2024-03-04T08:52:31.868934+0000","last_fullsized":"2024-03-04T08:52:31.868934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857019+0000","last_change":"2024-03-04T08:52:31.852454+0000","last_active":"2024-03-04T08:52:31.857019+0000","last_peered":"2024-03-04T08:52:31.857019+0000","last_clean":"2024-03-04T08:52:31.857019+0000","last_became_active":"2024-03-04T08:52:31.852169+0000","last_became_peered":"2024-03-04T08:52:31.852169+0000","last_unstale":"2024-03-04T08:52:31.857019+0000","last_undegraded":"2024-03-04T08:52:31.857019+0000","last_fullsized":"2024-03-04T08:52:31.857019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:46.743794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853552+0000","last_change":"2024-03-04T08:52:31.850716+0000","last_active":"2024-03-04T08:52:32.853552+0000","last_peered":"2024-03-04T08:52:32.853552+0000","last_clean":"2024-03-04T08:52:32.853552+0000","last_became_active":"2024-03-04T08:52:31.850424+0000","last_became_peered":"2024-03-04T08:52:31.850424+0000","last_unstale":"2024-03-04T08:52:32.853552+0000","last_undegraded":"2024-03-04T08:52:32.853552+0000","last_fullsized":"2024-03-04T08:52:32.853552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:45.936103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851919+0000","last_change":"2024-03-04T08:52:31.851610+0000","last_active":"2024-03-04T08:52:32.851919+0000","last_peered":"2024-03-04T08:52:32.851919+0000","last_clean":"2024-03-04T08:52:32.851919+0000","last_became_active":"2024-03-04T08:52:31.851348+0000","last_became_peered":"2024-03-04T08:52:31.851348+0000","last_unstale":"2024-03-04T08:52:32.851919+0000","last_undegraded":"2024-03-04T08:52:32.851919+0000","last_fullsized":"2024-03-04T08:52:32.851919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:47.591221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867760+0000","last_change":"2024-03-04T08:52:31.860910+0000","last_active":"2024-03-04T08:52:31.867760+0000","last_peered":"2024-03-04T08:52:31.867760+0000","last_clean":"2024-03-04T08:52:31.867760+0000","last_became_active":"2024-03-04T08:52:31.860621+0000","last_became_peered":"2024-03-04T08:52:31.860621+0000","last_unstale":"2024-03-04T08:52:31.867760+0000","last_undegraded":"2024-03-04T08:52:31.867760+0000","last_fullsized":"2024-03-04T08:52:31.867760+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:12.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855191+0000","last_change":"2024-03-04T08:52:31.849510+0000","last_active":"2024-03-04T08:52:31.855191+0000","last_peered":"2024-03-04T08:52:31.855191+0000","last_clean":"2024-03-04T08:52:31.855191+0000","last_became_active":"2024-03-04T08:52:31.849252+0000","last_became_peered":"2024-03-04T08:52:31.849252+0000","last_unstale":"2024-03-04T08:52:31.855191+0000","last_undegraded":"2024-03-04T08:52:31.855191+0000","last_fullsized":"2024-03-04T08:52:31.855191+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:55.639131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855204+0000","last_change":"2024-03-04T08:52:31.850359+0000","last_active":"2024-03-04T08:52:31.855204+0000","last_peered":"2024-03-04T08:52:31.855204+0000","last_clean":"2024-03-04T08:52:31.855204+0000","last_became_active":"2024-03-04T08:52:31.850086+0000","last_became_peered":"2024-03-04T08:52:31.850086+0000","last_unstale":"2024-03-04T08:52:31.855204+0000","last_undegraded":"2024-03-04T08:52:31.855204+0000","last_fullsized":"2024-03-04T08:52:31.855204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:20.638670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852074+0000","last_change":"2024-03-04T08:52:31.847842+0000","last_active":"2024-03-04T08:52:32.852074+0000","last_peered":"2024-03-04T08:52:32.852074+0000","last_clean":"2024-03-04T08:52:32.852074+0000","last_became_active":"2024-03-04T08:52:31.847576+0000","last_became_peered":"2024-03-04T08:52:31.847576+0000","last_unstale":"2024-03-04T08:52:32.852074+0000","last_undegraded":"2024-03-04T08:52:32.852074+0000","last_fullsized":"2024-03-04T08:52:32.852074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:47.691636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856684+0000","last_change":"2024-03-04T08:52:31.853147+0000","last_active":"2024-03-04T08:52:31.856684+0000","last_peered":"2024-03-04T08:52:31.856684+0000","last_clean":"2024-03-04T08:52:31.856684+0000","last_became_active":"2024-03-04T08:52:31.852835+0000","last_became_peered":"2024-03-04T08:52:31.852835+0000","last_unstale":"2024-03-04T08:52:31.856684+0000","last_undegraded":"2024-03-04T08:52:31.856684+0000","last_fullsized":"2024-03-04T08:52:31.856684+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:24:25.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857245+0000","last_change":"2024-03-04T08:52:31.854851+0000","last_active":"2024-03-04T08:52:31.857245+0000","last_peered":"2024-03-04T08:52:31.857245+0000","last_clean":"2024-03-04T08:52:31.857245+0000","last_became_active":"2024-03-04T08:52:31.853962+0000","last_became_peered":"2024-03-04T08:52:31.853962+0000","last_unstale":"2024-03-04T08:52:31.857245+0000","last_undegraded":"2024-03-04T08:52:31.857245+0000","last_fullsized":"2024-03-04T08:52:31.857245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:26.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851852+0000","last_change":"2024-03-04T08:52:31.850001+0000","last_active":"2024-03-04T08:52:32.851852+0000","last_peered":"2024-03-04T08:52:32.851852+0000","last_clean":"2024-03-04T08:52:32.851852+0000","last_became_active":"2024-03-04T08:52:31.849720+0000","last_became_peered":"2024-03-04T08:52:31.849720+0000","last_unstale":"2024-03-04T08:52:32.851852+0000","last_undegraded":"2024-03-04T08:52:32.851852+0000","last_fullsized":"2024-03-04T08:52:32.851852+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:32.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868971+0000","last_change":"2024-03-04T08:52:31.863033+0000","last_active":"2024-03-04T08:52:31.868971+0000","last_peered":"2024-03-04T08:52:31.868971+0000","last_clean":"2024-03-04T08:52:31.868971+0000","last_became_active":"2024-03-04T08:52:31.861121+0000","last_became_peered":"2024-03-04T08:52:31.861121+0000","last_unstale":"2024-03-04T08:52:31.868971+0000","last_undegraded":"2024-03-04T08:52:31.868971+0000","last_fullsized":"2024-03-04T08:52:31.868971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:05.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856885+0000","last_change":"2024-03-04T08:52:31.850690+0000","last_active":"2024-03-04T08:52:31.856885+0000","last_peered":"2024-03-04T08:52:31.856885+0000","last_clean":"2024-03-04T08:52:31.856885+0000","last_became_active":"2024-03-04T08:52:31.850372+0000","last_became_peered":"2024-03-04T08:52:31.850372+0000","last_unstale":"2024-03-04T08:52:31.856885+0000","last_undegraded":"2024-03-04T08:52:31.856885+0000","last_fullsized":"2024-03-04T08:52:31.856885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851764+0000","last_change":"2024-03-04T08:52:31.850120+0000","last_active":"2024-03-04T08:52:32.851764+0000","last_peered":"2024-03-04T08:52:32.851764+0000","last_clean":"2024-03-04T08:52:32.851764+0000","last_became_active":"2024-03-04T08:52:31.849790+0000","last_became_peered":"2024-03-04T08:52:31.849790+0000","last_unstale":"2024-03-04T08:52:32.851764+0000","last_undegraded":"2024-03-04T08:52:32.851764+0000","last_fullsized":"2024-03-04T08:52:32.851764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:45.936103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861340+0000","last_change":"2024-03-04T08:52:31.854125+0000","last_active":"2024-03-04T08:52:31.861340+0000","last_peered":"2024-03-04T08:52:31.861340+0000","last_clean":"2024-03-04T08:52:31.861340+0000","last_became_active":"2024-03-04T08:52:31.853773+0000","last_became_peered":"2024-03-04T08:52:31.853773+0000","last_unstale":"2024-03-04T08:52:31.861340+0000","last_undegraded":"2024-03-04T08:52:31.861340+0000","last_fullsized":"2024-03-04T08:52:31.861340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:15.197924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857071+0000","last_change":"2024-03-04T08:52:31.852783+0000","last_active":"2024-03-04T08:52:31.857071+0000","last_peered":"2024-03-04T08:52:31.857071+0000","last_clean":"2024-03-04T08:52:31.857071+0000","last_became_active":"2024-03-04T08:52:31.852128+0000","last_became_peered":"2024-03-04T08:52:31.852128+0000","last_unstale":"2024-03-04T08:52:31.857071+0000","last_undegraded":"2024-03-04T08:52:31.857071+0000","last_fullsized":"2024-03-04T08:52:31.857071+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:42.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860806+0000","last_change":"2024-03-04T08:52:31.849149+0000","last_active":"2024-03-04T08:52:31.860806+0000","last_peered":"2024-03-04T08:52:31.860806+0000","last_clean":"2024-03-04T08:52:31.860806+0000","last_became_active":"2024-03-04T08:52:31.848849+0000","last_became_peered":"2024-03-04T08:52:31.848849+0000","last_unstale":"2024-03-04T08:52:31.860806+0000","last_undegraded":"2024-03-04T08:52:31.860806+0000","last_fullsized":"2024-03-04T08:52:31.860806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:49.098468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859647+0000","last_change":"2024-03-04T08:52:31.856508+0000","last_active":"2024-03-04T08:52:31.859647+0000","last_peered":"2024-03-04T08:52:31.859647+0000","last_clean":"2024-03-04T08:52:31.859647+0000","last_became_active":"2024-03-04T08:52:31.855625+0000","last_became_peered":"2024-03-04T08:52:31.855625+0000","last_unstale":"2024-03-04T08:52:31.859647+0000","last_undegraded":"2024-03-04T08:52:31.859647+0000","last_fullsized":"2024-03-04T08:52:31.859647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:06:34.696214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859421+0000","last_change":"2024-03-04T08:52:31.855131+0000","last_active":"2024-03-04T08:52:31.859421+0000","last_peered":"2024-03-04T08:52:31.859421+0000","last_clean":"2024-03-04T08:52:31.859421+0000","last_became_active":"2024-03-04T08:52:31.854846+0000","last_became_peered":"2024-03-04T08:52:31.854846+0000","last_unstale":"2024-03-04T08:52:31.859421+0000","last_undegraded":"2024-03-04T08:52:31.859421+0000","last_fullsized":"2024-03-04T08:52:31.859421+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:04.671291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855225+0000","last_change":"2024-03-04T08:52:31.850280+0000","last_active":"2024-03-04T08:52:31.855225+0000","last_peered":"2024-03-04T08:52:31.855225+0000","last_clean":"2024-03-04T08:52:31.855225+0000","last_became_active":"2024-03-04T08:52:31.849983+0000","last_became_peered":"2024-03-04T08:52:31.849983+0000","last_unstale":"2024-03-04T08:52:31.855225+0000","last_undegraded":"2024-03-04T08:52:31.855225+0000","last_fullsized":"2024-03-04T08:52:31.855225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:43:32.949042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.853349+0000","last_change":"2024-03-04T08:52:31.852340+0000","last_active":"2024-03-04T08:52:31.853349+0000","last_peered":"2024-03-04T08:52:31.853349+0000","last_clean":"2024-03-04T08:52:31.853349+0000","last_became_active":"2024-03-04T08:52:31.852081+0000","last_became_peered":"2024-03-04T08:52:31.852081+0000","last_unstale":"2024-03-04T08:52:31.853349+0000","last_undegraded":"2024-03-04T08:52:31.853349+0000","last_fullsized":"2024-03-04T08:52:31.853349+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:47.073889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860753+0000","last_change":"2024-03-04T08:52:31.851498+0000","last_active":"2024-03-04T08:52:31.860753+0000","last_peered":"2024-03-04T08:52:31.860753+0000","last_clean":"2024-03-04T08:52:31.860753+0000","last_became_active":"2024-03-04T08:52:31.851224+0000","last_became_peered":"2024-03-04T08:52:31.851224+0000","last_unstale":"2024-03-04T08:52:31.860753+0000","last_undegraded":"2024-03-04T08:52:31.860753+0000","last_fullsized":"2024-03-04T08:52:31.860753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:09.095775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861360+0000","last_change":"2024-03-04T08:52:31.857169+0000","last_active":"2024-03-04T08:52:31.861360+0000","last_peered":"2024-03-04T08:52:31.861360+0000","last_clean":"2024-03-04T08:52:31.861360+0000","last_became_active":"2024-03-04T08:52:31.856483+0000","last_became_peered":"2024-03-04T08:52:31.856483+0000","last_unstale":"2024-03-04T08:52:31.861360+0000","last_undegraded":"2024-03-04T08:52:31.861360+0000","last_fullsized":"2024-03-04T08:52:31.861360+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:08.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845938+0000","last_change":"2024-03-04T08:52:31.844370+0000","last_active":"2024-03-04T08:52:31.845938+0000","last_peered":"2024-03-04T08:52:31.845938+0000","last_clean":"2024-03-04T08:52:31.845938+0000","last_became_active":"2024-03-04T08:52:31.844099+0000","last_became_peered":"2024-03-04T08:52:31.844099+0000","last_unstale":"2024-03-04T08:52:31.845938+0000","last_undegraded":"2024-03-04T08:52:31.845938+0000","last_fullsized":"2024-03-04T08:52:31.845938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:46.044163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852186+0000","last_change":"2024-03-04T08:52:31.857429+0000","last_active":"2024-03-04T08:52:32.852186+0000","last_peered":"2024-03-04T08:52:32.852186+0000","last_clean":"2024-03-04T08:52:32.852186+0000","last_became_active":"2024-03-04T08:52:31.856791+0000","last_became_peered":"2024-03-04T08:52:31.856791+0000","last_unstale":"2024-03-04T08:52:32.852186+0000","last_undegraded":"2024-03-04T08:52:32.852186+0000","last_fullsized":"2024-03-04T08:52:32.852186+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:17.481005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859712+0000","last_change":"2024-03-04T08:52:31.856795+0000","last_active":"2024-03-04T08:52:31.859712+0000","last_peered":"2024-03-04T08:52:31.859712+0000","last_clean":"2024-03-04T08:52:31.859712+0000","last_became_active":"2024-03-04T08:52:31.856021+0000","last_became_peered":"2024-03-04T08:52:31.856021+0000","last_unstale":"2024-03-04T08:52:31.859712+0000","last_undegraded":"2024-03-04T08:52:31.859712+0000","last_fullsized":"2024-03-04T08:52:31.859712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:07.493674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861029+0000","last_change":"2024-03-04T08:52:31.856419+0000","last_active":"2024-03-04T08:52:31.861029+0000","last_peered":"2024-03-04T08:52:31.861029+0000","last_clean":"2024-03-04T08:52:31.861029+0000","last_became_active":"2024-03-04T08:52:31.856155+0000","last_became_peered":"2024-03-04T08:52:31.856155+0000","last_unstale":"2024-03-04T08:52:31.861029+0000","last_undegraded":"2024-03-04T08:52:31.861029+0000","last_fullsized":"2024-03-04T08:52:31.861029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:44.622733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859339+0000","last_change":"2024-03-04T08:52:31.855456+0000","last_active":"2024-03-04T08:52:31.859339+0000","last_peered":"2024-03-04T08:52:31.859339+0000","last_clean":"2024-03-04T08:52:31.859339+0000","last_became_active":"2024-03-04T08:52:31.855180+0000","last_became_peered":"2024-03-04T08:52:31.855180+0000","last_unstale":"2024-03-04T08:52:31.859339+0000","last_undegraded":"2024-03-04T08:52:31.859339+0000","last_fullsized":"2024-03-04T08:52:31.859339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:52.058744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861069+0000","last_change":"2024-03-04T08:52:31.853910+0000","last_active":"2024-03-04T08:52:31.861069+0000","last_peered":"2024-03-04T08:52:31.861069+0000","last_clean":"2024-03-04T08:52:31.861069+0000","last_became_active":"2024-03-04T08:52:31.851937+0000","last_became_peered":"2024-03-04T08:52:31.851937+0000","last_unstale":"2024-03-04T08:52:31.861069+0000","last_undegraded":"2024-03-04T08:52:31.861069+0000","last_fullsized":"2024-03-04T08:52:31.861069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:57.478024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.850575+0000","last_change":"2024-03-04T08:52:31.847128+0000","last_active":"2024-03-04T08:52:31.850575+0000","last_peered":"2024-03-04T08:52:31.850575+0000","last_clean":"2024-03-04T08:52:31.850575+0000","last_became_active":"2024-03-04T08:52:31.846816+0000","last_became_peered":"2024-03-04T08:52:31.846816+0000","last_unstale":"2024-03-04T08:52:31.850575+0000","last_undegraded":"2024-03-04T08:52:31.850575+0000","last_fullsized":"2024-03-04T08:52:31.850575+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:55.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857119+0000","last_change":"2024-03-04T08:52:31.851226+0000","last_active":"2024-03-04T08:52:31.857119+0000","last_peered":"2024-03-04T08:52:31.857119+0000","last_clean":"2024-03-04T08:52:31.857119+0000","last_became_active":"2024-03-04T08:52:31.849872+0000","last_became_peered":"2024-03-04T08:52:31.849872+0000","last_unstale":"2024-03-04T08:52:31.857119+0000","last_undegraded":"2024-03-04T08:52:31.857119+0000","last_fullsized":"2024-03-04T08:52:31.857119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:05.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867293+0000","last_change":"2024-03-04T08:52:30.840766+0000","last_active":"2024-03-04T08:52:31.867293+0000","last_peered":"2024-03-04T08:52:31.867293+0000","last_clean":"2024-03-04T08:52:31.867293+0000","last_became_active":"2024-03-04T08:52:30.840479+0000","last_became_peered":"2024-03-04T08:52:30.840479+0000","last_unstale":"2024-03-04T08:52:31.867293+0000","last_undegraded":"2024-03-04T08:52:31.867293+0000","last_fullsized":"2024-03-04T08:52:31.867293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:27.346914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856638+0000","last_change":"2024-03-04T08:52:31.852068+0000","last_active":"2024-03-04T08:52:31.856638+0000","last_peered":"2024-03-04T08:52:31.856638+0000","last_clean":"2024-03-04T08:52:31.856638+0000","last_became_active":"2024-03-04T08:52:31.851711+0000","last_became_peered":"2024-03-04T08:52:31.851711+0000","last_unstale":"2024-03-04T08:52:31.856638+0000","last_undegraded":"2024-03-04T08:52:31.856638+0000","last_fullsized":"2024-03-04T08:52:31.856638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:08.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852130+0000","last_change":"2024-03-04T08:52:30.847952+0000","last_active":"2024-03-04T08:52:32.852130+0000","last_peered":"2024-03-04T08:52:32.852130+0000","last_clean":"2024-03-04T08:52:32.852130+0000","last_became_active":"2024-03-04T08:52:30.847661+0000","last_became_peered":"2024-03-04T08:52:30.847661+0000","last_unstale":"2024-03-04T08:52:32.852130+0000","last_undegraded":"2024-03-04T08:52:32.852130+0000","last_fullsized":"2024-03-04T08:52:32.852130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:47.563843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859482+0000","last_change":"2024-03-04T08:52:31.855115+0000","last_active":"2024-03-04T08:52:31.859482+0000","last_peered":"2024-03-04T08:52:31.859482+0000","last_clean":"2024-03-04T08:52:31.859482+0000","last_became_active":"2024-03-04T08:52:31.854810+0000","last_became_peered":"2024-03-04T08:52:31.854810+0000","last_unstale":"2024-03-04T08:52:31.859482+0000","last_undegraded":"2024-03-04T08:52:31.859482+0000","last_fullsized":"2024-03-04T08:52:31.859482+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:10.253458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852240+0000","last_change":"2024-03-04T08:52:30.850036+0000","last_active":"2024-03-04T08:52:32.852240+0000","last_peered":"2024-03-04T08:52:32.852240+0000","last_clean":"2024-03-04T08:52:32.852240+0000","last_became_active":"2024-03-04T08:52:30.849678+0000","last_became_peered":"2024-03-04T08:52:30.849678+0000","last_unstale":"2024-03-04T08:52:32.852240+0000","last_undegraded":"2024-03-04T08:52:32.852240+0000","last_fullsized":"2024-03-04T08:52:32.852240+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:42.953327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856351+0000","last_change":"2024-03-04T08:52:31.852547+0000","last_active":"2024-03-04T08:52:31.856351+0000","last_peered":"2024-03-04T08:52:31.856351+0000","last_clean":"2024-03-04T08:52:31.856351+0000","last_became_active":"2024-03-04T08:52:31.852247+0000","last_became_peered":"2024-03-04T08:52:31.852247+0000","last_unstale":"2024-03-04T08:52:31.856351+0000","last_undegraded":"2024-03-04T08:52:31.856351+0000","last_fullsized":"2024-03-04T08:52:31.856351+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:32.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867875+0000","last_change":"2024-03-04T08:52:30.839012+0000","last_active":"2024-03-04T08:52:31.867875+0000","last_peered":"2024-03-04T08:52:31.867875+0000","last_clean":"2024-03-04T08:52:31.867875+0000","last_became_active":"2024-03-04T08:52:30.838661+0000","last_became_peered":"2024-03-04T08:52:30.838661+0000","last_unstale":"2024-03-04T08:52:31.867875+0000","last_undegraded":"2024-03-04T08:52:31.867875+0000","last_fullsized":"2024-03-04T08:52:31.867875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:56.473641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853750+0000","last_change":"2024-03-04T08:52:31.847700+0000","last_active":"2024-03-04T08:52:32.853750+0000","last_peered":"2024-03-04T08:52:32.853750+0000","last_clean":"2024-03-04T08:52:32.853750+0000","last_became_active":"2024-03-04T08:52:31.847376+0000","last_became_peered":"2024-03-04T08:52:31.847376+0000","last_unstale":"2024-03-04T08:52:32.853750+0000","last_undegraded":"2024-03-04T08:52:32.853750+0000","last_fullsized":"2024-03-04T08:52:32.853750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:37.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.870747+0000","last_change":"2024-03-04T08:52:30.845450+0000","last_active":"2024-03-04T08:52:31.870747+0000","last_peered":"2024-03-04T08:52:31.870747+0000","last_clean":"2024-03-04T08:52:31.870747+0000","last_became_active":"2024-03-04T08:52:30.845005+0000","last_became_peered":"2024-03-04T08:52:30.845005+0000","last_unstale":"2024-03-04T08:52:31.870747+0000","last_undegraded":"2024-03-04T08:52:31.870747+0000","last_fullsized":"2024-03-04T08:52:31.870747+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:40.863152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859401+0000","last_change":"2024-03-04T08:52:31.855982+0000","last_active":"2024-03-04T08:52:31.859401+0000","last_peered":"2024-03-04T08:52:31.859401+0000","last_clean":"2024-03-04T08:52:31.859401+0000","last_became_active":"2024-03-04T08:52:31.855716+0000","last_became_peered":"2024-03-04T08:52:31.855716+0000","last_unstale":"2024-03-04T08:52:31.859401+0000","last_undegraded":"2024-03-04T08:52:31.859401+0000","last_fullsized":"2024-03-04T08:52:31.859401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:41.698142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853264+0000","last_change":"2024-03-04T08:52:30.843158+0000","last_active":"2024-03-04T08:52:32.853264+0000","last_peered":"2024-03-04T08:52:32.853264+0000","last_clean":"2024-03-04T08:52:32.853264+0000","last_became_active":"2024-03-04T08:52:30.842858+0000","last_became_peered":"2024-03-04T08:52:30.842858+0000","last_unstale":"2024-03-04T08:52:32.853264+0000","last_undegraded":"2024-03-04T08:52:32.853264+0000","last_fullsized":"2024-03-04T08:52:32.853264+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:26:58.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845193+0000","last_change":"2024-03-04T08:52:31.843648+0000","last_active":"2024-03-04T08:52:31.845193+0000","last_peered":"2024-03-04T08:52:31.845193+0000","last_clean":"2024-03-04T08:52:31.845193+0000","last_became_active":"2024-03-04T08:52:31.843334+0000","last_became_peered":"2024-03-04T08:52:31.843334+0000","last_unstale":"2024-03-04T08:52:31.845193+0000","last_undegraded":"2024-03-04T08:52:31.845193+0000","last_fullsized":"2024-03-04T08:52:31.845193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:56:35.022967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842992+0000","last_change":"2024-03-04T08:52:30.838155+0000","last_active":"2024-03-04T08:52:31.842992+0000","last_peered":"2024-03-04T08:52:31.842992+0000","last_clean":"2024-03-04T08:52:31.842992+0000","last_became_active":"2024-03-04T08:52:30.837659+0000","last_became_peered":"2024-03-04T08:52:30.837659+0000","last_unstale":"2024-03-04T08:52:31.842992+0000","last_undegraded":"2024-03-04T08:52:31.842992+0000","last_fullsized":"2024-03-04T08:52:31.842992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:35.918888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.866962+0000","last_change":"2024-03-04T08:52:31.863429+0000","last_active":"2024-03-04T08:52:31.866962+0000","last_peered":"2024-03-04T08:52:31.866962+0000","last_clean":"2024-03-04T08:52:31.866962+0000","last_became_active":"2024-03-04T08:52:31.863169+0000","last_became_peered":"2024-03-04T08:52:31.863169+0000","last_unstale":"2024-03-04T08:52:31.866962+0000","last_undegraded":"2024-03-04T08:52:31.866962+0000","last_fullsized":"2024-03-04T08:52:31.866962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:56:35.022967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845287+0000","last_change":"2024-03-04T08:52:30.837258+0000","last_active":"2024-03-04T08:52:31.845287+0000","last_peered":"2024-03-04T08:52:31.845287+0000","last_clean":"2024-03-04T08:52:31.845287+0000","last_became_active":"2024-03-04T08:52:30.836962+0000","last_became_peered":"2024-03-04T08:52:30.836962+0000","last_unstale":"2024-03-04T08:52:31.845287+0000","last_undegraded":"2024-03-04T08:52:31.845287+0000","last_fullsized":"2024-03-04T08:52:31.845287+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:37:39.106059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853280+0000","last_change":"2024-03-04T08:52:31.847756+0000","last_active":"2024-03-04T08:52:32.853280+0000","last_peered":"2024-03-04T08:52:32.853280+0000","last_clean":"2024-03-04T08:52:32.853280+0000","last_became_active":"2024-03-04T08:52:31.847433+0000","last_became_peered":"2024-03-04T08:52:31.847433+0000","last_unstale":"2024-03-04T08:52:32.853280+0000","last_undegraded":"2024-03-04T08:52:32.853280+0000","last_fullsized":"2024-03-04T08:52:32.853280+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:28.091773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841862+0000","last_change":"2024-03-04T08:52:30.835758+0000","last_active":"2024-03-04T08:52:31.841862+0000","last_peered":"2024-03-04T08:52:31.841862+0000","last_clean":"2024-03-04T08:52:31.841862+0000","last_became_active":"2024-03-04T08:52:30.835458+0000","last_became_peered":"2024-03-04T08:52:30.835458+0000","last_unstale":"2024-03-04T08:52:31.841862+0000","last_undegraded":"2024-03-04T08:52:31.841862+0000","last_fullsized":"2024-03-04T08:52:31.841862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:43.618350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.851890+0000","last_change":"2024-03-04T08:52:31.848003+0000","last_active":"2024-03-04T08:52:31.851890+0000","last_peered":"2024-03-04T08:52:31.851890+0000","last_clean":"2024-03-04T08:52:31.851890+0000","last_became_active":"2024-03-04T08:52:31.847728+0000","last_became_peered":"2024-03-04T08:52:31.847728+0000","last_unstale":"2024-03-04T08:52:31.851890+0000","last_undegraded":"2024-03-04T08:52:31.851890+0000","last_fullsized":"2024-03-04T08:52:31.851890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:44.622733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853761+0000","last_change":"2024-03-04T08:52:30.845199+0000","last_active":"2024-03-04T08:52:32.853761+0000","last_peered":"2024-03-04T08:52:32.853761+0000","last_clean":"2024-03-04T08:52:32.853761+0000","last_became_active":"2024-03-04T08:52:30.844936+0000","last_became_peered":"2024-03-04T08:52:30.844936+0000","last_unstale":"2024-03-04T08:52:32.853761+0000","last_undegraded":"2024-03-04T08:52:32.853761+0000","last_fullsized":"2024-03-04T08:52:32.853761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:26.792989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860959+0000","last_change":"2024-03-04T08:52:31.857356+0000","last_active":"2024-03-04T08:52:31.860959+0000","last_peered":"2024-03-04T08:52:31.860959+0000","last_clean":"2024-03-04T08:52:31.860959+0000","last_became_active":"2024-03-04T08:52:31.856036+0000","last_became_peered":"2024-03-04T08:52:31.856036+0000","last_unstale":"2024-03-04T08:52:31.860959+0000","last_undegraded":"2024-03-04T08:52:31.860959+0000","last_fullsized":"2024-03-04T08:52:31.860959+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:26.476283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.864329+0000","last_change":"2024-03-04T08:52:30.850866+0000","last_active":"2024-03-04T08:52:31.864329+0000","last_peered":"2024-03-04T08:52:31.864329+0000","last_clean":"2024-03-04T08:52:31.864329+0000","last_became_active":"2024-03-04T08:52:30.850629+0000","last_became_peered":"2024-03-04T08:52:30.850629+0000","last_unstale":"2024-03-04T08:52:31.864329+0000","last_undegraded":"2024-03-04T08:52:31.864329+0000","last_fullsized":"2024-03-04T08:52:31.864329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.471900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853696+0000","last_change":"2024-03-04T08:52:31.850513+0000","last_active":"2024-03-04T08:52:32.853696+0000","last_peered":"2024-03-04T08:52:32.853696+0000","last_clean":"2024-03-04T08:52:32.853696+0000","last_became_active":"2024-03-04T08:52:31.850224+0000","last_became_peered":"2024-03-04T08:52:31.850224+0000","last_unstale":"2024-03-04T08:52:32.853696+0000","last_undegraded":"2024-03-04T08:52:32.853696+0000","last_fullsized":"2024-03-04T08:52:32.853696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:32.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.872199+0000","last_change":"2024-03-04T08:52:30.839968+0000","last_active":"2024-03-04T08:52:31.872199+0000","last_peered":"2024-03-04T08:52:31.872199+0000","last_clean":"2024-03-04T08:52:31.872199+0000","last_became_active":"2024-03-04T08:52:30.839682+0000","last_became_peered":"2024-03-04T08:52:30.839682+0000","last_unstale":"2024-03-04T08:52:31.872199+0000","last_undegraded":"2024-03-04T08:52:31.872199+0000","last_fullsized":"2024-03-04T08:52:31.872199+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:45.739411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859353+0000","last_change":"2024-03-04T08:52:31.853783+0000","last_active":"2024-03-04T08:52:31.859353+0000","last_peered":"2024-03-04T08:52:31.859353+0000","last_clean":"2024-03-04T08:52:31.859353+0000","last_became_active":"2024-03-04T08:52:31.853448+0000","last_became_peered":"2024-03-04T08:52:31.853448+0000","last_unstale":"2024-03-04T08:52:31.859353+0000","last_undegraded":"2024-03-04T08:52:31.859353+0000","last_fullsized":"2024-03-04T08:52:31.859353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:26.476283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.874894+0000","last_change":"2024-03-04T08:52:30.840395+0000","last_active":"2024-03-04T08:52:31.874894+0000","last_peered":"2024-03-04T08:52:31.874894+0000","last_clean":"2024-03-04T08:52:31.874894+0000","last_became_active":"2024-03-04T08:52:30.840096+0000","last_became_peered":"2024-03-04T08:52:30.840096+0000","last_unstale":"2024-03-04T08:52:31.874894+0000","last_undegraded":"2024-03-04T08:52:31.874894+0000","last_fullsized":"2024-03-04T08:52:31.874894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:28.368601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860826+0000","last_change":"2024-03-04T08:52:31.854749+0000","last_active":"2024-03-04T08:52:31.860826+0000","last_peered":"2024-03-04T08:52:31.860826+0000","last_clean":"2024-03-04T08:52:31.860826+0000","last_became_active":"2024-03-04T08:52:31.848024+0000","last_became_peered":"2024-03-04T08:52:31.848024+0000","last_unstale":"2024-03-04T08:52:31.860826+0000","last_undegraded":"2024-03-04T08:52:31.860826+0000","last_fullsized":"2024-03-04T08:52:31.860826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:29:26.161883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.843914+0000","last_change":"2024-03-04T08:52:30.840571+0000","last_active":"2024-03-04T08:52:31.843914+0000","last_peered":"2024-03-04T08:52:31.843914+0000","last_clean":"2024-03-04T08:52:31.843914+0000","last_became_active":"2024-03-04T08:52:30.840305+0000","last_became_peered":"2024-03-04T08:52:30.840305+0000","last_unstale":"2024-03-04T08:52:31.843914+0000","last_undegraded":"2024-03-04T08:52:31.843914+0000","last_fullsized":"2024-03-04T08:52:31.843914+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:47.386046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.849654+0000","last_change":"2024-03-04T08:52:31.845697+0000","last_active":"2024-03-04T08:52:31.849654+0000","last_peered":"2024-03-04T08:52:31.849654+0000","last_clean":"2024-03-04T08:52:31.849654+0000","last_became_active":"2024-03-04T08:52:31.845429+0000","last_became_peered":"2024-03-04T08:52:31.845429+0000","last_unstale":"2024-03-04T08:52:31.849654+0000","last_undegraded":"2024-03-04T08:52:31.849654+0000","last_fullsized":"2024-03-04T08:52:31.849654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:23.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842842+0000","last_change":"2024-03-04T08:52:30.839276+0000","last_active":"2024-03-04T08:52:31.842842+0000","last_peered":"2024-03-04T08:52:31.842842+0000","last_clean":"2024-03-04T08:52:31.842842+0000","last_became_active":"2024-03-04T08:52:30.838997+0000","last_became_peered":"2024-03-04T08:52:30.838997+0000","last_unstale":"2024-03-04T08:52:31.842842+0000","last_undegraded":"2024-03-04T08:52:31.842842+0000","last_fullsized":"2024-03-04T08:52:31.842842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:07.783884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861318+0000","last_change":"2024-03-04T08:52:31.852815+0000","last_active":"2024-03-04T08:52:31.861318+0000","last_peered":"2024-03-04T08:52:31.861318+0000","last_clean":"2024-03-04T08:52:31.861318+0000","last_became_active":"2024-03-04T08:52:31.852542+0000","last_became_peered":"2024-03-04T08:52:31.852542+0000","last_unstale":"2024-03-04T08:52:31.861318+0000","last_undegraded":"2024-03-04T08:52:31.861318+0000","last_fullsized":"2024-03-04T08:52:31.861318+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:08.592597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867650+0000","last_change":"2024-03-04T08:52:30.840348+0000","last_active":"2024-03-04T08:52:31.867650+0000","last_peered":"2024-03-04T08:52:31.867650+0000","last_clean":"2024-03-04T08:52:31.867650+0000","last_became_active":"2024-03-04T08:52:30.839625+0000","last_became_peered":"2024-03-04T08:52:30.839625+0000","last_unstale":"2024-03-04T08:52:31.867650+0000","last_undegraded":"2024-03-04T08:52:31.867650+0000","last_fullsized":"2024-03-04T08:52:31.867650+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:51.054361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.853470+0000","last_change":"2024-03-04T08:52:31.847380+0000","last_active":"2024-03-04T08:52:31.853470+0000","last_peered":"2024-03-04T08:52:31.853470+0000","last_clean":"2024-03-04T08:52:31.853470+0000","last_became_active":"2024-03-04T08:52:31.847095+0000","last_became_peered":"2024-03-04T08:52:31.847095+0000","last_unstale":"2024-03-04T08:52:31.853470+0000","last_undegraded":"2024-03-04T08:52:31.853470+0000","last_fullsized":"2024-03-04T08:52:31.853470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:09.592279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.870606+0000","last_change":"2024-03-04T08:52:30.841049+0000","last_active":"2024-03-04T08:52:31.870606+0000","last_peered":"2024-03-04T08:52:31.870606+0000","last_clean":"2024-03-04T08:52:31.870606+0000","last_became_active":"2024-03-04T08:52:30.840702+0000","last_became_peered":"2024-03-04T08:52:30.840702+0000","last_unstale":"2024-03-04T08:52:31.870606+0000","last_undegraded":"2024-03-04T08:52:31.870606+0000","last_fullsized":"2024-03-04T08:52:31.870606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:51.838626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851771+0000","last_change":"2024-03-04T08:52:31.849184+0000","last_active":"2024-03-04T08:52:32.851771+0000","last_peered":"2024-03-04T08:52:32.851771+0000","last_clean":"2024-03-04T08:52:32.851771+0000","last_became_active":"2024-03-04T08:52:31.848908+0000","last_became_peered":"2024-03-04T08:52:31.848908+0000","last_unstale":"2024-03-04T08:52:32.851771+0000","last_undegraded":"2024-03-04T08:52:32.851771+0000","last_fullsized":"2024-03-04T08:52:32.851771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:00.385469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868716+0000","last_change":"2024-03-04T08:52:30.842101+0000","last_active":"2024-03-04T08:52:31.868716+0000","last_peered":"2024-03-04T08:52:31.868716+0000","last_clean":"2024-03-04T08:52:31.868716+0000","last_became_active":"2024-03-04T08:52:30.841806+0000","last_became_peered":"2024-03-04T08:52:30.841806+0000","last_unstale":"2024-03-04T08:52:31.868716+0000","last_undegraded":"2024-03-04T08:52:31.868716+0000","last_fullsized":"2024-03-04T08:52:31.868716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:54.651399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853353+0000","last_change":"2024-03-04T08:52:31.855554+0000","last_active":"2024-03-04T08:52:32.853353+0000","last_peered":"2024-03-04T08:52:32.853353+0000","last_clean":"2024-03-04T08:52:32.853353+0000","last_became_active":"2024-03-04T08:52:31.855027+0000","last_became_peered":"2024-03-04T08:52:31.855027+0000","last_unstale":"2024-03-04T08:52:32.853353+0000","last_undegraded":"2024-03-04T08:52:32.853353+0000","last_fullsized":"2024-03-04T08:52:32.853353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:00.385469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.866758+0000","last_change":"2024-03-04T08:52:30.849674+0000","last_active":"2024-03-04T08:52:31.866758+0000","last_peered":"2024-03-04T08:52:31.866758+0000","last_clean":"2024-03-04T08:52:31.866758+0000","last_became_active":"2024-03-04T08:52:30.849391+0000","last_became_peered":"2024-03-04T08:52:30.849391+0000","last_unstale":"2024-03-04T08:52:31.866758+0000","last_undegraded":"2024-03-04T08:52:31.866758+0000","last_fullsized":"2024-03-04T08:52:31.866758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:20:12.443105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852032+0000","last_change":"2024-03-04T08:52:31.852778+0000","last_active":"2024-03-04T08:52:32.852032+0000","last_peered":"2024-03-04T08:52:32.852032+0000","last_clean":"2024-03-04T08:52:32.852032+0000","last_became_active":"2024-03-04T08:52:31.852527+0000","last_became_peered":"2024-03-04T08:52:31.852527+0000","last_unstale":"2024-03-04T08:52:32.852032+0000","last_undegraded":"2024-03-04T08:52:32.852032+0000","last_fullsized":"2024-03-04T08:52:32.852032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:13.671352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.848370+0000","last_change":"2024-03-04T08:52:30.838837+0000","last_active":"2024-03-04T08:52:31.848370+0000","last_peered":"2024-03-04T08:52:31.848370+0000","last_clean":"2024-03-04T08:52:31.848370+0000","last_became_active":"2024-03-04T08:52:30.838557+0000","last_became_peered":"2024-03-04T08:52:30.838557+0000","last_unstale":"2024-03-04T08:52:31.848370+0000","last_undegraded":"2024-03-04T08:52:31.848370+0000","last_fullsized":"2024-03-04T08:52:31.848370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:26:01.284846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.849672+0000","last_change":"2024-03-04T08:52:31.844595+0000","last_active":"2024-03-04T08:52:31.849672+0000","last_peered":"2024-03-04T08:52:31.849672+0000","last_clean":"2024-03-04T08:52:31.849672+0000","last_became_active":"2024-03-04T08:52:31.844278+0000","last_became_peered":"2024-03-04T08:52:31.844278+0000","last_unstale":"2024-03-04T08:52:31.849672+0000","last_undegraded":"2024-03-04T08:52:31.849672+0000","last_fullsized":"2024-03-04T08:52:31.849672+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:29:26.161883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851971+0000","last_change":"2024-03-04T08:52:30.849609+0000","last_active":"2024-03-04T08:52:32.851971+0000","last_peered":"2024-03-04T08:52:32.851971+0000","last_clean":"2024-03-04T08:52:32.851971+0000","last_became_active":"2024-03-04T08:52:30.849244+0000","last_became_peered":"2024-03-04T08:52:30.849244+0000","last_unstale":"2024-03-04T08:52:32.851971+0000","last_undegraded":"2024-03-04T08:52:32.851971+0000","last_fullsized":"2024-03-04T08:52:32.851971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:54.301295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859393+0000","last_change":"2024-03-04T08:52:31.853052+0000","last_active":"2024-03-04T08:52:31.859393+0000","last_peered":"2024-03-04T08:52:31.859393+0000","last_clean":"2024-03-04T08:52:31.859393+0000","last_became_active":"2024-03-04T08:52:31.852794+0000","last_became_peered":"2024-03-04T08:52:31.852794+0000","last_unstale":"2024-03-04T08:52:31.859393+0000","last_undegraded":"2024-03-04T08:52:31.859393+0000","last_fullsized":"2024-03-04T08:52:31.859393+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.069534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.837275+0000","last_change":"2024-03-04T08:52:30.838735+0000","last_active":"2024-03-04T08:52:31.837275+0000","last_peered":"2024-03-04T08:52:31.837275+0000","last_clean":"2024-03-04T08:52:31.837275+0000","last_became_active":"2024-03-04T08:52:30.838419+0000","last_became_peered":"2024-03-04T08:52:30.838419+0000","last_unstale":"2024-03-04T08:52:31.837275+0000","last_undegraded":"2024-03-04T08:52:31.837275+0000","last_fullsized":"2024-03-04T08:52:31.837275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:41.576765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861074+0000","last_change":"2024-03-04T08:52:31.854944+0000","last_active":"2024-03-04T08:52:31.861074+0000","last_peered":"2024-03-04T08:52:31.861074+0000","last_clean":"2024-03-04T08:52:31.861074+0000","last_became_active":"2024-03-04T08:52:31.854647+0000","last_became_peered":"2024-03-04T08:52:31.854647+0000","last_unstale":"2024-03-04T08:52:31.861074+0000","last_undegraded":"2024-03-04T08:52:31.861074+0000","last_fullsized":"2024-03-04T08:52:31.861074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:55.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.846058+0000","last_change":"2024-03-04T08:52:30.848120+0000","last_active":"2024-03-04T08:52:31.846058+0000","last_peered":"2024-03-04T08:52:31.846058+0000","last_clean":"2024-03-04T08:52:31.846058+0000","last_became_active":"2024-03-04T08:52:30.847824+0000","last_became_peered":"2024-03-04T08:52:30.847824+0000","last_unstale":"2024-03-04T08:52:31.846058+0000","last_undegraded":"2024-03-04T08:52:31.846058+0000","last_fullsized":"2024-03-04T08:52:31.846058+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:29.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852030+0000","last_change":"2024-03-04T08:52:31.849037+0000","last_active":"2024-03-04T08:52:32.852030+0000","last_peered":"2024-03-04T08:52:32.852030+0000","last_clean":"2024-03-04T08:52:32.852030+0000","last_became_active":"2024-03-04T08:52:31.848222+0000","last_became_peered":"2024-03-04T08:52:31.848222+0000","last_unstale":"2024-03-04T08:52:32.852030+0000","last_undegraded":"2024-03-04T08:52:32.852030+0000","last_fullsized":"2024-03-04T08:52:32.852030+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:35.230045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842304+0000","last_change":"2024-03-04T08:52:30.846239+0000","last_active":"2024-03-04T08:52:31.842304+0000","last_peered":"2024-03-04T08:52:31.842304+0000","last_clean":"2024-03-04T08:52:31.842304+0000","last_became_active":"2024-03-04T08:52:30.845957+0000","last_became_peered":"2024-03-04T08:52:30.845957+0000","last_unstale":"2024-03-04T08:52:31.842304+0000","last_undegraded":"2024-03-04T08:52:31.842304+0000","last_fullsized":"2024-03-04T08:52:31.842304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:51:06.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859410+0000","last_change":"2024-03-04T08:52:31.856105+0000","last_active":"2024-03-04T08:52:31.859410+0000","last_peered":"2024-03-04T08:52:31.859410+0000","last_clean":"2024-03-04T08:52:31.859410+0000","last_became_active":"2024-03-04T08:52:31.855833+0000","last_became_peered":"2024-03-04T08:52:31.855833+0000","last_unstale":"2024-03-04T08:52:31.859410+0000","last_undegraded":"2024-03-04T08:52:31.859410+0000","last_fullsized":"2024-03-04T08:52:31.859410+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.869794+0000","last_change":"2024-03-04T08:52:30.840665+0000","last_active":"2024-03-04T08:52:31.869794+0000","last_peered":"2024-03-04T08:52:31.869794+0000","last_clean":"2024-03-04T08:52:31.869794+0000","last_became_active":"2024-03-04T08:52:30.840373+0000","last_became_peered":"2024-03-04T08:52:30.840373+0000","last_unstale":"2024-03-04T08:52:31.869794+0000","last_undegraded":"2024-03-04T08:52:31.869794+0000","last_fullsized":"2024-03-04T08:52:31.869794+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.241570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851979+0000","last_change":"2024-03-04T08:52:31.852279+0000","last_active":"2024-03-04T08:52:32.851979+0000","last_peered":"2024-03-04T08:52:32.851979+0000","last_clean":"2024-03-04T08:52:32.851979+0000","last_became_active":"2024-03-04T08:52:31.851993+0000","last_became_peered":"2024-03-04T08:52:31.851993+0000","last_unstale":"2024-03-04T08:52:32.851979+0000","last_undegraded":"2024-03-04T08:52:32.851979+0000","last_fullsized":"2024-03-04T08:52:32.851979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:13:34.205955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.844315+0000","last_change":"2024-03-04T08:52:30.838960+0000","last_active":"2024-03-04T08:52:31.844315+0000","last_peered":"2024-03-04T08:52:31.844315+0000","last_clean":"2024-03-04T08:52:31.844315+0000","last_became_active":"2024-03-04T08:52:30.838656+0000","last_became_peered":"2024-03-04T08:52:30.838656+0000","last_unstale":"2024-03-04T08:52:31.844315+0000","last_undegraded":"2024-03-04T08:52:31.844315+0000","last_fullsized":"2024-03-04T08:52:31.844315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:11.889264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.843015+0000","last_change":"2024-03-04T08:52:31.839761+0000","last_active":"2024-03-04T08:52:31.843015+0000","last_peered":"2024-03-04T08:52:31.843015+0000","last_clean":"2024-03-04T08:52:31.843015+0000","last_became_active":"2024-03-04T08:52:31.839450+0000","last_became_peered":"2024-03-04T08:52:31.839450+0000","last_unstale":"2024-03-04T08:52:31.843015+0000","last_undegraded":"2024-03-04T08:52:31.843015+0000","last_fullsized":"2024-03-04T08:52:31.843015+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:41.698142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.847152+0000","last_change":"2024-03-04T08:52:30.840769+0000","last_active":"2024-03-04T08:52:31.847152+0000","last_peered":"2024-03-04T08:52:31.847152+0000","last_clean":"2024-03-04T08:52:31.847152+0000","last_became_active":"2024-03-04T08:52:30.840467+0000","last_became_peered":"2024-03-04T08:52:30.840467+0000","last_unstale":"2024-03-04T08:52:31.847152+0000","last_undegraded":"2024-03-04T08:52:31.847152+0000","last_fullsized":"2024-03-04T08:52:31.847152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:23.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860900+0000","last_change":"2024-03-04T08:52:31.848402+0000","last_active":"2024-03-04T08:52:31.860900+0000","last_peered":"2024-03-04T08:52:31.860900+0000","last_clean":"2024-03-04T08:52:31.860900+0000","last_became_active":"2024-03-04T08:52:31.847535+0000","last_became_peered":"2024-03-04T08:52:31.847535+0000","last_unstale":"2024-03-04T08:52:31.860900+0000","last_undegraded":"2024-03-04T08:52:31.860900+0000","last_fullsized":"2024-03-04T08:52:31.860900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:18:14.233231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.836865+0000","last_change":"2024-03-04T08:52:30.838822+0000","last_active":"2024-03-04T08:52:31.836865+0000","last_peered":"2024-03-04T08:52:31.836865+0000","last_clean":"2024-03-04T08:52:31.836865+0000","last_became_active":"2024-03-04T08:52:30.838443+0000","last_became_peered":"2024-03-04T08:52:30.838443+0000","last_unstale":"2024-03-04T08:52:31.836865+0000","last_undegraded":"2024-03-04T08:52:31.836865+0000","last_fullsized":"2024-03-04T08:52:31.836865+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:04.904235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859267+0000","last_change":"2024-03-04T08:52:31.854292+0000","last_active":"2024-03-04T08:52:31.859267+0000","last_peered":"2024-03-04T08:52:31.859267+0000","last_clean":"2024-03-04T08:52:31.859267+0000","last_became_active":"2024-03-04T08:52:31.853986+0000","last_became_peered":"2024-03-04T08:52:31.853986+0000","last_unstale":"2024-03-04T08:52:31.859267+0000","last_undegraded":"2024-03-04T08:52:31.859267+0000","last_fullsized":"2024-03-04T08:52:31.859267+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:12.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.837270+0000","last_change":"2024-03-04T08:52:30.849216+0000","last_active":"2024-03-04T08:52:31.837270+0000","last_peered":"2024-03-04T08:52:31.837270+0000","last_clean":"2024-03-04T08:52:31.837270+0000","last_became_active":"2024-03-04T08:52:30.848919+0000","last_became_peered":"2024-03-04T08:52:30.848919+0000","last_unstale":"2024-03-04T08:52:31.837270+0000","last_undegraded":"2024-03-04T08:52:31.837270+0000","last_fullsized":"2024-03-04T08:52:31.837270+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:13.907364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.869026+0000","last_change":"2024-03-04T08:52:31.866544+0000","last_active":"2024-03-04T08:52:31.869026+0000","last_peered":"2024-03-04T08:52:31.869026+0000","last_clean":"2024-03-04T08:52:31.869026+0000","last_became_active":"2024-03-04T08:52:31.866224+0000","last_became_peered":"2024-03-04T08:52:31.866224+0000","last_unstale":"2024-03-04T08:52:31.869026+0000","last_undegraded":"2024-03-04T08:52:31.869026+0000","last_fullsized":"2024-03-04T08:52:31.869026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:46.743794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853179+0000","last_change":"2024-03-04T08:52:30.838881+0000","last_active":"2024-03-04T08:52:32.853179+0000","last_peered":"2024-03-04T08:52:32.853179+0000","last_clean":"2024-03-04T08:52:32.853179+0000","last_became_active":"2024-03-04T08:52:30.838579+0000","last_became_peered":"2024-03-04T08:52:30.838579+0000","last_unstale":"2024-03-04T08:52:32.853179+0000","last_undegraded":"2024-03-04T08:52:32.853179+0000","last_fullsized":"2024-03-04T08:52:32.853179+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:35.178351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855581+0000","last_change":"2024-03-04T08:52:31.851937+0000","last_active":"2024-03-04T08:52:31.855581+0000","last_peered":"2024-03-04T08:52:31.855581+0000","last_clean":"2024-03-04T08:52:31.855581+0000","last_became_active":"2024-03-04T08:52:31.850887+0000","last_became_peered":"2024-03-04T08:52:31.850887+0000","last_unstale":"2024-03-04T08:52:31.855581+0000","last_undegraded":"2024-03-04T08:52:31.855581+0000","last_fullsized":"2024-03-04T08:52:31.855581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:02:54.190992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841140+0000","last_change":"2024-03-04T08:52:30.847745+0000","last_active":"2024-03-04T08:52:31.841140+0000","last_peered":"2024-03-04T08:52:31.841140+0000","last_clean":"2024-03-04T08:52:31.841140+0000","last_became_active":"2024-03-04T08:52:30.847474+0000","last_became_peered":"2024-03-04T08:52:30.847474+0000","last_unstale":"2024-03-04T08:52:31.841140+0000","last_undegraded":"2024-03-04T08:52:31.841140+0000","last_fullsized":"2024-03-04T08:52:31.841140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:14.193540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857175+0000","last_change":"2024-03-04T08:52:31.851391+0000","last_active":"2024-03-04T08:52:31.857175+0000","last_peered":"2024-03-04T08:52:31.857175+0000","last_clean":"2024-03-04T08:52:31.857175+0000","last_became_active":"2024-03-04T08:52:31.851119+0000","last_became_peered":"2024-03-04T08:52:31.851119+0000","last_unstale":"2024-03-04T08:52:31.857175+0000","last_undegraded":"2024-03-04T08:52:31.857175+0000","last_fullsized":"2024-03-04T08:52:31.857175+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:59.092037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.846767+0000","last_change":"2024-03-04T08:52:30.840416+0000","last_active":"2024-03-04T08:52:31.846767+0000","last_peered":"2024-03-04T08:52:31.846767+0000","last_clean":"2024-03-04T08:52:31.846767+0000","last_became_active":"2024-03-04T08:52:30.840158+0000","last_became_peered":"2024-03-04T08:52:30.840158+0000","last_unstale":"2024-03-04T08:52:31.846767+0000","last_undegraded":"2024-03-04T08:52:31.846767+0000","last_fullsized":"2024-03-04T08:52:31.846767+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:19:36.080598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841209+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:52:31.841209+0000","last_peered":"2024-03-04T08:52:31.841209+0000","last_clean":"2024-03-04T08:52:31.841209+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:52:31.841209+0000","last_undegraded":"2024-03-04T08:52:31.841209+0000","last_fullsized":"2024-03-04T08:52:31.841209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":816100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":233159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":225732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":234141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":816100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":239389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":238967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:52:35.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:52:36.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 Processor -- start 2024-03-04T08:52:36.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 -- start start 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ec00ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00d0910 con 0x7f9ec015bb20 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0161980 con 0x7f9ec00cfff0 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.072+0000 7f9ec6a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00d2500 con 0x7f9ec00d04a0 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9ec015bb20 0x7f9ec00d1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45006/0 (socket says 172.21.15.19:45006) 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebffff640 1 -- 172.21.15.19:0/551371543 learned_addr learned my addr 172.21.15.19:0/551371543 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933963596 0 0) 0x7f9ec00d0910 con 0x7f9ec015bb20 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea8003520 con 0x7f9ec015bb20 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ec4fab640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ec00ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685415862 0 0) 0x7f9ea8003520 con 0x7f9ec015bb20 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 msgr2=0x7f9ec00ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ec00ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 >> v1:172.21.15.204:6789/0 conn(0x7f9ec00cfff0 legacy=0x7f9ec00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0161c60 con 0x7f9ec015bb20 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f9eb0001670 con 0x7f9ec015bb20 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 >> v1:172.21.15.19:6789/0 conn(0x7f9ec015bb20 legacy=0x7f9ec00d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ea80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ea8003f20 0x7f9ea8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8004d40 0x7f9ea80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00d2500 con 0x7f9ea8003f20 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea800ba20 con 0x7f9ea8004d40 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea800bc20 con 0x7f9ec00d04a0 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ea8003f20 0x7f9ea8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ebffff640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ea80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.073+0000 7f9ec4fab640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8004d40 0x7f9ea80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 -- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 msgr2=0x7f9ea80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00d04a0 0x7f9ea80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 -- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8004d40 msgr2=0x7f9ea80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8004d40 0x7f9ea80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 -- 172.21.15.19:0/551371543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8003520 con 0x7f9ea8003f20 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.074+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ea8003f20 0x7f9ea8004800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4001860 tx=0x7f9ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae6eee0d2ff41d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4001430 con 0x7f9ea8003f20 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4032620 con 0x7f9ea8003f20 2024-03-04T08:52:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ebeffd640 1 -- 172.21.15.19:0/551371543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4032a10 con 0x7f9ea8003f20 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/551371543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ea8003f20 msgr2=0x7f9ea8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/551371543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ea8003f20 0x7f9ea8004800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4001860 tx=0x7f9ea8005830 comp rx=0 tx=0).stop 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec4fab640 1 -- 172.21.15.19:0/551371543 reap_dead start 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/551371543 shutdown_connections 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/551371543 >> 172.21.15.19:0/551371543 conn(0x7f9ec009a9f0 msgr2=0x7f9ec009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/551371543 shutdown_connections 2024-03-04T08:52:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.075+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/551371543 wait complete. 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.076+0000 7f9ec6a0e640 1 Processor -- start 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 -- start start 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 0x7f9ec014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 0x7f9ec0159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0162500 con 0x7f9ec00cd900 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0162220 con 0x7f9ea8003f20 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec6a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00d1980 con 0x7f9ec00b4650 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec4fab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec4fab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49672/0 (socket says 172.21.15.19:49672) 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ec4fab640 1 -- 172.21.15.19:0/2428528384 learned_addr learned my addr 172.21.15.19:0/2428528384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.077+0000 7f9ebffff640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 0x7f9ec014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 0x7f9ec0159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 -- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 msgr2=0x7f9ec0159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 0x7f9ec0159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 -- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 msgr2=0x7f9ec014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 0x7f9ec014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 -- 172.21.15.19:0/2428528384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00b4bf0 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebf7fe640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 0x7f9ec0159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebffff640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 0x7f9ec014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec4fab640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00cf5e0 tx=0x7f9eb800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800fd80 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb801d070 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00b4ed0 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8015670 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.078+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00b5490 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.079+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec00ce2c0 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.080+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9eb8015810 con 0x7f9ec00cd900 2024-03-04T08:52:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.080+0000 7f9ebcff9640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 0x7f9eac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.080+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eb808ab30 con 0x7f9ec00cd900 2024-03-04T08:52:36.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.080+0000 7f9ebffff640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 0x7f9eac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.081+0000 7f9ebffff640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 0x7f9eac06d9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0001050 tx=0x7f9eb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.084+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9eb8010040 con 0x7f9ec00cd900 2024-03-04T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.302+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ec004f330 con 0x7f9eac06b500 2024-03-04T08:52:36.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.309+0000 7f9ebcff9640 1 -- 172.21.15.19:0/2428528384 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251902 (secure 0 0 0) 0x7f9ec004f330 con 0x7f9eac06b500 2024-03-04T08:52:36.308 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:36.310 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 msgr2=0x7f9eac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 0x7f9eac06d9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0001050 tx=0x7f9eb0009040 comp rx=0 tx=0).stop 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 msgr2=0x7f9ec00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00cf5e0 tx=0x7f9eb800f580 comp rx=0 tx=0).stop 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 shutdown_connections 2024-03-04T08:52:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ec00cd900 0x7f9ec00cdd80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9ec00b4650 0x7f9ec0159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9eac06b500 0x7f9eac06d9c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 --2- 172.21.15.19:0/2428528384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9ea8003f20 0x7f9ec014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 >> 172.21.15.19:0/2428528384 conn(0x7f9ec009a9f0 msgr2=0x7f9ec00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 shutdown_connections 2024-03-04T08:52:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.312+0000 7f9ec6a0e640 1 -- 172.21.15.19:0/2428528384 wait complete. 2024-03-04T08:52:36.319 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-03-04T08:52:35.164593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230068,"kb_used_data":5568,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744652,"statfs":{"total":773094113280,"available":772858523648,"internally_reserved":0,"allocated":5701632,"data_stored":3036095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.338406"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851865+0000","last_change":"2024-03-04T08:52:31.851980+0000","last_active":"2024-03-04T08:52:32.851865+0000","last_peered":"2024-03-04T08:52:32.851865+0000","last_clean":"2024-03-04T08:52:32.851865+0000","last_became_active":"2024-03-04T08:52:31.851665+0000","last_became_peered":"2024-03-04T08:52:31.851665+0000","last_unstale":"2024-03-04T08:52:32.851865+0000","last_undegraded":"2024-03-04T08:52:32.851865+0000","last_fullsized":"2024-03-04T08:52:32.851865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:37.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856914+0000","last_change":"2024-03-04T08:52:31.852613+0000","last_active":"2024-03-04T08:52:31.856914+0000","last_peered":"2024-03-04T08:52:31.856914+0000","last_clean":"2024-03-04T08:52:31.856914+0000","last_became_active":"2024-03-04T08:52:31.852146+0000","last_became_peered":"2024-03-04T08:52:31.852146+0000","last_unstale":"2024-03-04T08:52:31.856914+0000","last_undegraded":"2024-03-04T08:52:31.856914+0000","last_fullsized":"2024-03-04T08:52:31.856914+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:14.911748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868934+0000","last_change":"2024-03-04T08:52:31.861686+0000","last_active":"2024-03-04T08:52:31.868934+0000","last_peered":"2024-03-04T08:52:31.868934+0000","last_clean":"2024-03-04T08:52:31.868934+0000","last_became_active":"2024-03-04T08:52:31.860973+0000","last_became_peered":"2024-03-04T08:52:31.860973+0000","last_unstale":"2024-03-04T08:52:31.868934+0000","last_undegraded":"2024-03-04T08:52:31.868934+0000","last_fullsized":"2024-03-04T08:52:31.868934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857019+0000","last_change":"2024-03-04T08:52:31.852454+0000","last_active":"2024-03-04T08:52:31.857019+0000","last_peered":"2024-03-04T08:52:31.857019+0000","last_clean":"2024-03-04T08:52:31.857019+0000","last_became_active":"2024-03-04T08:52:31.852169+0000","last_became_peered":"2024-03-04T08:52:31.852169+0000","last_unstale":"2024-03-04T08:52:31.857019+0000","last_undegraded":"2024-03-04T08:52:31.857019+0000","last_fullsized":"2024-03-04T08:52:31.857019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:46.743794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853552+0000","last_change":"2024-03-04T08:52:31.850716+0000","last_active":"2024-03-04T08:52:32.853552+0000","last_peered":"2024-03-04T08:52:32.853552+0000","last_clean":"2024-03-04T08:52:32.853552+0000","last_became_active":"2024-03-04T08:52:31.850424+0000","last_became_peered":"2024-03-04T08:52:31.850424+0000","last_unstale":"2024-03-04T08:52:32.853552+0000","last_undegraded":"2024-03-04T08:52:32.853552+0000","last_fullsized":"2024-03-04T08:52:32.853552+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:45.936103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851919+0000","last_change":"2024-03-04T08:52:31.851610+0000","last_active":"2024-03-04T08:52:32.851919+0000","last_peered":"2024-03-04T08:52:32.851919+0000","last_clean":"2024-03-04T08:52:32.851919+0000","last_became_active":"2024-03-04T08:52:31.851348+0000","last_became_peered":"2024-03-04T08:52:31.851348+0000","last_unstale":"2024-03-04T08:52:32.851919+0000","last_undegraded":"2024-03-04T08:52:32.851919+0000","last_fullsized":"2024-03-04T08:52:32.851919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:47.591221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867760+0000","last_change":"2024-03-04T08:52:31.860910+0000","last_active":"2024-03-04T08:52:31.867760+0000","last_peered":"2024-03-04T08:52:31.867760+0000","last_clean":"2024-03-04T08:52:31.867760+0000","last_became_active":"2024-03-04T08:52:31.860621+0000","last_became_peered":"2024-03-04T08:52:31.860621+0000","last_unstale":"2024-03-04T08:52:31.867760+0000","last_undegraded":"2024-03-04T08:52:31.867760+0000","last_fullsized":"2024-03-04T08:52:31.867760+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:12.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855191+0000","last_change":"2024-03-04T08:52:31.849510+0000","last_active":"2024-03-04T08:52:31.855191+0000","last_peered":"2024-03-04T08:52:31.855191+0000","last_clean":"2024-03-04T08:52:31.855191+0000","last_became_active":"2024-03-04T08:52:31.849252+0000","last_became_peered":"2024-03-04T08:52:31.849252+0000","last_unstale":"2024-03-04T08:52:31.855191+0000","last_undegraded":"2024-03-04T08:52:31.855191+0000","last_fullsized":"2024-03-04T08:52:31.855191+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:55.639131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855204+0000","last_change":"2024-03-04T08:52:31.850359+0000","last_active":"2024-03-04T08:52:31.855204+0000","last_peered":"2024-03-04T08:52:31.855204+0000","last_clean":"2024-03-04T08:52:31.855204+0000","last_became_active":"2024-03-04T08:52:31.850086+0000","last_became_peered":"2024-03-04T08:52:31.850086+0000","last_unstale":"2024-03-04T08:52:31.855204+0000","last_undegraded":"2024-03-04T08:52:31.855204+0000","last_fullsized":"2024-03-04T08:52:31.855204+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:20.638670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852074+0000","last_change":"2024-03-04T08:52:31.847842+0000","last_active":"2024-03-04T08:52:32.852074+0000","last_peered":"2024-03-04T08:52:32.852074+0000","last_clean":"2024-03-04T08:52:32.852074+0000","last_became_active":"2024-03-04T08:52:31.847576+0000","last_became_peered":"2024-03-04T08:52:31.847576+0000","last_unstale":"2024-03-04T08:52:32.852074+0000","last_undegraded":"2024-03-04T08:52:32.852074+0000","last_fullsized":"2024-03-04T08:52:32.852074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:29:47.691636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856684+0000","last_change":"2024-03-04T08:52:31.853147+0000","last_active":"2024-03-04T08:52:31.856684+0000","last_peered":"2024-03-04T08:52:31.856684+0000","last_clean":"2024-03-04T08:52:31.856684+0000","last_became_active":"2024-03-04T08:52:31.852835+0000","last_became_peered":"2024-03-04T08:52:31.852835+0000","last_unstale":"2024-03-04T08:52:31.856684+0000","last_undegraded":"2024-03-04T08:52:31.856684+0000","last_fullsized":"2024-03-04T08:52:31.856684+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:24:25.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857245+0000","last_change":"2024-03-04T08:52:31.854851+0000","last_active":"2024-03-04T08:52:31.857245+0000","last_peered":"2024-03-04T08:52:31.857245+0000","last_clean":"2024-03-04T08:52:31.857245+0000","last_became_active":"2024-03-04T08:52:31.853962+0000","last_became_peered":"2024-03-04T08:52:31.853962+0000","last_unstale":"2024-03-04T08:52:31.857245+0000","last_undegraded":"2024-03-04T08:52:31.857245+0000","last_fullsized":"2024-03-04T08:52:31.857245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:26.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851852+0000","last_change":"2024-03-04T08:52:31.850001+0000","last_active":"2024-03-04T08:52:32.851852+0000","last_peered":"2024-03-04T08:52:32.851852+0000","last_clean":"2024-03-04T08:52:32.851852+0000","last_became_active":"2024-03-04T08:52:31.849720+0000","last_became_peered":"2024-03-04T08:52:31.849720+0000","last_unstale":"2024-03-04T08:52:32.851852+0000","last_undegraded":"2024-03-04T08:52:32.851852+0000","last_fullsized":"2024-03-04T08:52:32.851852+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:32.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868971+0000","last_change":"2024-03-04T08:52:31.863033+0000","last_active":"2024-03-04T08:52:31.868971+0000","last_peered":"2024-03-04T08:52:31.868971+0000","last_clean":"2024-03-04T08:52:31.868971+0000","last_became_active":"2024-03-04T08:52:31.861121+0000","last_became_peered":"2024-03-04T08:52:31.861121+0000","last_unstale":"2024-03-04T08:52:31.868971+0000","last_undegraded":"2024-03-04T08:52:31.868971+0000","last_fullsized":"2024-03-04T08:52:31.868971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:05.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856885+0000","last_change":"2024-03-04T08:52:31.850690+0000","last_active":"2024-03-04T08:52:31.856885+0000","last_peered":"2024-03-04T08:52:31.856885+0000","last_clean":"2024-03-04T08:52:31.856885+0000","last_became_active":"2024-03-04T08:52:31.850372+0000","last_became_peered":"2024-03-04T08:52:31.850372+0000","last_unstale":"2024-03-04T08:52:31.856885+0000","last_undegraded":"2024-03-04T08:52:31.856885+0000","last_fullsized":"2024-03-04T08:52:31.856885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851764+0000","last_change":"2024-03-04T08:52:31.850120+0000","last_active":"2024-03-04T08:52:32.851764+0000","last_peered":"2024-03-04T08:52:32.851764+0000","last_clean":"2024-03-04T08:52:32.851764+0000","last_became_active":"2024-03-04T08:52:31.849790+0000","last_became_peered":"2024-03-04T08:52:31.849790+0000","last_unstale":"2024-03-04T08:52:32.851764+0000","last_undegraded":"2024-03-04T08:52:32.851764+0000","last_fullsized":"2024-03-04T08:52:32.851764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:05:45.936103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861340+0000","last_change":"2024-03-04T08:52:31.854125+0000","last_active":"2024-03-04T08:52:31.861340+0000","last_peered":"2024-03-04T08:52:31.861340+0000","last_clean":"2024-03-04T08:52:31.861340+0000","last_became_active":"2024-03-04T08:52:31.853773+0000","last_became_peered":"2024-03-04T08:52:31.853773+0000","last_unstale":"2024-03-04T08:52:31.861340+0000","last_undegraded":"2024-03-04T08:52:31.861340+0000","last_fullsized":"2024-03-04T08:52:31.861340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:15.197924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857071+0000","last_change":"2024-03-04T08:52:31.852783+0000","last_active":"2024-03-04T08:52:31.857071+0000","last_peered":"2024-03-04T08:52:31.857071+0000","last_clean":"2024-03-04T08:52:31.857071+0000","last_became_active":"2024-03-04T08:52:31.852128+0000","last_became_peered":"2024-03-04T08:52:31.852128+0000","last_unstale":"2024-03-04T08:52:31.857071+0000","last_undegraded":"2024-03-04T08:52:31.857071+0000","last_fullsized":"2024-03-04T08:52:31.857071+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:42.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860806+0000","last_change":"2024-03-04T08:52:31.849149+0000","last_active":"2024-03-04T08:52:31.860806+0000","last_peered":"2024-03-04T08:52:31.860806+0000","last_clean":"2024-03-04T08:52:31.860806+0000","last_became_active":"2024-03-04T08:52:31.848849+0000","last_became_peered":"2024-03-04T08:52:31.848849+0000","last_unstale":"2024-03-04T08:52:31.860806+0000","last_undegraded":"2024-03-04T08:52:31.860806+0000","last_fullsized":"2024-03-04T08:52:31.860806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:30:49.098468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859647+0000","last_change":"2024-03-04T08:52:31.856508+0000","last_active":"2024-03-04T08:52:31.859647+0000","last_peered":"2024-03-04T08:52:31.859647+0000","last_clean":"2024-03-04T08:52:31.859647+0000","last_became_active":"2024-03-04T08:52:31.855625+0000","last_became_peered":"2024-03-04T08:52:31.855625+0000","last_unstale":"2024-03-04T08:52:31.859647+0000","last_undegraded":"2024-03-04T08:52:31.859647+0000","last_fullsized":"2024-03-04T08:52:31.859647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:06:34.696214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859421+0000","last_change":"2024-03-04T08:52:31.855131+0000","last_active":"2024-03-04T08:52:31.859421+0000","last_peered":"2024-03-04T08:52:31.859421+0000","last_clean":"2024-03-04T08:52:31.859421+0000","last_became_active":"2024-03-04T08:52:31.854846+0000","last_became_peered":"2024-03-04T08:52:31.854846+0000","last_unstale":"2024-03-04T08:52:31.859421+0000","last_undegraded":"2024-03-04T08:52:31.859421+0000","last_fullsized":"2024-03-04T08:52:31.859421+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:04.671291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855225+0000","last_change":"2024-03-04T08:52:31.850280+0000","last_active":"2024-03-04T08:52:31.855225+0000","last_peered":"2024-03-04T08:52:31.855225+0000","last_clean":"2024-03-04T08:52:31.855225+0000","last_became_active":"2024-03-04T08:52:31.849983+0000","last_became_peered":"2024-03-04T08:52:31.849983+0000","last_unstale":"2024-03-04T08:52:31.855225+0000","last_undegraded":"2024-03-04T08:52:31.855225+0000","last_fullsized":"2024-03-04T08:52:31.855225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:43:32.949042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.853349+0000","last_change":"2024-03-04T08:52:31.852340+0000","last_active":"2024-03-04T08:52:31.853349+0000","last_peered":"2024-03-04T08:52:31.853349+0000","last_clean":"2024-03-04T08:52:31.853349+0000","last_became_active":"2024-03-04T08:52:31.852081+0000","last_became_peered":"2024-03-04T08:52:31.852081+0000","last_unstale":"2024-03-04T08:52:31.853349+0000","last_undegraded":"2024-03-04T08:52:31.853349+0000","last_fullsized":"2024-03-04T08:52:31.853349+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:07:47.073889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860753+0000","last_change":"2024-03-04T08:52:31.851498+0000","last_active":"2024-03-04T08:52:31.860753+0000","last_peered":"2024-03-04T08:52:31.860753+0000","last_clean":"2024-03-04T08:52:31.860753+0000","last_became_active":"2024-03-04T08:52:31.851224+0000","last_became_peered":"2024-03-04T08:52:31.851224+0000","last_unstale":"2024-03-04T08:52:31.860753+0000","last_undegraded":"2024-03-04T08:52:31.860753+0000","last_fullsized":"2024-03-04T08:52:31.860753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:09.095775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861360+0000","last_change":"2024-03-04T08:52:31.857169+0000","last_active":"2024-03-04T08:52:31.861360+0000","last_peered":"2024-03-04T08:52:31.861360+0000","last_clean":"2024-03-04T08:52:31.861360+0000","last_became_active":"2024-03-04T08:52:31.856483+0000","last_became_peered":"2024-03-04T08:52:31.856483+0000","last_unstale":"2024-03-04T08:52:31.861360+0000","last_undegraded":"2024-03-04T08:52:31.861360+0000","last_fullsized":"2024-03-04T08:52:31.861360+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:08.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845938+0000","last_change":"2024-03-04T08:52:31.844370+0000","last_active":"2024-03-04T08:52:31.845938+0000","last_peered":"2024-03-04T08:52:31.845938+0000","last_clean":"2024-03-04T08:52:31.845938+0000","last_became_active":"2024-03-04T08:52:31.844099+0000","last_became_peered":"2024-03-04T08:52:31.844099+0000","last_unstale":"2024-03-04T08:52:31.845938+0000","last_undegraded":"2024-03-04T08:52:31.845938+0000","last_fullsized":"2024-03-04T08:52:31.845938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:46.044163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852186+0000","last_change":"2024-03-04T08:52:31.857429+0000","last_active":"2024-03-04T08:52:32.852186+0000","last_peered":"2024-03-04T08:52:32.852186+0000","last_clean":"2024-03-04T08:52:32.852186+0000","last_became_active":"2024-03-04T08:52:31.856791+0000","last_became_peered":"2024-03-04T08:52:31.856791+0000","last_unstale":"2024-03-04T08:52:32.852186+0000","last_undegraded":"2024-03-04T08:52:32.852186+0000","last_fullsized":"2024-03-04T08:52:32.852186+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:13:17.481005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859712+0000","last_change":"2024-03-04T08:52:31.856795+0000","last_active":"2024-03-04T08:52:31.859712+0000","last_peered":"2024-03-04T08:52:31.859712+0000","last_clean":"2024-03-04T08:52:31.859712+0000","last_became_active":"2024-03-04T08:52:31.856021+0000","last_became_peered":"2024-03-04T08:52:31.856021+0000","last_unstale":"2024-03-04T08:52:31.859712+0000","last_undegraded":"2024-03-04T08:52:31.859712+0000","last_fullsized":"2024-03-04T08:52:31.859712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:07.493674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861029+0000","last_change":"2024-03-04T08:52:31.856419+0000","last_active":"2024-03-04T08:52:31.861029+0000","last_peered":"2024-03-04T08:52:31.861029+0000","last_clean":"2024-03-04T08:52:31.861029+0000","last_became_active":"2024-03-04T08:52:31.856155+0000","last_became_peered":"2024-03-04T08:52:31.856155+0000","last_unstale":"2024-03-04T08:52:31.861029+0000","last_undegraded":"2024-03-04T08:52:31.861029+0000","last_fullsized":"2024-03-04T08:52:31.861029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:44.622733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859339+0000","last_change":"2024-03-04T08:52:31.855456+0000","last_active":"2024-03-04T08:52:31.859339+0000","last_peered":"2024-03-04T08:52:31.859339+0000","last_clean":"2024-03-04T08:52:31.859339+0000","last_became_active":"2024-03-04T08:52:31.855180+0000","last_became_peered":"2024-03-04T08:52:31.855180+0000","last_unstale":"2024-03-04T08:52:31.859339+0000","last_undegraded":"2024-03-04T08:52:31.859339+0000","last_fullsized":"2024-03-04T08:52:31.859339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:52.058744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861069+0000","last_change":"2024-03-04T08:52:31.853910+0000","last_active":"2024-03-04T08:52:31.861069+0000","last_peered":"2024-03-04T08:52:31.861069+0000","last_clean":"2024-03-04T08:52:31.861069+0000","last_became_active":"2024-03-04T08:52:31.851937+0000","last_became_peered":"2024-03-04T08:52:31.851937+0000","last_unstale":"2024-03-04T08:52:31.861069+0000","last_undegraded":"2024-03-04T08:52:31.861069+0000","last_fullsized":"2024-03-04T08:52:31.861069+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:57.478024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.850575+0000","last_change":"2024-03-04T08:52:31.847128+0000","last_active":"2024-03-04T08:52:31.850575+0000","last_peered":"2024-03-04T08:52:31.850575+0000","last_clean":"2024-03-04T08:52:31.850575+0000","last_became_active":"2024-03-04T08:52:31.846816+0000","last_became_peered":"2024-03-04T08:52:31.846816+0000","last_unstale":"2024-03-04T08:52:31.850575+0000","last_undegraded":"2024-03-04T08:52:31.850575+0000","last_fullsized":"2024-03-04T08:52:31.850575+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:55.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857119+0000","last_change":"2024-03-04T08:52:31.851226+0000","last_active":"2024-03-04T08:52:31.857119+0000","last_peered":"2024-03-04T08:52:31.857119+0000","last_clean":"2024-03-04T08:52:31.857119+0000","last_became_active":"2024-03-04T08:52:31.849872+0000","last_became_peered":"2024-03-04T08:52:31.849872+0000","last_unstale":"2024-03-04T08:52:31.857119+0000","last_undegraded":"2024-03-04T08:52:31.857119+0000","last_fullsized":"2024-03-04T08:52:31.857119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:05.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867293+0000","last_change":"2024-03-04T08:52:30.840766+0000","last_active":"2024-03-04T08:52:31.867293+0000","last_peered":"2024-03-04T08:52:31.867293+0000","last_clean":"2024-03-04T08:52:31.867293+0000","last_became_active":"2024-03-04T08:52:30.840479+0000","last_became_peered":"2024-03-04T08:52:30.840479+0000","last_unstale":"2024-03-04T08:52:31.867293+0000","last_undegraded":"2024-03-04T08:52:31.867293+0000","last_fullsized":"2024-03-04T08:52:31.867293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:27.346914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856638+0000","last_change":"2024-03-04T08:52:31.852068+0000","last_active":"2024-03-04T08:52:31.856638+0000","last_peered":"2024-03-04T08:52:31.856638+0000","last_clean":"2024-03-04T08:52:31.856638+0000","last_became_active":"2024-03-04T08:52:31.851711+0000","last_became_peered":"2024-03-04T08:52:31.851711+0000","last_unstale":"2024-03-04T08:52:31.856638+0000","last_undegraded":"2024-03-04T08:52:31.856638+0000","last_fullsized":"2024-03-04T08:52:31.856638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:08.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852130+0000","last_change":"2024-03-04T08:52:30.847952+0000","last_active":"2024-03-04T08:52:32.852130+0000","last_peered":"2024-03-04T08:52:32.852130+0000","last_clean":"2024-03-04T08:52:32.852130+0000","last_became_active":"2024-03-04T08:52:30.847661+0000","last_became_peered":"2024-03-04T08:52:30.847661+0000","last_unstale":"2024-03-04T08:52:32.852130+0000","last_undegraded":"2024-03-04T08:52:32.852130+0000","last_fullsized":"2024-03-04T08:52:32.852130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:47.563843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859482+0000","last_change":"2024-03-04T08:52:31.855115+0000","last_active":"2024-03-04T08:52:31.859482+0000","last_peered":"2024-03-04T08:52:31.859482+0000","last_clean":"2024-03-04T08:52:31.859482+0000","last_became_active":"2024-03-04T08:52:31.854810+0000","last_became_peered":"2024-03-04T08:52:31.854810+0000","last_unstale":"2024-03-04T08:52:31.859482+0000","last_undegraded":"2024-03-04T08:52:31.859482+0000","last_fullsized":"2024-03-04T08:52:31.859482+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:10.253458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852240+0000","last_change":"2024-03-04T08:52:30.850036+0000","last_active":"2024-03-04T08:52:32.852240+0000","last_peered":"2024-03-04T08:52:32.852240+0000","last_clean":"2024-03-04T08:52:32.852240+0000","last_became_active":"2024-03-04T08:52:30.849678+0000","last_became_peered":"2024-03-04T08:52:30.849678+0000","last_unstale":"2024-03-04T08:52:32.852240+0000","last_undegraded":"2024-03-04T08:52:32.852240+0000","last_fullsized":"2024-03-04T08:52:32.852240+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:42.953327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.856351+0000","last_change":"2024-03-04T08:52:31.852547+0000","last_active":"2024-03-04T08:52:31.856351+0000","last_peered":"2024-03-04T08:52:31.856351+0000","last_clean":"2024-03-04T08:52:31.856351+0000","last_became_active":"2024-03-04T08:52:31.852247+0000","last_became_peered":"2024-03-04T08:52:31.852247+0000","last_unstale":"2024-03-04T08:52:31.856351+0000","last_undegraded":"2024-03-04T08:52:31.856351+0000","last_fullsized":"2024-03-04T08:52:31.856351+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:02:32.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867875+0000","last_change":"2024-03-04T08:52:30.839012+0000","last_active":"2024-03-04T08:52:31.867875+0000","last_peered":"2024-03-04T08:52:31.867875+0000","last_clean":"2024-03-04T08:52:31.867875+0000","last_became_active":"2024-03-04T08:52:30.838661+0000","last_became_peered":"2024-03-04T08:52:30.838661+0000","last_unstale":"2024-03-04T08:52:31.867875+0000","last_undegraded":"2024-03-04T08:52:31.867875+0000","last_fullsized":"2024-03-04T08:52:31.867875+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:56.473641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853750+0000","last_change":"2024-03-04T08:52:31.847700+0000","last_active":"2024-03-04T08:52:32.853750+0000","last_peered":"2024-03-04T08:52:32.853750+0000","last_clean":"2024-03-04T08:52:32.853750+0000","last_became_active":"2024-03-04T08:52:31.847376+0000","last_became_peered":"2024-03-04T08:52:31.847376+0000","last_unstale":"2024-03-04T08:52:32.853750+0000","last_undegraded":"2024-03-04T08:52:32.853750+0000","last_fullsized":"2024-03-04T08:52:32.853750+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:37.071730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.870747+0000","last_change":"2024-03-04T08:52:30.845450+0000","last_active":"2024-03-04T08:52:31.870747+0000","last_peered":"2024-03-04T08:52:31.870747+0000","last_clean":"2024-03-04T08:52:31.870747+0000","last_became_active":"2024-03-04T08:52:30.845005+0000","last_became_peered":"2024-03-04T08:52:30.845005+0000","last_unstale":"2024-03-04T08:52:31.870747+0000","last_undegraded":"2024-03-04T08:52:31.870747+0000","last_fullsized":"2024-03-04T08:52:31.870747+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:40.863152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859401+0000","last_change":"2024-03-04T08:52:31.855982+0000","last_active":"2024-03-04T08:52:31.859401+0000","last_peered":"2024-03-04T08:52:31.859401+0000","last_clean":"2024-03-04T08:52:31.859401+0000","last_became_active":"2024-03-04T08:52:31.855716+0000","last_became_peered":"2024-03-04T08:52:31.855716+0000","last_unstale":"2024-03-04T08:52:31.859401+0000","last_undegraded":"2024-03-04T08:52:31.859401+0000","last_fullsized":"2024-03-04T08:52:31.859401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:41.698142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853264+0000","last_change":"2024-03-04T08:52:30.843158+0000","last_active":"2024-03-04T08:52:32.853264+0000","last_peered":"2024-03-04T08:52:32.853264+0000","last_clean":"2024-03-04T08:52:32.853264+0000","last_became_active":"2024-03-04T08:52:30.842858+0000","last_became_peered":"2024-03-04T08:52:30.842858+0000","last_unstale":"2024-03-04T08:52:32.853264+0000","last_undegraded":"2024-03-04T08:52:32.853264+0000","last_fullsized":"2024-03-04T08:52:32.853264+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:26:58.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845193+0000","last_change":"2024-03-04T08:52:31.843648+0000","last_active":"2024-03-04T08:52:31.845193+0000","last_peered":"2024-03-04T08:52:31.845193+0000","last_clean":"2024-03-04T08:52:31.845193+0000","last_became_active":"2024-03-04T08:52:31.843334+0000","last_became_peered":"2024-03-04T08:52:31.843334+0000","last_unstale":"2024-03-04T08:52:31.845193+0000","last_undegraded":"2024-03-04T08:52:31.845193+0000","last_fullsized":"2024-03-04T08:52:31.845193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:56:35.022967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842992+0000","last_change":"2024-03-04T08:52:30.838155+0000","last_active":"2024-03-04T08:52:31.842992+0000","last_peered":"2024-03-04T08:52:31.842992+0000","last_clean":"2024-03-04T08:52:31.842992+0000","last_became_active":"2024-03-04T08:52:30.837659+0000","last_became_peered":"2024-03-04T08:52:30.837659+0000","last_unstale":"2024-03-04T08:52:31.842992+0000","last_undegraded":"2024-03-04T08:52:31.842992+0000","last_fullsized":"2024-03-04T08:52:31.842992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:08:35.918888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.866962+0000","last_change":"2024-03-04T08:52:31.863429+0000","last_active":"2024-03-04T08:52:31.866962+0000","last_peered":"2024-03-04T08:52:31.866962+0000","last_clean":"2024-03-04T08:52:31.866962+0000","last_became_active":"2024-03-04T08:52:31.863169+0000","last_became_peered":"2024-03-04T08:52:31.863169+0000","last_unstale":"2024-03-04T08:52:31.866962+0000","last_undegraded":"2024-03-04T08:52:31.866962+0000","last_fullsized":"2024-03-04T08:52:31.866962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:56:35.022967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.845287+0000","last_change":"2024-03-04T08:52:30.837258+0000","last_active":"2024-03-04T08:52:31.845287+0000","last_peered":"2024-03-04T08:52:31.845287+0000","last_clean":"2024-03-04T08:52:31.845287+0000","last_became_active":"2024-03-04T08:52:30.836962+0000","last_became_peered":"2024-03-04T08:52:30.836962+0000","last_unstale":"2024-03-04T08:52:31.845287+0000","last_undegraded":"2024-03-04T08:52:31.845287+0000","last_fullsized":"2024-03-04T08:52:31.845287+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:37:39.106059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853280+0000","last_change":"2024-03-04T08:52:31.847756+0000","last_active":"2024-03-04T08:52:32.853280+0000","last_peered":"2024-03-04T08:52:32.853280+0000","last_clean":"2024-03-04T08:52:32.853280+0000","last_became_active":"2024-03-04T08:52:31.847433+0000","last_became_peered":"2024-03-04T08:52:31.847433+0000","last_unstale":"2024-03-04T08:52:32.853280+0000","last_undegraded":"2024-03-04T08:52:32.853280+0000","last_fullsized":"2024-03-04T08:52:32.853280+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:28.091773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841862+0000","last_change":"2024-03-04T08:52:30.835758+0000","last_active":"2024-03-04T08:52:31.841862+0000","last_peered":"2024-03-04T08:52:31.841862+0000","last_clean":"2024-03-04T08:52:31.841862+0000","last_became_active":"2024-03-04T08:52:30.835458+0000","last_became_peered":"2024-03-04T08:52:30.835458+0000","last_unstale":"2024-03-04T08:52:31.841862+0000","last_undegraded":"2024-03-04T08:52:31.841862+0000","last_fullsized":"2024-03-04T08:52:31.841862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:43.618350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.851890+0000","last_change":"2024-03-04T08:52:31.848003+0000","last_active":"2024-03-04T08:52:31.851890+0000","last_peered":"2024-03-04T08:52:31.851890+0000","last_clean":"2024-03-04T08:52:31.851890+0000","last_became_active":"2024-03-04T08:52:31.847728+0000","last_became_peered":"2024-03-04T08:52:31.847728+0000","last_unstale":"2024-03-04T08:52:31.851890+0000","last_undegraded":"2024-03-04T08:52:31.851890+0000","last_fullsized":"2024-03-04T08:52:31.851890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:18:44.622733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853761+0000","last_change":"2024-03-04T08:52:30.845199+0000","last_active":"2024-03-04T08:52:32.853761+0000","last_peered":"2024-03-04T08:52:32.853761+0000","last_clean":"2024-03-04T08:52:32.853761+0000","last_became_active":"2024-03-04T08:52:30.844936+0000","last_became_peered":"2024-03-04T08:52:30.844936+0000","last_unstale":"2024-03-04T08:52:32.853761+0000","last_undegraded":"2024-03-04T08:52:32.853761+0000","last_fullsized":"2024-03-04T08:52:32.853761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:26.792989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860959+0000","last_change":"2024-03-04T08:52:31.857356+0000","last_active":"2024-03-04T08:52:31.860959+0000","last_peered":"2024-03-04T08:52:31.860959+0000","last_clean":"2024-03-04T08:52:31.860959+0000","last_became_active":"2024-03-04T08:52:31.856036+0000","last_became_peered":"2024-03-04T08:52:31.856036+0000","last_unstale":"2024-03-04T08:52:31.860959+0000","last_undegraded":"2024-03-04T08:52:31.860959+0000","last_fullsized":"2024-03-04T08:52:31.860959+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:26.476283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.864329+0000","last_change":"2024-03-04T08:52:30.850866+0000","last_active":"2024-03-04T08:52:31.864329+0000","last_peered":"2024-03-04T08:52:31.864329+0000","last_clean":"2024-03-04T08:52:31.864329+0000","last_became_active":"2024-03-04T08:52:30.850629+0000","last_became_peered":"2024-03-04T08:52:30.850629+0000","last_unstale":"2024-03-04T08:52:31.864329+0000","last_undegraded":"2024-03-04T08:52:31.864329+0000","last_fullsized":"2024-03-04T08:52:31.864329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:25.471900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853696+0000","last_change":"2024-03-04T08:52:31.850513+0000","last_active":"2024-03-04T08:52:32.853696+0000","last_peered":"2024-03-04T08:52:32.853696+0000","last_clean":"2024-03-04T08:52:32.853696+0000","last_became_active":"2024-03-04T08:52:31.850224+0000","last_became_peered":"2024-03-04T08:52:31.850224+0000","last_unstale":"2024-03-04T08:52:32.853696+0000","last_undegraded":"2024-03-04T08:52:32.853696+0000","last_fullsized":"2024-03-04T08:52:32.853696+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:32.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.872199+0000","last_change":"2024-03-04T08:52:30.839968+0000","last_active":"2024-03-04T08:52:31.872199+0000","last_peered":"2024-03-04T08:52:31.872199+0000","last_clean":"2024-03-04T08:52:31.872199+0000","last_became_active":"2024-03-04T08:52:30.839682+0000","last_became_peered":"2024-03-04T08:52:30.839682+0000","last_unstale":"2024-03-04T08:52:31.872199+0000","last_undegraded":"2024-03-04T08:52:31.872199+0000","last_fullsized":"2024-03-04T08:52:31.872199+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:45.739411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859353+0000","last_change":"2024-03-04T08:52:31.853783+0000","last_active":"2024-03-04T08:52:31.859353+0000","last_peered":"2024-03-04T08:52:31.859353+0000","last_clean":"2024-03-04T08:52:31.859353+0000","last_became_active":"2024-03-04T08:52:31.853448+0000","last_became_peered":"2024-03-04T08:52:31.853448+0000","last_unstale":"2024-03-04T08:52:31.859353+0000","last_undegraded":"2024-03-04T08:52:31.859353+0000","last_fullsized":"2024-03-04T08:52:31.859353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:53:26.476283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.874894+0000","last_change":"2024-03-04T08:52:30.840395+0000","last_active":"2024-03-04T08:52:31.874894+0000","last_peered":"2024-03-04T08:52:31.874894+0000","last_clean":"2024-03-04T08:52:31.874894+0000","last_became_active":"2024-03-04T08:52:30.840096+0000","last_became_peered":"2024-03-04T08:52:30.840096+0000","last_unstale":"2024-03-04T08:52:31.874894+0000","last_undegraded":"2024-03-04T08:52:31.874894+0000","last_fullsized":"2024-03-04T08:52:31.874894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:28.368601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860826+0000","last_change":"2024-03-04T08:52:31.854749+0000","last_active":"2024-03-04T08:52:31.860826+0000","last_peered":"2024-03-04T08:52:31.860826+0000","last_clean":"2024-03-04T08:52:31.860826+0000","last_became_active":"2024-03-04T08:52:31.848024+0000","last_became_peered":"2024-03-04T08:52:31.848024+0000","last_unstale":"2024-03-04T08:52:31.860826+0000","last_undegraded":"2024-03-04T08:52:31.860826+0000","last_fullsized":"2024-03-04T08:52:31.860826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:29:26.161883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.843914+0000","last_change":"2024-03-04T08:52:30.840571+0000","last_active":"2024-03-04T08:52:31.843914+0000","last_peered":"2024-03-04T08:52:31.843914+0000","last_clean":"2024-03-04T08:52:31.843914+0000","last_became_active":"2024-03-04T08:52:30.840305+0000","last_became_peered":"2024-03-04T08:52:30.840305+0000","last_unstale":"2024-03-04T08:52:31.843914+0000","last_undegraded":"2024-03-04T08:52:31.843914+0000","last_fullsized":"2024-03-04T08:52:31.843914+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:47.386046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.849654+0000","last_change":"2024-03-04T08:52:31.845697+0000","last_active":"2024-03-04T08:52:31.849654+0000","last_peered":"2024-03-04T08:52:31.849654+0000","last_clean":"2024-03-04T08:52:31.849654+0000","last_became_active":"2024-03-04T08:52:31.845429+0000","last_became_peered":"2024-03-04T08:52:31.845429+0000","last_unstale":"2024-03-04T08:52:31.849654+0000","last_undegraded":"2024-03-04T08:52:31.849654+0000","last_fullsized":"2024-03-04T08:52:31.849654+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:23.659723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842842+0000","last_change":"2024-03-04T08:52:30.839276+0000","last_active":"2024-03-04T08:52:31.842842+0000","last_peered":"2024-03-04T08:52:31.842842+0000","last_clean":"2024-03-04T08:52:31.842842+0000","last_became_active":"2024-03-04T08:52:30.838997+0000","last_became_peered":"2024-03-04T08:52:30.838997+0000","last_unstale":"2024-03-04T08:52:31.842842+0000","last_undegraded":"2024-03-04T08:52:31.842842+0000","last_fullsized":"2024-03-04T08:52:31.842842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:07.783884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861318+0000","last_change":"2024-03-04T08:52:31.852815+0000","last_active":"2024-03-04T08:52:31.861318+0000","last_peered":"2024-03-04T08:52:31.861318+0000","last_clean":"2024-03-04T08:52:31.861318+0000","last_became_active":"2024-03-04T08:52:31.852542+0000","last_became_peered":"2024-03-04T08:52:31.852542+0000","last_unstale":"2024-03-04T08:52:31.861318+0000","last_undegraded":"2024-03-04T08:52:31.861318+0000","last_fullsized":"2024-03-04T08:52:31.861318+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:08.592597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.867650+0000","last_change":"2024-03-04T08:52:30.840348+0000","last_active":"2024-03-04T08:52:31.867650+0000","last_peered":"2024-03-04T08:52:31.867650+0000","last_clean":"2024-03-04T08:52:31.867650+0000","last_became_active":"2024-03-04T08:52:30.839625+0000","last_became_peered":"2024-03-04T08:52:30.839625+0000","last_unstale":"2024-03-04T08:52:31.867650+0000","last_undegraded":"2024-03-04T08:52:31.867650+0000","last_fullsized":"2024-03-04T08:52:31.867650+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:51.054361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.853470+0000","last_change":"2024-03-04T08:52:31.847380+0000","last_active":"2024-03-04T08:52:31.853470+0000","last_peered":"2024-03-04T08:52:31.853470+0000","last_clean":"2024-03-04T08:52:31.853470+0000","last_became_active":"2024-03-04T08:52:31.847095+0000","last_became_peered":"2024-03-04T08:52:31.847095+0000","last_unstale":"2024-03-04T08:52:31.853470+0000","last_undegraded":"2024-03-04T08:52:31.853470+0000","last_fullsized":"2024-03-04T08:52:31.853470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:19:09.592279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.870606+0000","last_change":"2024-03-04T08:52:30.841049+0000","last_active":"2024-03-04T08:52:31.870606+0000","last_peered":"2024-03-04T08:52:31.870606+0000","last_clean":"2024-03-04T08:52:31.870606+0000","last_became_active":"2024-03-04T08:52:30.840702+0000","last_became_peered":"2024-03-04T08:52:30.840702+0000","last_unstale":"2024-03-04T08:52:31.870606+0000","last_undegraded":"2024-03-04T08:52:31.870606+0000","last_fullsized":"2024-03-04T08:52:31.870606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:51.838626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851771+0000","last_change":"2024-03-04T08:52:31.849184+0000","last_active":"2024-03-04T08:52:32.851771+0000","last_peered":"2024-03-04T08:52:32.851771+0000","last_clean":"2024-03-04T08:52:32.851771+0000","last_became_active":"2024-03-04T08:52:31.848908+0000","last_became_peered":"2024-03-04T08:52:31.848908+0000","last_unstale":"2024-03-04T08:52:32.851771+0000","last_undegraded":"2024-03-04T08:52:32.851771+0000","last_fullsized":"2024-03-04T08:52:32.851771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:00.385469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.868716+0000","last_change":"2024-03-04T08:52:30.842101+0000","last_active":"2024-03-04T08:52:31.868716+0000","last_peered":"2024-03-04T08:52:31.868716+0000","last_clean":"2024-03-04T08:52:31.868716+0000","last_became_active":"2024-03-04T08:52:30.841806+0000","last_became_peered":"2024-03-04T08:52:30.841806+0000","last_unstale":"2024-03-04T08:52:31.868716+0000","last_undegraded":"2024-03-04T08:52:31.868716+0000","last_fullsized":"2024-03-04T08:52:31.868716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:54.651399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853353+0000","last_change":"2024-03-04T08:52:31.855554+0000","last_active":"2024-03-04T08:52:32.853353+0000","last_peered":"2024-03-04T08:52:32.853353+0000","last_clean":"2024-03-04T08:52:32.853353+0000","last_became_active":"2024-03-04T08:52:31.855027+0000","last_became_peered":"2024-03-04T08:52:31.855027+0000","last_unstale":"2024-03-04T08:52:32.853353+0000","last_undegraded":"2024-03-04T08:52:32.853353+0000","last_fullsized":"2024-03-04T08:52:32.853353+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:00.385469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.866758+0000","last_change":"2024-03-04T08:52:30.849674+0000","last_active":"2024-03-04T08:52:31.866758+0000","last_peered":"2024-03-04T08:52:31.866758+0000","last_clean":"2024-03-04T08:52:31.866758+0000","last_became_active":"2024-03-04T08:52:30.849391+0000","last_became_peered":"2024-03-04T08:52:30.849391+0000","last_unstale":"2024-03-04T08:52:31.866758+0000","last_undegraded":"2024-03-04T08:52:31.866758+0000","last_fullsized":"2024-03-04T08:52:31.866758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:20:12.443105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852032+0000","last_change":"2024-03-04T08:52:31.852778+0000","last_active":"2024-03-04T08:52:32.852032+0000","last_peered":"2024-03-04T08:52:32.852032+0000","last_clean":"2024-03-04T08:52:32.852032+0000","last_became_active":"2024-03-04T08:52:31.852527+0000","last_became_peered":"2024-03-04T08:52:31.852527+0000","last_unstale":"2024-03-04T08:52:32.852032+0000","last_undegraded":"2024-03-04T08:52:32.852032+0000","last_fullsized":"2024-03-04T08:52:32.852032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:13.671352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.848370+0000","last_change":"2024-03-04T08:52:30.838837+0000","last_active":"2024-03-04T08:52:31.848370+0000","last_peered":"2024-03-04T08:52:31.848370+0000","last_clean":"2024-03-04T08:52:31.848370+0000","last_became_active":"2024-03-04T08:52:30.838557+0000","last_became_peered":"2024-03-04T08:52:30.838557+0000","last_unstale":"2024-03-04T08:52:31.848370+0000","last_undegraded":"2024-03-04T08:52:31.848370+0000","last_fullsized":"2024-03-04T08:52:31.848370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:26:01.284846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.849672+0000","last_change":"2024-03-04T08:52:31.844595+0000","last_active":"2024-03-04T08:52:31.849672+0000","last_peered":"2024-03-04T08:52:31.849672+0000","last_clean":"2024-03-04T08:52:31.849672+0000","last_became_active":"2024-03-04T08:52:31.844278+0000","last_became_peered":"2024-03-04T08:52:31.844278+0000","last_unstale":"2024-03-04T08:52:31.849672+0000","last_undegraded":"2024-03-04T08:52:31.849672+0000","last_fullsized":"2024-03-04T08:52:31.849672+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:29:26.161883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851971+0000","last_change":"2024-03-04T08:52:30.849609+0000","last_active":"2024-03-04T08:52:32.851971+0000","last_peered":"2024-03-04T08:52:32.851971+0000","last_clean":"2024-03-04T08:52:32.851971+0000","last_became_active":"2024-03-04T08:52:30.849244+0000","last_became_peered":"2024-03-04T08:52:30.849244+0000","last_unstale":"2024-03-04T08:52:32.851971+0000","last_undegraded":"2024-03-04T08:52:32.851971+0000","last_fullsized":"2024-03-04T08:52:32.851971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:54.301295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859393+0000","last_change":"2024-03-04T08:52:31.853052+0000","last_active":"2024-03-04T08:52:31.859393+0000","last_peered":"2024-03-04T08:52:31.859393+0000","last_clean":"2024-03-04T08:52:31.859393+0000","last_became_active":"2024-03-04T08:52:31.852794+0000","last_became_peered":"2024-03-04T08:52:31.852794+0000","last_unstale":"2024-03-04T08:52:31.859393+0000","last_undegraded":"2024-03-04T08:52:31.859393+0000","last_fullsized":"2024-03-04T08:52:31.859393+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.069534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.837275+0000","last_change":"2024-03-04T08:52:30.838735+0000","last_active":"2024-03-04T08:52:31.837275+0000","last_peered":"2024-03-04T08:52:31.837275+0000","last_clean":"2024-03-04T08:52:31.837275+0000","last_became_active":"2024-03-04T08:52:30.838419+0000","last_became_peered":"2024-03-04T08:52:30.838419+0000","last_unstale":"2024-03-04T08:52:31.837275+0000","last_undegraded":"2024-03-04T08:52:31.837275+0000","last_fullsized":"2024-03-04T08:52:31.837275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:41.576765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.861074+0000","last_change":"2024-03-04T08:52:31.854944+0000","last_active":"2024-03-04T08:52:31.861074+0000","last_peered":"2024-03-04T08:52:31.861074+0000","last_clean":"2024-03-04T08:52:31.861074+0000","last_became_active":"2024-03-04T08:52:31.854647+0000","last_became_peered":"2024-03-04T08:52:31.854647+0000","last_unstale":"2024-03-04T08:52:31.861074+0000","last_undegraded":"2024-03-04T08:52:31.861074+0000","last_fullsized":"2024-03-04T08:52:31.861074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:55.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.846058+0000","last_change":"2024-03-04T08:52:30.848120+0000","last_active":"2024-03-04T08:52:31.846058+0000","last_peered":"2024-03-04T08:52:31.846058+0000","last_clean":"2024-03-04T08:52:31.846058+0000","last_became_active":"2024-03-04T08:52:30.847824+0000","last_became_peered":"2024-03-04T08:52:30.847824+0000","last_unstale":"2024-03-04T08:52:31.846058+0000","last_undegraded":"2024-03-04T08:52:31.846058+0000","last_fullsized":"2024-03-04T08:52:31.846058+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:29.140598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.852030+0000","last_change":"2024-03-04T08:52:31.849037+0000","last_active":"2024-03-04T08:52:32.852030+0000","last_peered":"2024-03-04T08:52:32.852030+0000","last_clean":"2024-03-04T08:52:32.852030+0000","last_became_active":"2024-03-04T08:52:31.848222+0000","last_became_peered":"2024-03-04T08:52:31.848222+0000","last_unstale":"2024-03-04T08:52:32.852030+0000","last_undegraded":"2024-03-04T08:52:32.852030+0000","last_fullsized":"2024-03-04T08:52:32.852030+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:35.230045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.842304+0000","last_change":"2024-03-04T08:52:30.846239+0000","last_active":"2024-03-04T08:52:31.842304+0000","last_peered":"2024-03-04T08:52:31.842304+0000","last_clean":"2024-03-04T08:52:31.842304+0000","last_became_active":"2024-03-04T08:52:30.845957+0000","last_became_peered":"2024-03-04T08:52:30.845957+0000","last_unstale":"2024-03-04T08:52:31.842304+0000","last_undegraded":"2024-03-04T08:52:31.842304+0000","last_fullsized":"2024-03-04T08:52:31.842304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:51:06.965010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859410+0000","last_change":"2024-03-04T08:52:31.856105+0000","last_active":"2024-03-04T08:52:31.859410+0000","last_peered":"2024-03-04T08:52:31.859410+0000","last_clean":"2024-03-04T08:52:31.859410+0000","last_became_active":"2024-03-04T08:52:31.855833+0000","last_became_peered":"2024-03-04T08:52:31.855833+0000","last_unstale":"2024-03-04T08:52:31.859410+0000","last_undegraded":"2024-03-04T08:52:31.859410+0000","last_fullsized":"2024-03-04T08:52:31.859410+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:11.036678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.869794+0000","last_change":"2024-03-04T08:52:30.840665+0000","last_active":"2024-03-04T08:52:31.869794+0000","last_peered":"2024-03-04T08:52:31.869794+0000","last_clean":"2024-03-04T08:52:31.869794+0000","last_became_active":"2024-03-04T08:52:30.840373+0000","last_became_peered":"2024-03-04T08:52:30.840373+0000","last_unstale":"2024-03-04T08:52:31.869794+0000","last_undegraded":"2024-03-04T08:52:31.869794+0000","last_fullsized":"2024-03-04T08:52:31.869794+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:11:59.241570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.851979+0000","last_change":"2024-03-04T08:52:31.852279+0000","last_active":"2024-03-04T08:52:32.851979+0000","last_peered":"2024-03-04T08:52:32.851979+0000","last_clean":"2024-03-04T08:52:32.851979+0000","last_became_active":"2024-03-04T08:52:31.851993+0000","last_became_peered":"2024-03-04T08:52:31.851993+0000","last_unstale":"2024-03-04T08:52:32.851979+0000","last_undegraded":"2024-03-04T08:52:32.851979+0000","last_fullsized":"2024-03-04T08:52:32.851979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:13:34.205955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.844315+0000","last_change":"2024-03-04T08:52:30.838960+0000","last_active":"2024-03-04T08:52:31.844315+0000","last_peered":"2024-03-04T08:52:31.844315+0000","last_clean":"2024-03-04T08:52:31.844315+0000","last_became_active":"2024-03-04T08:52:30.838656+0000","last_became_peered":"2024-03-04T08:52:30.838656+0000","last_unstale":"2024-03-04T08:52:31.844315+0000","last_undegraded":"2024-03-04T08:52:31.844315+0000","last_fullsized":"2024-03-04T08:52:31.844315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:11.889264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.843015+0000","last_change":"2024-03-04T08:52:31.839761+0000","last_active":"2024-03-04T08:52:31.843015+0000","last_peered":"2024-03-04T08:52:31.843015+0000","last_clean":"2024-03-04T08:52:31.843015+0000","last_became_active":"2024-03-04T08:52:31.839450+0000","last_became_peered":"2024-03-04T08:52:31.839450+0000","last_unstale":"2024-03-04T08:52:31.843015+0000","last_undegraded":"2024-03-04T08:52:31.843015+0000","last_fullsized":"2024-03-04T08:52:31.843015+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:57:41.698142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.847152+0000","last_change":"2024-03-04T08:52:30.840769+0000","last_active":"2024-03-04T08:52:31.847152+0000","last_peered":"2024-03-04T08:52:31.847152+0000","last_clean":"2024-03-04T08:52:31.847152+0000","last_became_active":"2024-03-04T08:52:30.840467+0000","last_became_peered":"2024-03-04T08:52:30.840467+0000","last_unstale":"2024-03-04T08:52:31.847152+0000","last_undegraded":"2024-03-04T08:52:31.847152+0000","last_fullsized":"2024-03-04T08:52:31.847152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:55:23.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.860900+0000","last_change":"2024-03-04T08:52:31.848402+0000","last_active":"2024-03-04T08:52:31.860900+0000","last_peered":"2024-03-04T08:52:31.860900+0000","last_clean":"2024-03-04T08:52:31.860900+0000","last_became_active":"2024-03-04T08:52:31.847535+0000","last_became_peered":"2024-03-04T08:52:31.847535+0000","last_unstale":"2024-03-04T08:52:31.860900+0000","last_undegraded":"2024-03-04T08:52:31.860900+0000","last_fullsized":"2024-03-04T08:52:31.860900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:18:14.233231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.836865+0000","last_change":"2024-03-04T08:52:30.838822+0000","last_active":"2024-03-04T08:52:31.836865+0000","last_peered":"2024-03-04T08:52:31.836865+0000","last_clean":"2024-03-04T08:52:31.836865+0000","last_became_active":"2024-03-04T08:52:30.838443+0000","last_became_peered":"2024-03-04T08:52:30.838443+0000","last_unstale":"2024-03-04T08:52:31.836865+0000","last_undegraded":"2024-03-04T08:52:31.836865+0000","last_fullsized":"2024-03-04T08:52:31.836865+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:04.904235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.859267+0000","last_change":"2024-03-04T08:52:31.854292+0000","last_active":"2024-03-04T08:52:31.859267+0000","last_peered":"2024-03-04T08:52:31.859267+0000","last_clean":"2024-03-04T08:52:31.859267+0000","last_became_active":"2024-03-04T08:52:31.853986+0000","last_became_peered":"2024-03-04T08:52:31.853986+0000","last_unstale":"2024-03-04T08:52:31.859267+0000","last_undegraded":"2024-03-04T08:52:31.859267+0000","last_fullsized":"2024-03-04T08:52:31.859267+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:12.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.837270+0000","last_change":"2024-03-04T08:52:30.849216+0000","last_active":"2024-03-04T08:52:31.837270+0000","last_peered":"2024-03-04T08:52:31.837270+0000","last_clean":"2024-03-04T08:52:31.837270+0000","last_became_active":"2024-03-04T08:52:30.848919+0000","last_became_peered":"2024-03-04T08:52:30.848919+0000","last_unstale":"2024-03-04T08:52:31.837270+0000","last_undegraded":"2024-03-04T08:52:31.837270+0000","last_fullsized":"2024-03-04T08:52:31.837270+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:28:13.907364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.869026+0000","last_change":"2024-03-04T08:52:31.866544+0000","last_active":"2024-03-04T08:52:31.869026+0000","last_peered":"2024-03-04T08:52:31.869026+0000","last_clean":"2024-03-04T08:52:31.869026+0000","last_became_active":"2024-03-04T08:52:31.866224+0000","last_became_peered":"2024-03-04T08:52:31.866224+0000","last_unstale":"2024-03-04T08:52:31.869026+0000","last_undegraded":"2024-03-04T08:52:31.869026+0000","last_fullsized":"2024-03-04T08:52:31.869026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:46.743794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.853179+0000","last_change":"2024-03-04T08:52:30.838881+0000","last_active":"2024-03-04T08:52:32.853179+0000","last_peered":"2024-03-04T08:52:32.853179+0000","last_clean":"2024-03-04T08:52:32.853179+0000","last_became_active":"2024-03-04T08:52:30.838579+0000","last_became_peered":"2024-03-04T08:52:30.838579+0000","last_unstale":"2024-03-04T08:52:32.853179+0000","last_undegraded":"2024-03-04T08:52:32.853179+0000","last_fullsized":"2024-03-04T08:52:32.853179+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T08:57:35.178351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.855581+0000","last_change":"2024-03-04T08:52:31.851937+0000","last_active":"2024-03-04T08:52:31.855581+0000","last_peered":"2024-03-04T08:52:31.855581+0000","last_clean":"2024-03-04T08:52:31.855581+0000","last_became_active":"2024-03-04T08:52:31.850887+0000","last_became_peered":"2024-03-04T08:52:31.850887+0000","last_unstale":"2024-03-04T08:52:31.855581+0000","last_undegraded":"2024-03-04T08:52:31.855581+0000","last_fullsized":"2024-03-04T08:52:31.855581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:02:54.190992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841140+0000","last_change":"2024-03-04T08:52:30.847745+0000","last_active":"2024-03-04T08:52:31.841140+0000","last_peered":"2024-03-04T08:52:31.841140+0000","last_clean":"2024-03-04T08:52:31.841140+0000","last_became_active":"2024-03-04T08:52:30.847474+0000","last_became_peered":"2024-03-04T08:52:30.847474+0000","last_unstale":"2024-03-04T08:52:31.841140+0000","last_undegraded":"2024-03-04T08:52:31.841140+0000","last_fullsized":"2024-03-04T08:52:31.841140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:14.193540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.857175+0000","last_change":"2024-03-04T08:52:31.851391+0000","last_active":"2024-03-04T08:52:31.857175+0000","last_peered":"2024-03-04T08:52:31.857175+0000","last_clean":"2024-03-04T08:52:31.857175+0000","last_became_active":"2024-03-04T08:52:31.851119+0000","last_became_peered":"2024-03-04T08:52:31.851119+0000","last_unstale":"2024-03-04T08:52:31.857175+0000","last_undegraded":"2024-03-04T08:52:31.857175+0000","last_fullsized":"2024-03-04T08:52:31.857175+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:30.821124+0000","last_clean_scrub_stamp":"2024-03-04T08:52:30.821124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:59.092037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.846767+0000","last_change":"2024-03-04T08:52:30.840416+0000","last_active":"2024-03-04T08:52:31.846767+0000","last_peered":"2024-03-04T08:52:31.846767+0000","last_clean":"2024-03-04T08:52:31.846767+0000","last_became_active":"2024-03-04T08:52:30.840158+0000","last_became_peered":"2024-03-04T08:52:30.840158+0000","last_unstale":"2024-03-04T08:52:31.846767+0000","last_undegraded":"2024-03-04T08:52:31.846767+0000","last_fullsized":"2024-03-04T08:52:31.846767+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:52:29.816740+0000","last_clean_scrub_stamp":"2024-03-04T08:52:29.816740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:19:36.080598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-04T08:52:31.841209+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:52:31.841209+0000","last_peered":"2024-03-04T08:52:31.841209+0000","last_clean":"2024-03-04T08:52:31.841209+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:52:31.841209+0000","last_undegraded":"2024-03-04T08:52:31.841209+0000","last_fullsized":"2024-03-04T08:52:31.841209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":816100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":233159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":225732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":234141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":816100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":239389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":581632,"data_stored":238967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:52:36.325 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T08:52:36.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-04T08:52:36.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.472+0000 7f33f5eb8640 1 Processor -- start 2024-03-04T08:52:36.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.472+0000 7f33f5eb8640 1 -- start start 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33f5eb8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33f01614d0 0x7f33f00d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33f5eb8640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f01618b0 con 0x7f33f00d1910 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33f5eb8640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00cf400 con 0x7f33f00d24b0 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33f5eb8640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00cf6a0 con 0x7f33f01614d0 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33ef7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33f01614d0 0x7f33f00d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33eeffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f33f00d1910 0x7f33f00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45022/0 (socket says 172.21.15.19:45022) 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33eeffd640 1 -- 172.21.15.19:0/741440783 learned_addr learned my addr 172.21.15.19:0/741440783 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33ef7fe640 1 -- 172.21.15.19:0/741440783 >> v1:172.21.15.204:6789/0 conn(0x7f33f00d24b0 legacy=0x7f33f00b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33ef7fe640 1 -- 172.21.15.19:0/741440783 >> v1:172.21.15.19:6789/0 conn(0x7f33f00d1910 legacy=0x7f33f00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33ef7fe640 1 -- 172.21.15.19:0/741440783 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00cf980 con 0x7f33f01614d0 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.473+0000 7f33ee7fc640 1 -- 172.21.15.19:0/741440783 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698385051 0 0) 0x7f33f01618b0 con 0x7f33f00d1910 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33ef7fe640 1 --2- 172.21.15.19:0/741440783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f00d4860 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f33f008c470 tx=0x7f33e402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f9e2fd216621bc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33ee7fc640 1 -- 172.21.15.19:0/741440783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4035020 con 0x7f33f01614d0 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33ee7fc640 1 -- 172.21.15.19:0/741440783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4031800 con 0x7f33f01614d0 2024-03-04T08:52:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33ee7fc640 1 -- 172.21.15.19:0/741440783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4031bd0 con 0x7f33f01614d0 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33f5eb8640 1 -- 172.21.15.19:0/741440783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 msgr2=0x7f33f00d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.474+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/741440783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f00d4860 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f33f008c470 tx=0x7f33e402b8a0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.475+0000 7f33f5eb8640 1 -- 172.21.15.19:0/741440783 shutdown_connections 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.475+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/741440783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f00d4860 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.475+0000 7f33f5eb8640 1 -- 172.21.15.19:0/741440783 >> 172.21.15.19:0/741440783 conn(0x7f33f00d3d40 msgr2=0x7f33f00d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.475+0000 7f33f5eb8640 1 -- 172.21.15.19:0/741440783 shutdown_connections 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.475+0000 7f33f5eb8640 1 -- 172.21.15.19:0/741440783 wait complete. 2024-03-04T08:52:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.476+0000 7f33f5eb8640 1 Processor -- start 2024-03-04T08:52:36.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.476+0000 7f33f5eb8640 1 -- start start 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 0x7f33f00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f00d24b0 0x7f33f00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00b1540 con 0x7f33f01614d0 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00b0910 con 0x7f33f00d1910 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00b16c0 con 0x7f33f00d24b0 2024-03-04T08:52:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49688/0 (socket says 172.21.15.19:49688) 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 -- 172.21.15.19:0/2466982409 learned_addr learned my addr 172.21.15.19:0/2466982409 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 -- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f00d24b0 msgr2=0x7f33f00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f00d24b0 0x7f33f00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 -- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 msgr2=0x7f33f00c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33ef7fe640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 0x7f33f00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 0x7f33f00c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 -- 172.21.15.19:0/2466982409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f01e9ae0 con 0x7f33f01614d0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33ef7fe640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 0x7f33f00c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33effff640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f33e800c780 tx=0x7f33e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8004b60 con 0x7f33f01614d0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8004d00 con 0x7f33f01614d0 2024-03-04T08:52:36.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f01e9dc0 con 0x7f33f01614d0 2024-03-04T08:52:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800aa90 con 0x7f33f01614d0 2024-03-04T08:52:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.477+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f01e9750 con 0x7f33f01614d0 2024-03-04T08:52:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.479+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f01ea2e0 con 0x7f33f01614d0 2024-03-04T08:52:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.479+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33e800ac30 con 0x7f33f01614d0 2024-03-04T08:52:36.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.479+0000 7f33d7fff640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 0x7f33dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.479+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33e808a580 con 0x7f33f01614d0 2024-03-04T08:52:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.479+0000 7f33ef7fe640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 0x7f33dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.480+0000 7f33ef7fe640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 0x7f33dc06d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33e4036000 tx=0x7f33e403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.488+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f33f01ea2e0 con 0x7f33f01614d0 2024-03-04T08:52:36.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.736+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f33f0068ff0 con 0x7f33f01614d0 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.739+0000 7f33d7fff640 1 -- 172.21.15.19:0/2466982409 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f33e8020070 con 0x7f33f01614d0 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-04T08:52:36.735 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 msgr2=0x7f33dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 0x7f33dc06d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33e4036000 tx=0x7f33e403c040 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 msgr2=0x7f33f01e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f33e800c780 tx=0x7f33e800cc40 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 shutdown_connections 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f01614d0 0x7f33f01e9210 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33f00d24b0 0x7f33f00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f33dc06b4d0 0x7f33dc06d990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 --2- 172.21.15.19:0/2466982409 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f33f00d1910 0x7f33f00c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.741+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 >> 172.21.15.19:0/2466982409 conn(0x7f33f00d3d40 msgr2=0x7f33f00d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:36.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.742+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 shutdown_connections 2024-03-04T08:52:36.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.742+0000 7f33f5eb8640 1 -- 172.21.15.19:0/2466982409 wait complete. 2024-03-04T08:52:36.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.854+0000 7fb20a088640 1 Processor -- start 2024-03-04T08:52:36.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 -- start start 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 0x7fb2040d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb2040cd8c0 0x7fb2040d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb204161980 con 0x7fb2040cfff0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb204161c60 con 0x7fb2040cd8c0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb20a088640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204161f40 con 0x7fb20415bb20 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb202ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2040cfff0 0x7fb2040ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45032/0 (socket says 172.21.15.19:45032) 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.855+0000 7fb202ffd640 1 -- 172.21.15.19:0/2195233535 learned_addr learned my addr 172.21.15.19:0/2195233535 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb2037fe640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 0x7fb2040d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb203fff640 1 --2- 172.21.15.19:0/2195233535 >> v2:172.21.15.204:3300/0 conn(0x7fb2040cd8c0 0x7fb2040d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb2027fc640 1 -- 172.21.15.19:0/2195233535 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169086712 0 0) 0x7fb204161980 con 0x7fb2040cfff0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb2027fc640 1 -- 172.21.15.19:0/2195233535 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ec003520 con 0x7fb2040cfff0 2024-03-04T08:52:36.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb203fff640 1 -- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 msgr2=0x7fb2040d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb203fff640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 0x7fb2040d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb203fff640 1 -- 172.21.15.19:0/2195233535 >> v1:172.21.15.19:6789/0 conn(0x7fb2040cfff0 legacy=0x7fb2040ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb203fff640 1 -- 172.21.15.19:0/2195233535 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204162220 con 0x7fb2040cd8c0 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.856+0000 7fb2037fe640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 0x7fb2040d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.857+0000 7fb203fff640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2040cd8c0 0x7fb2040d0470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009d90 tx=0x7fb1fc02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d2708d526ce903e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.857+0000 7fb2027fc640 1 -- 172.21.15.19:0/2195233535 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc039070 con 0x7fb2040cd8c0 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.857+0000 7fb2027fc640 1 -- 172.21.15.19:0/2195233535 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc02cbc0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.857+0000 7fb2027fc640 1 -- 172.21.15.19:0/2195233535 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc034440 con 0x7fb2040cd8c0 2024-03-04T08:52:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 -- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2040cd8c0 msgr2=0x7fb2040d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2040cd8c0 0x7fb2040d0470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009d90 tx=0x7fb1fc02be10 comp rx=0 tx=0).stop 2024-03-04T08:52:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 -- 172.21.15.19:0/2195233535 shutdown_connections 2024-03-04T08:52:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb2040cd8c0 0x7fb2040d0470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 --2- 172.21.15.19:0/2195233535 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb20415bb20 0x7fb2040d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 -- 172.21.15.19:0/2195233535 >> 172.21.15.19:0/2195233535 conn(0x7fb20409a9f0 msgr2=0x7fb20409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 -- 172.21.15.19:0/2195233535 shutdown_connections 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.858+0000 7fb20a088640 1 -- 172.21.15.19:0/2195233535 wait complete. 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.860+0000 7fb20a088640 1 Processor -- start 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.860+0000 7fb20a088640 1 -- start start 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2040cfff0 0x7fb204158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 0x7fb20406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040d24b0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040d2330 con 0x7fb20415bb20 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb20a088640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040d1980 con 0x7fb2040cfff0 2024-03-04T08:52:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.861+0000 7fb2037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49694/0 (socket says 172.21.15.19:49694) 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 -- 172.21.15.19:0/419528563 learned_addr learned my addr 172.21.15.19:0/419528563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb203fff640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 0x7fb20406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb202ffd640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2040cfff0 0x7fb204158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 -- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2040cfff0 msgr2=0x7fb204158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2040cfff0 0x7fb204158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 -- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 msgr2=0x7fb20406ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 0x7fb20406ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 -- 172.21.15.19:0/419528563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20415dbb0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb203fff640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 0x7fb20406ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb2037fe640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400e990 tx=0x7fb1f400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4017070 con 0x7fb2040cd8c0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400c9e0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2040c6230 con 0x7fb2040cd8c0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400cdb0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.862+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb204155560 con 0x7fb2040cd8c0 2024-03-04T08:52:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.863+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20404f330 con 0x7fb2040cd8c0 2024-03-04T08:52:36.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.864+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1f401a070 con 0x7fb2040cd8c0 2024-03-04T08:52:36.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.864+0000 7fb1ebfff640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 0x7fb1f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:36.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.864+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1f408a3d0 con 0x7fb2040cd8c0 2024-03-04T08:52:36.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.865+0000 7fb202ffd640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 0x7fb1f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:36.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.865+0000 7fb202ffd640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 0x7fb1f006d9c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2040cd0d0 tx=0x7fb1f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:36.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:36.873+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb1f4059240 con 0x7fb2040cd8c0 2024-03-04T08:52:37.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.107+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2040c5fe0 con 0x7fb2040cd8c0 2024-03-04T08:52:37.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.108+0000 7fb1ebfff640 1 -- 172.21.15.19:0/419528563 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7fb1f4058b40 con 0x7fb2040cd8c0 2024-03-04T08:52:37.105 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:37.105 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:37.105 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:37.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 msgr2=0x7fb1f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 0x7fb1f006d9c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2040cd0d0 tx=0x7fb1f8009040 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 msgr2=0x7fb204155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400e990 tx=0x7fb1f400ee50 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 shutdown_connections 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1f006b500 0x7fb1f006d9c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb20415bb20 0x7fb20406ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb2040cfff0 0x7fb204158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 --2- 172.21.15.19:0/419528563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2040cd8c0 0x7fb204155020 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 >> 172.21.15.19:0/419528563 conn(0x7fb20409a9f0 msgr2=0x7fb20409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 shutdown_connections 2024-03-04T08:52:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.110+0000 7fb20a088640 1 -- 172.21.15.19:0/419528563 wait complete. 2024-03-04T08:52:37.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T08:52:31.193124+0000', 'modified': '2024-03-04T08:52:34.201909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5958}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5958': {'gid': 5958, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6833/245913424', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6832', 'nonce': 245913424}, {'type': 'v1', 'addr': '172.21.15.19:6833', 'nonce': 245913424}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5958, 'qdb_cluster': [5958]} 2024-03-04T08:52:37.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-04T08:52:37.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-04T08:52:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.628+0000 7fd520f0f640 1 Processor -- start 2024-03-04T08:52:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.628+0000 7fd520f0f640 1 -- start start 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd520f0f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd51c168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd520f0f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0ce510 con 0x7fd51c1586c0 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd520f0f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c161cf0 con 0x7fd51c0b0240 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd520f0f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c158aa0 con 0x7fd51c06b6c0 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd51a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd51c1586c0 0x7fd51c15efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41812/0 (socket says 172.21.15.19:41812) 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd51a59c640 1 -- 172.21.15.19:0/3308156095 learned_addr learned my addr 172.21.15.19:0/3308156095 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd51c168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257654328 0 0) 0x7fd51c0ce510 con 0x7fd51c1586c0 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003520 con 0x7fd51c1586c0 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027610336 0 0) 0x7fd51c161cf0 con 0x7fd51c0b0240 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd51c0ce510 con 0x7fd51c0b0240 2024-03-04T08:52:37.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1379198203 0 0) 0x7fd508003520 con 0x7fd51c1586c0 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 msgr2=0x7fd51c168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd51c168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 >> v1:172.21.15.204:6789/0 conn(0x7fd51c0b0240 legacy=0x7fd51c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c161fd0 con 0x7fd51c1586c0 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fd50c0015f0 con 0x7fd51c1586c0 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.629+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 >> v1:172.21.15.19:6789/0 conn(0x7fd51c1586c0 legacy=0x7fd51c15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd508003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd508004120 0x7fd508004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd508004d40 0x7fd5080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c158aa0 con 0x7fd508004d40 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800bb00 con 0x7fd508004120 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800bd00 con 0x7fd51c06b6c0 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd508004d40 0x7fd5080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51a59c640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd508003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd513fff640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd508004120 0x7fd508004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 -- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 msgr2=0x7fd508003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c06b6c0 0x7fd508003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 -- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd508004120 msgr2=0x7fd508004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd508004120 0x7fd508004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd51ad9d640 1 -- 172.21.15.19:0/3308156095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508003520 con 0x7fd508004d40 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.630+0000 7fd513fff640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd508004120 0x7fd508004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd508004d40 0x7fd5080051c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd514009fa0 tx=0x7fd508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55469e9e49965363 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514039070 con 0x7fd508004d40 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51402ccb0 con 0x7fd508004d40 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd519d9b640 1 -- 172.21.15.19:0/3308156095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514009bf0 con 0x7fd508004d40 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 -- 172.21.15.19:0/3308156095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd508004d40 msgr2=0x7fd5080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3308156095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd508004d40 0x7fd5080051c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd514009fa0 tx=0x7fd508005830 comp rx=0 tx=0).stop 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd51ad9d640 1 -- 172.21.15.19:0/3308156095 reap_dead start 2024-03-04T08:52:37.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 -- 172.21.15.19:0/3308156095 shutdown_connections 2024-03-04T08:52:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 -- 172.21.15.19:0/3308156095 >> 172.21.15.19:0/3308156095 conn(0x7fd51c0d09d0 msgr2=0x7fd51c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 -- 172.21.15.19:0/3308156095 shutdown_connections 2024-03-04T08:52:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.631+0000 7fd520f0f640 1 -- 172.21.15.19:0/3308156095 wait complete. 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.633+0000 7fd520f0f640 1 Processor -- start 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.633+0000 7fd520f0f640 1 -- start start 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd51c15fce0 0x7fd51c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c0af410 0x7fd51c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c162870 con 0x7fd51c15f900 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c162590 con 0x7fd51c15fce0 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd520f0f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0719e0 con 0x7fd51c0af410 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40476/0 (socket says 172.21.15.19:40476) 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 -- 172.21.15.19:0/3173733294 learned_addr learned my addr 172.21.15.19:0/3173733294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c0af410 0x7fd51c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd513fff640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd51c15fce0 0x7fd51c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 -- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c0af410 msgr2=0x7fd51c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c0af410 0x7fd51c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 -- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd51c15fce0 msgr2=0x7fd51c0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd51c15fce0 0x7fd51c0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.634+0000 7fd51a59c640 1 -- 172.21.15.19:0/3173733294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0af950 con 0x7fd51c15f900 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd51a59c640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd50c007060 tx=0x7fd50c007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd512ffd640 1 -- 172.21.15.19:0/3173733294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c01a070 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd512ffd640 1 -- 172.21.15.19:0/3173733294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00f960 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c1e7b70 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd512ffd640 1 -- 172.21.15.19:0/3173733294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00fd50 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.635+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c157560 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.637+0000 7fd512ffd640 1 -- 172.21.15.19:0/3173733294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd50c01d070 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.637+0000 7fd512ffd640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 0x7fd4fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.637+0000 7fd512ffd640 1 -- 172.21.15.19:0/3173733294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c089a80 con 0x7fd51c15f900 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.637+0000 7fd513fff640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 0x7fd4fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.637+0000 7fd523bcc740 1 Processor -- start 2024-03-04T08:52:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 -- start start 2024-03-04T08:52:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd513fff640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 0x7fd4fc06d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd504007b60 tx=0x7fd504009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774218c0 0x55d277423360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d27744da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2773876b0 con 0x55d27741d870 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277330a60 con 0x55d27744d600 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277383750 con 0x55d2774218c0 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.638+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40480/0 (socket says 172.21.15.19:40480) 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 -- 172.21.15.19:0/4222593721 learned_addr learned my addr 172.21.15.19:0/4222593721 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd513fff640 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774218c0 0x55d277423360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d27744da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 -- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774218c0 msgr2=0x55d277423360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774218c0 0x55d277423360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 -- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 msgr2=0x55d27744da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d27744da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 -- 172.21.15.19:0/4222593721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d27734ef30 con 0x55d27741d870 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd51a59c640 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd50c087f20 tx=0x7fd50c00ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65279c088280f10 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd4fbfff640 1 -- 172.21.15.19:0/4222593721 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c05c350 con 0x55d27741d870 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd4fbfff640 1 -- 172.21.15.19:0/4222593721 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c060910 con 0x55d27741d870 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.639+0000 7fd4fbfff640 1 -- 172.21.15.19:0/4222593721 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c054870 con 0x55d27741d870 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- 172.21.15.19:0/4222593721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 msgr2=0x55d27741dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd50c087f20 tx=0x7fd50c00ffd0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- 172.21.15.19:0/4222593721 shutdown_connections 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d27744da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774218c0 0x55d277423360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 --2- 172.21.15.19:0/4222593721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27741d870 0x55d27741dc50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- 172.21.15.19:0/4222593721 >> 172.21.15.19:0/4222593721 conn(0x55d27741f8f0 msgr2=0x55d2774211b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- 172.21.15.19:0/4222593721 shutdown_connections 2024-03-04T08:52:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- 172.21.15.19:0/4222593721 wait complete. 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.640+0000 7fd523bcc740 1 -- start start 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 Processor -- start 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d277464190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774646d0 0x55d2774678e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277421d50 con 0x55d277467e20 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277343ea0 con 0x55d27744d600 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277422030 con 0x55d2774646d0 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.641+0000 7fd523bcc740 10 client.0 _ll_register_callbacks cb 0x55d277343870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40492/0 (socket says 172.21.15.19:40492) 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d277464190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51ad9d640 1 -- 172.21.15.19:0/2553366951 learned_addr learned my addr 172.21.15.19:0/2553366951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd513fff640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774646d0 0x55d2774678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 -- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774646d0 msgr2=0x55d2774678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774646d0 0x55d2774678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 -- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 msgr2=0x55d2774479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 -- 172.21.15.19:0/2553366951 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d277344270 con 0x55d27744d600 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d277464190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd50c058190 tx=0x7fd50c015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2efac50fe8a0b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd4f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.204:3300/0 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c074060 con 0x55d27744d600 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mon.1 v2:172.21.15.204:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c057850 con 0x55d27744d600 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.642+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd50c060910 con 0x55d27744d600 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50c05c350 con 0x55d27744d600 2024-03-04T08:52:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 10 client.5812 fetch_fsmap learned FSMap version 22 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55d27709c2d0 con 0x55d27744d600 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mon.1 v2:172.21.15.204:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c060910 con 0x55d27744d600 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mon.1 v2:172.21.15.204:3300/0 5 ==== fsmap(e 22) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd50c05e2f0 con 0x55d27744d600 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 10 client.5812 fetch_fsmap finished waiting for FSMap version 22 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 10 client.5812 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 20 client.5812 populate_metadata read hostname 'smithi019' 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d277450bc0 0x55d27744ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 4 client.5812 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 --> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d277394bf0 con 0x55d277450bc0 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd513fff640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d277450bc0 0x55d27744ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd4f97fa640 10 client.5812 ms_handle_connect on v2:172.21.15.19:6832/245913424 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.643+0000 7fd513fff640 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d277450bc0 0x55d27744ea50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1394abf8c0c0fc server_cookie=61a431133e9494e4 in_seq=0 out_seq=0 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2553366951 <== mds.0 v2:172.21.15.19:6832/245913424 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d277394bf0 con 0x55d277450bc0 2024-03-04T08:52:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd4f97fa640 10 client.5812 handle_command_reply: tid=0 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 client.5812 shutdown 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 msgr2=0x55d277464190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d277464190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd50c058190 tx=0x7fd50c015000 comp rx=0 tx=0).stop 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 shutdown_connections 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d277450bc0 0x55d27744ea50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d2774479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d2774646d0 0x55d2774678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2553366951 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d277464190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd4f97fa640 0 client.5812 ms_handle_reset on v2:172.21.15.19:6832/245913424 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.644+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 >> 172.21.15.19:0/2553366951 conn(0x55d27741d870 msgr2=0x55d27744b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.645+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 shutdown_connections 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.645+0000 7fd523bcc740 1 -- 172.21.15.19:0/2553366951 wait complete. 2024-03-04T08:52:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.645+0000 7fd523bcc740 20 client.5812 trim_cache size 0 max 16384 2024-03-04T08:52:37.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.661+0000 7fd523bcc740 1 Processor -- start 2024-03-04T08:52:37.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.661+0000 7fd523bcc740 1 -- start start 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 0x55d27744f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 0x55d27741c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c1ffed0 con 0x55d27744d600 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c1f5240 con 0x55d277418ee0 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0ae5f0 con 0x55d277467e20 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40494/0 (socket says 172.21.15.19:40494) 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 -- 172.21.15.19:0/914159424 learned_addr learned my addr 172.21.15.19:0/914159424 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 0x55d27741c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 -- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 msgr2=0x55d27744f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd513fff640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 0x55d27744f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 0x55d27744f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 -- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 msgr2=0x55d27741c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 0x55d27741c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51a59c640 1 -- 172.21.15.19:0/914159424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2771666b0 con 0x55d27744d600 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 0x55d27741c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.662+0000 7fd513fff640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 0x55d27744f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd51a59c640 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00f5a0 tx=0x7fd50c087000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5612c7fc809430 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd4fb7fe640 1 -- 172.21.15.19:0/914159424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c05e2f0 con 0x55d27744d600 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd4fb7fe640 1 -- 172.21.15.19:0/914159424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c057650 con 0x55d27744d600 2024-03-04T08:52:37.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd4fb7fe640 1 -- 172.21.15.19:0/914159424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c053f50 con 0x55d27744d600 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 -- 172.21.15.19:0/914159424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 msgr2=0x55d27744ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00f5a0 tx=0x7fd50c087000 comp rx=0 tx=0).stop 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 -- 172.21.15.19:0/914159424 shutdown_connections 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d277418ee0 0x55d27741c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277467e20 0x55d27744f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 --2- 172.21.15.19:0/914159424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d27744d600 0x55d27744ec40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 -- 172.21.15.19:0/914159424 >> 172.21.15.19:0/914159424 conn(0x55d27741d870 msgr2=0x55d277421080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 -- 172.21.15.19:0/914159424 shutdown_connections 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.663+0000 7fd523bcc740 1 -- 172.21.15.19:0/914159424 wait complete. 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.664+0000 7fd523bcc740 1 -- start start 2024-03-04T08:52:37.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.664+0000 7fd523bcc740 1 Processor -- start 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277418ee0 0x55d27744f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d2774221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277343ea0 con 0x55d277467e20 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277422030 con 0x55d27744d600 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277421d50 con 0x55d277418ee0 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd523bcc740 10 client.0 _ll_register_callbacks cb 0x7fd50c057b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40508/0 (socket says 172.21.15.19:40508) 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 -- 172.21.15.19:0/2858557107 learned_addr learned my addr 172.21.15.19:0/2858557107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277418ee0 0x55d27744f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd513fff640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d2774221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 -- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277418ee0 msgr2=0x55d27744f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277418ee0 0x55d27744f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 -- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 msgr2=0x55d2774221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d2774221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 -- 172.21.15.19:0/2858557107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d27747b210 con 0x55d277467e20 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd51ad9d640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e200 tx=0x7fd514004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9d57821d46ea88 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.665+0000 7fd4f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514039040 con 0x55d277467e20 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd514041a20 con 0x55d277467e20 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd50c057650 con 0x55d277467e20 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd514051050 con 0x55d277467e20 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 10 client.6129 fetch_fsmap learned FSMap version 22 2024-03-04T08:52:37.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55d2774229c0 con 0x55d277467e20 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c057650 con 0x55d277467e20 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 22) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd514054020 con 0x55d277467e20 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 10 client.6129 fetch_fsmap finished waiting for FSMap version 22 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 10 client.6129 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 20 client.6129 populate_metadata read hostname 'smithi019' 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d2774d8070 0x55d27741c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 4 client.6129 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 --> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d27738ef40 con 0x55d2774d8070 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.666+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d2774d8070 0x55d27741c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd4f97fa640 10 client.6129 ms_handle_connect on v2:172.21.15.19:6832/245913424 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd51a59c640 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d2774d8070 0x55d27741c510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5945516bc6b52f63 server_cookie=54dcea2593ae7eb in_seq=0 out_seq=0 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd4f97fa640 1 -- 172.21.15.19:0/2858557107 <== mds.0 v2:172.21.15.19:6832/245913424 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d27738ef40 con 0x55d2774d8070 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd4f97fa640 10 client.6129 handle_command_reply: tid=0 2024-03-04T08:52:37.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 client.6129 shutdown 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 msgr2=0x55d27747b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e200 tx=0x7fd514004ab0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 shutdown_connections 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:6832/245913424,v1:172.21.15.19:6833/245913424] conn(0x55d2774d8070 0x55d27741c510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d277467e20 0x55d27747b9a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x55d27744d600 0x55d2774221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 --2- 172.21.15.19:0/2858557107 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x55d277418ee0 0x55d27744f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd4f97fa640 0 client.6129 ms_handle_reset on v2:172.21.15.19:6832/245913424 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 >> 172.21.15.19:0/2858557107 conn(0x55d27741d870 msgr2=0x55d277446fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 shutdown_connections 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 1 -- 172.21.15.19:0/2858557107 wait complete. 2024-03-04T08:52:37.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.667+0000 7fd523bcc740 20 client.6129 trim_cache size 0 max 16384 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "385c227e-6109-4019-8b7b-25dec95ce12d", 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5958, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 5.8218746760000002, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 22, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 49, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 49, 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 10.854206517 2024-03-04T08:52:37.670 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:37.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 msgr2=0x7fd4fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 0x7fd4fc06d9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd504007b60 tx=0x7fd504009040 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 msgr2=0x7fd51c1e8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd50c007060 tx=0x7fd50c007520 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 shutdown_connections 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd51c0af410 0x7fd51c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd4fc06b500 0x7fd4fc06d9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd51c15fce0 0x7fd51c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 --2- 172.21.15.19:0/3173733294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd51c15f900 0x7fd51c1e8650 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 >> 172.21.15.19:0/3173733294 conn(0x7fd51c0d09d0 msgr2=0x7fd51c0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 shutdown_connections 2024-03-04T08:52:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.668+0000 7fd520f0f640 1 -- 172.21.15.19:0/3173733294 wait complete. 2024-03-04T08:52:37.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:52:37.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.779+0000 7fde9fc1c640 1 Processor -- start 2024-03-04T08:52:37.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.779+0000 7fde9fc1c640 1 -- start start 2024-03-04T08:52:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9fc1c640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fde980d22b0 0x7fde980d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9fc1c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde980b41f0 0x7fde980b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9fc1c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980b3430 con 0x7fde9815dfe0 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9fc1c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980d2c50 con 0x7fde980b41f0 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9fc1c640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980b31e0 con 0x7fde980d22b0 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde980b41f0 0x7fde980b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde980b41f0 0x7fde980b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40520/0 (socket says 172.21.15.19:40520) 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 -- 172.21.15.19:0/59466690 learned_addr learned my addr 172.21.15.19:0/59466690 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9d1b7640 1 --2- 172.21.15.19:0/59466690 >> v2:172.21.15.204:3300/0 conn(0x7fde980d22b0 0x7fde980d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 -- 172.21.15.19:0/59466690 >> v2:172.21.15.204:3300/0 conn(0x7fde980d22b0 msgr2=0x7fde980d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 --2- 172.21.15.19:0/59466690 >> v2:172.21.15.204:3300/0 conn(0x7fde980d22b0 0x7fde980d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 -- 172.21.15.19:0/59466690 >> v1:172.21.15.204:6789/0 conn(0x7fde9815dfe0 legacy=0x7fde980cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.780+0000 7fde9e1b9640 1 -- 172.21.15.19:0/59466690 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980b3710 con 0x7fde980b41f0 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.781+0000 7fde9e1b9640 1 --2- 172.21.15.19:0/59466690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde980b4680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fde90009e50 tx=0x7fde9002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ffd363f91ff33c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.781+0000 7fde9c9b6640 1 -- 172.21.15.19:0/59466690 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9002ca80 con 0x7fde980b41f0 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.781+0000 7fde9c9b6640 1 -- 172.21.15.19:0/59466690 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9002cc20 con 0x7fde980b41f0 2024-03-04T08:52:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.781+0000 7fde9c9b6640 1 -- 172.21.15.19:0/59466690 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900343f0 con 0x7fde980b41f0 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 -- 172.21.15.19:0/59466690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 msgr2=0x7fde980b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/59466690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde980b4680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fde90009e50 tx=0x7fde9002bee0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 -- 172.21.15.19:0/59466690 shutdown_connections 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/59466690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde980b4680 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/59466690 >> v2:172.21.15.204:3300/0 conn(0x7fde980d22b0 0x7fde980d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 -- 172.21.15.19:0/59466690 >> 172.21.15.19:0/59466690 conn(0x7fde980d3cd0 msgr2=0x7fde980d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 -- 172.21.15.19:0/59466690 shutdown_connections 2024-03-04T08:52:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.782+0000 7fde9fc1c640 1 -- 172.21.15.19:0/59466690 wait complete. 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.783+0000 7fde9fc1c640 1 Processor -- start 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.783+0000 7fde9fc1c640 1 -- start start 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde980d22b0 0x7fde9815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 0x7fde981600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980cfa00 con 0x7fde980b41f0 2024-03-04T08:52:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980b3d60 con 0x7fde980d22b0 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9fc1c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980d1c70 con 0x7fde9815dfe0 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40534/0 (socket says 172.21.15.19:40534) 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 -- 172.21.15.19:0/3558110384 learned_addr learned my addr 172.21.15.19:0/3558110384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d1b7640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde980d22b0 0x7fde9815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9e1b9640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 0x7fde981600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 -- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 msgr2=0x7fde981600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 0x7fde981600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 -- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde980d22b0 msgr2=0x7fde9815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde980d22b0 0x7fde9815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9d9b8640 1 -- 172.21.15.19:0/3558110384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98160600 con 0x7fde980b41f0 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.784+0000 7fde9e1b9640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 0x7fde981600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde9d9b8640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde8800b3f0 tx=0x7fde8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88015020 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88011830 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde981f4140 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88011c20 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.785+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde981f4700 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.786+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9804f330 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.787+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde88018020 con 0x7fde980b41f0 2024-03-04T08:52:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.787+0000 7fde8e7fc640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 0x7fde7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.787+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde8808a190 con 0x7fde980b41f0 2024-03-04T08:52:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.787+0000 7fde9d1b7640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 0x7fde7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.788+0000 7fde9d1b7640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 0x7fde7c06d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde980a13f0 tx=0x7fde94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:37.791+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fde8801f020 con 0x7fde980b41f0 2024-03-04T08:52:37.815 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-03-04T08:52:37.819+0000 7f01d2ee9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:52:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.014+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde980747a0 con 0x7fde980b41f0 2024-03-04T08:52:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.014+0000 7fde8e7fc640 1 -- 172.21.15.19:0/3558110384 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde880172c0 con 0x7fde980b41f0 2024-03-04T08:52:38.011 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:52:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 msgr2=0x7fde7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 0x7fde7c06d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde980a13f0 tx=0x7fde94008040 comp rx=0 tx=0).stop 2024-03-04T08:52:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 msgr2=0x7fde981f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde8800b3f0 tx=0x7fde8800b8b0 comp rx=0 tx=0).stop 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 shutdown_connections 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fde9815dfe0 0x7fde981600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fde7c06b4d0 0x7fde7c06d990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fde980d22b0 0x7fde9815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 --2- 172.21.15.19:0/3558110384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde980b41f0 0x7fde981f3b10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 >> 172.21.15.19:0/3558110384 conn(0x7fde980d3cd0 msgr2=0x7fde9806ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 shutdown_connections 2024-03-04T08:52:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:38.016+0000 7fde9fc1c640 1 -- 172.21.15.19:0/3558110384 wait complete. 2024-03-04T08:52:38.023 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:52:38.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:52:38.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:52:38.025 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:38.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.025 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:52:38.042 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.043 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:52:38.044 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:38.044 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:52:38.045 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:52:38.045 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:38.045 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:52:38.045 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:52:38.045 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42536sec preferred_lft 42536sec 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:52:38.046 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.047 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:52:38.048 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:38.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.049 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:52:38.108 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:52:38.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.807 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:52:38.862 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:52:38.863 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:52:38.863 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:52:38.863 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:52:38.863 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:52:38.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.863 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:52:38.863 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:52:38.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:52:38.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:52:38.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:52:38.864 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:52:38.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.962 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:52:38.976 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:52:38.977 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:52:38.977 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:38.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:38.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:52:39.045 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:52:39.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:39.045 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:39.100 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:39.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:39.100 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:39.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:39.223 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:39.278 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:39.279 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:39.280 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:39.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.282 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:39.333 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:52:39.333 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:52:39.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:39.402 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:39.458 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:39.459 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:39.460 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:39.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.461 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:39.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:52:39.473+0000 7fe13c249480 -1 init, newargv = 0x55bad3aeee00 newargc=15 2024-03-04T08:52:39.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[57514]: starting ceph client 2024-03-04T08:52:39.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[57514]: starting fuse 2024-03-04T08:52:39.485 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:52:39.485 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:39.485 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:52:39.486 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:52:39.487 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:52:39.487 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:39.487 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:52:39.487 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:39.624 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.57514.asok 2024-03-04T08:52:39.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:52:39.635 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57514.asok 2024-03-04T08:52:39.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57514.asok status 2024-03-04T08:52:39.771 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "57514", 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:52:39.772 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6141, 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 6141 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 538967764 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:39.773 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 538967764 2024-03-04T08:52:39.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:39.774 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.6141 192.168.0.1:0/538967764", 2024-03-04T08:52:39.774 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/538967764", 2024-03-04T08:52:39.774 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:52:39.774 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 22, 2024-03-04T08:52:39.775 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 49, 2024-03-04T08:52:39.775 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:52:39.775 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:52:39.775 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:52:39.775 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:39.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.780 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:52:39.781 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:39.795 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:52:39.795 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:39.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:39.865 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-03-04T08:52:39.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-03-04T08:52:40.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.076+0000 7f2ab1e64640 1 Processor -- start 2024-03-04T08:52:40.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2ab1e64640 1 -- start start 2024-03-04T08:52:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2ab1e64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2aac168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2ab1e64640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0d2730 con 0x7f2aac1614d0 2024-03-04T08:52:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2ab1e64640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac1618b0 con 0x7f2aac0d4860 2024-03-04T08:52:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2ab1e64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0d4cf0 con 0x7f2aac0b1e40 2024-03-04T08:52:40.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2aab7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2aac1614d0 0x7f2aac0d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41814/0 (socket says 172.21.15.19:41814) 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.077+0000 7f2aab7fe640 1 -- 172.21.15.19:0/3622032511 learned_addr learned my addr 172.21.15.19:0/3622032511 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aabfff640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2aac168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248050285 0 0) 0x7f2aac0d2730 con 0x7f2aac1614d0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a98003520 con 0x7f2aac1614d0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142853001 0 0) 0x7f2aac1618b0 con 0x7f2aac0d4860 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aac0d2730 con 0x7f2aac0d4860 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690645336 0 0) 0x7f2a98003520 con 0x7f2aac1614d0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 msgr2=0x7f2aac168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2aac168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 >> v1:172.21.15.204:6789/0 conn(0x7f2aac0d4860 legacy=0x7f2aac0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0cf400 con 0x7f2aac1614d0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f2a9c001670 con 0x7f2aac1614d0 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 >> v1:172.21.15.19:6789/0 conn(0x7f2aac1614d0 legacy=0x7f2aac0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a98003b70 0x7f2a98003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2a98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a98004d40 0x7f2a980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0d4cf0 con 0x7f2a98003b70 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9800ba70 con 0x7f2a98004d40 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9800bc70 con 0x7f2aac0b1e40 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a98003b70 0x7f2a98003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aabfff640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a98004d40 0x7f2a980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.078+0000 7f2aaaffd640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2a98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 -- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 msgr2=0x7f2a98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2aac0b1e40 0x7f2a98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 -- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a98004d40 msgr2=0x7f2a980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a98004d40 0x7f2a980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 -- 172.21.15.19:0/3622032511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98003520 con 0x7f2a98003b70 2024-03-04T08:52:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aabfff640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2a98004d40 0x7f2a980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a98003b70 0x7f2a98003f90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007fd0 tx=0x7f2a98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe630125b26cee6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007ce0 con 0x7f2a98003b70 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c030070 con 0x7f2a98003b70 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.079+0000 7f2aaa7fc640 1 -- 172.21.15.19:0/3622032511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005d50 con 0x7f2a98003b70 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 -- 172.21.15.19:0/3622032511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a98003b70 msgr2=0x7f2a98003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/3622032511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a98003b70 0x7f2a98003f90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007fd0 tx=0x7f2a98005830 comp rx=0 tx=0).stop 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2aabfff640 1 -- 172.21.15.19:0/3622032511 reap_dead start 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 -- 172.21.15.19:0/3622032511 shutdown_connections 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 -- 172.21.15.19:0/3622032511 >> 172.21.15.19:0/3622032511 conn(0x7f2aac0d3d40 msgr2=0x7f2aac0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 -- 172.21.15.19:0/3622032511 shutdown_connections 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.080+0000 7f2ab1e64640 1 -- 172.21.15.19:0/3622032511 wait complete. 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.081+0000 7f2ab1e64640 1 Processor -- start 2024-03-04T08:52:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.081+0000 7f2ab1e64640 1 -- start start 2024-03-04T08:52:40.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a98003b70 0x7f2aac0b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2aac06c890 0x7f2aac06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0cfc60 con 0x7f2aac0ca460 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0cf980 con 0x7f2aac06c890 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2ab1e64640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0b0910 con 0x7f2a98003b70 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40538/0 (socket says 172.21.15.19:40538) 2024-03-04T08:52:40.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 -- 172.21.15.19:0/2594641865 learned_addr learned my addr 172.21.15.19:0/2594641865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:40.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aabfff640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2aac06c890 0x7f2aac06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a98003b70 0x7f2aac0b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 -- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a98003b70 msgr2=0x7f2aac0b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a98003b70 0x7f2aac0b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 -- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2aac06c890 msgr2=0x7f2aac06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2aac06c890 0x7f2aac06cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.082+0000 7f2aaaffd640 1 -- 172.21.15.19:0/2594641865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0b6e70 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2aaaffd640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400e7e0 tx=0x7f2a9400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400ee90 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94018070 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac0b8fb0 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400c6c0 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.083+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac0b9570 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.084+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac068ff0 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.084+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a9400c860 con 0x7f2aac0ca460 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.085+0000 7f2aa3fff640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 0x7f2a8c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.085+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a94089e20 con 0x7f2aac0ca460 2024-03-04T08:52:40.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.085+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 0x7f2a8c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.085+0000 7f2aab7fe640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 0x7f2a8c06db60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c034000 tx=0x7f2a9c007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.089+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2a940586e0 con 0x7f2aac0ca460 2024-03-04T08:52:40.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.340+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f2aac0b5430 con 0x7f2aac0ca460 2024-03-04T08:52:40.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.342+0000 7f2aa3fff640 1 -- 172.21.15.19:0/2594641865 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+140 (secure 0 0 0) 0x7f2a9405c780 con 0x7f2aac0ca460 2024-03-04T08:52:40.338 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:52:40.338 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:40.339 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow r pool=cephfs_data" 2024-03-04T08:52:40.339 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:40.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 msgr2=0x7f2a8c06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 0x7f2a8c06db60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c034000 tx=0x7f2a9c007000 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 msgr2=0x7f2aac151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400e7e0 tx=0x7f2a9400eca0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 shutdown_connections 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2a8c06b6a0 0x7f2a8c06db60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2aac06c890 0x7f2aac06cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2aac0ca460 0x7f2aac151080 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 --2- 172.21.15.19:0/2594641865 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2a98003b70 0x7f2aac0b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 >> 172.21.15.19:0/2594641865 conn(0x7f2aac0d3d40 msgr2=0x7f2aac0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 shutdown_connections 2024-03-04T08:52:40.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.344+0000 7f2ab1e64640 1 -- 172.21.15.19:0/2594641865 wait complete. 2024-03-04T08:52:40.352 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:40.352 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:40.366 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.512+0000 7fa7ae40e640 1 Processor -- start 2024-03-04T08:52:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.512+0000 7fa7ae40e640 1 -- start start 2024-03-04T08:52:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ae40e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7a80d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ae40e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80b3430 con 0x7fa7a80b41f0 2024-03-04T08:52:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ae40e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80b3710 con 0x7fa7a815dfe0 2024-03-04T08:52:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ae40e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80d2c50 con 0x7fa7a80d22b0 2024-03-04T08:52:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ac9ab640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa7a80b41f0 0x7fa7a80b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41820/0 (socket says 172.21.15.19:41820) 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7ac9ab640 1 -- 172.21.15.19:0/1979821179 learned_addr learned my addr 172.21.15.19:0/1979821179 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7a80d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701271344 0 0) 0x7fa7a80b3430 con 0x7fa7a80b41f0 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003520 con 0x7fa7a80b41f0 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273844155 0 0) 0x7fa790003520 con 0x7fa7a80b41f0 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 msgr2=0x7fa7a80d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7a80d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 >> v1:172.21.15.204:6789/0 conn(0x7fa7a815dfe0 legacy=0x7fa7a80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80b39f0 con 0x7fa7a80b41f0 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fa7a00019f0 con 0x7fa7a80b41f0 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7a80d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 >> v1:172.21.15.19:6789/0 conn(0x7fa7a80b41f0 legacy=0x7fa7a80b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa790003fd0 0x7fa790004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.513+0000 7fa7a6ffd640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790004d40 0x7fa7900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000baf0 con 0x7fa790003fd0 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000bca0 con 0x7fa790004d40 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79000bea0 con 0x7fa7a80d22b0 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa790003fd0 0x7fa790004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7ac9ab640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790004d40 0x7fa7900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a7fff640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 -- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 msgr2=0x7fa7900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80d22b0 0x7fa7900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 -- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790004d40 msgr2=0x7fa7900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790004d40 0x7fa7900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.514+0000 7fa7a77fe640 1 -- 172.21.15.19:0/1979821179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790003520 con 0x7fa790003fd0 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa790003fd0 0x7fa790004800 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098a0 tx=0x7fa790005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a688682df0caa14 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00f040 con 0x7fa790003fd0 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c004230 con 0x7fa790003fd0 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7a6ffd640 1 -- 172.21.15.19:0/1979821179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c02d040 con 0x7fa790003fd0 2024-03-04T08:52:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 -- 172.21.15.19:0/1979821179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa790003fd0 msgr2=0x7fa790004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/1979821179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa790003fd0 0x7fa790004800 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0098a0 tx=0x7fa790005830 comp rx=0 tx=0).stop 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ac9ab640 1 -- 172.21.15.19:0/1979821179 reap_dead start 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 -- 172.21.15.19:0/1979821179 shutdown_connections 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 -- 172.21.15.19:0/1979821179 >> 172.21.15.19:0/1979821179 conn(0x7fa7a80d3cd0 msgr2=0x7fa7a80d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 -- 172.21.15.19:0/1979821179 shutdown_connections 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.515+0000 7fa7ae40e640 1 -- 172.21.15.19:0/1979821179 wait complete. 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 Processor -- start 2024-03-04T08:52:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 -- start start 2024-03-04T08:52:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 0x7fa7a81f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80cb580 0x7fa7a80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b3d60 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80b31e0 con 0x7fa790003fd0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.517+0000 7fa7ae40e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80d1c70 con 0x7fa7a80cb580 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40554/0 (socket says 172.21.15.19:40554) 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 -- 172.21.15.19:0/720770478 learned_addr learned my addr 172.21.15.19:0/720770478 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a7fff640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 0x7fa7a81f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7ac9ab640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80cb580 0x7fa7a80cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 -- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80cb580 msgr2=0x7fa7a80cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80cb580 0x7fa7a80cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 -- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 msgr2=0x7fa7a81f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 0x7fa7a81f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 -- 172.21.15.19:0/720770478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80cc2b0 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a7fff640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 0x7fa7a81f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a77fe640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02bf00 tx=0x7fa79c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00f000 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c03b440 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c03b810 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a80cc590 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.518+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a80ccb50 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.519+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a804f330 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.520+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa79c03b9b0 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.520+0000 7fa7a4ff9640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 0x7fa79406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.520+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa79c0ac730 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.521+0000 7fa7a7fff640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 0x7fa79406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.521+0000 7fa7a7fff640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 0x7fa79406d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806a380 tx=0x7fa798009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.525+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa79c07b5b0 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.707+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a806a090 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.708+0000 7fa7a4ff9640 1 -- 172.21.15.19:0/720770478 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7fa79c07aeb0 con 0x7fa7a80b7fd0 2024-03-04T08:52:40.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:40.704 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:40.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 msgr2=0x7fa79406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 0x7fa79406d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806a380 tx=0x7fa798009040 comp rx=0 tx=0).stop 2024-03-04T08:52:40.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 msgr2=0x7fa7a80b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02bf00 tx=0x7fa79c004730 comp rx=0 tx=0).stop 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 shutdown_connections 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa7a80cb580 0x7fa7a80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a80b7fd0 0x7fa7a80b8450 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa79406b4d0 0x7fa79406d990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 --2- 172.21.15.19:0/720770478 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa790003fd0 0x7fa7a81f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 >> 172.21.15.19:0/720770478 conn(0x7fa7a80d3cd0 msgr2=0x7fa7a80b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 shutdown_connections 2024-03-04T08:52:40.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.710+0000 7fa7ae40e640 1 -- 172.21.15.19:0/720770478 wait complete. 2024-03-04T08:52:40.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:40.718 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 Processor -- start 2024-03-04T08:52:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 -- start start 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99bc15c050 0x7f99bc06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 0x7f99bc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0cd4b0 con 0x7f99bc0ccca0 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc06ff80 con 0x7f99bc15c050 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99c1d5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cd790 con 0x7f99bc06fb40 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.826+0000 7f99bb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99bc15c050 0x7f99bc06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99bc15c050 0x7f99bc06f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40564/0 (socket says 172.21.15.19:40564) 2024-03-04T08:52:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 -- 172.21.15.19:0/308116661 learned_addr learned my addr 172.21.15.19:0/308116661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99baffd640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 0x7f99bc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 -- 172.21.15.19:0/308116661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 msgr2=0x7f99bc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 0x7f99bc0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 -- 172.21.15.19:0/308116661 >> v1:172.21.15.204:6789/0 conn(0x7f99bc0ccca0 legacy=0x7f99bc0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99bb7fe640 1 -- 172.21.15.19:0/308116661 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cda70 con 0x7f99bc15c050 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.827+0000 7f99baffd640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 0x7f99bc0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99bb7fe640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc15c050 0x7f99bc06f600 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e50 tx=0x7f99ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92411e421950e6a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99ba7fc640 1 -- 172.21.15.19:0/308116661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02ca70 con 0x7f99bc15c050 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99ba7fc640 1 -- 172.21.15.19:0/308116661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac02cc10 con 0x7f99bc15c050 2024-03-04T08:52:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99ba7fc640 1 -- 172.21.15.19:0/308116661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0343f0 con 0x7f99bc15c050 2024-03-04T08:52:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 -- 172.21.15.19:0/308116661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc15c050 msgr2=0x7f99bc06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc15c050 0x7f99bc06f600 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009e50 tx=0x7f99ac02bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 -- 172.21.15.19:0/308116661 shutdown_connections 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc06fb40 0x7f99bc0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/308116661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc15c050 0x7f99bc06f600 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 -- 172.21.15.19:0/308116661 >> 172.21.15.19:0/308116661 conn(0x7f99bc0b3800 msgr2=0x7f99bc0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 -- 172.21.15.19:0/308116661 shutdown_connections 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.828+0000 7f99c1d5e640 1 -- 172.21.15.19:0/308116661 wait complete. 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.829+0000 7f99c1d5e640 1 Processor -- start 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 -- start start 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99bc06fb40 0x7f99bc152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 0x7f99bc09ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0d01f0 con 0x7f99bc0ccca0 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cd130 con 0x7f99bc06fb40 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99c1d5e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0d0370 con 0x7f99bc15c050 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.830+0000 7f99baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40574/0 (socket says 172.21.15.19:40574) 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 -- 172.21.15.19:0/232175053 learned_addr learned my addr 172.21.15.19:0/232175053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99bb7fe640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99bc06fb40 0x7f99bc152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99bbfff640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 0x7f99bc09ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 -- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 msgr2=0x7f99bc09ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 0x7f99bc09ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 -- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99bc06fb40 msgr2=0x7f99bc152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99bc06fb40 0x7f99bc152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 -- 172.21.15.19:0/232175053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc09f410 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99bbfff640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 0x7f99bc09ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99baffd640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f99b000d800 tx=0x7f99b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0004030 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00041d0 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc09ce90 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00096a0 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.831+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc1552a0 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.832+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc09fe60 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.833+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99b0009840 con 0x7f99bc0ccca0 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.833+0000 7f99a3fff640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 0x7f99a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:40.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.833+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b008a440 con 0x7f99bc0ccca0 2024-03-04T08:52:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.833+0000 7f99bb7fe640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 0x7f99a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:40.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.834+0000 7f99bb7fe640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 0x7f99a806d9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f99ac035000 tx=0x7f99ac030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:40.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:40.838+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f99b0059350 con 0x7f99bc0ccca0 2024-03-04T08:52:41.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.018+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99bc068ff0 con 0x7f99bc0ccca0 2024-03-04T08:52:41.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.019+0000 7f99a3fff640 1 -- 172.21.15.19:0/232175053 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99b0058c50 con 0x7f99bc0ccca0 2024-03-04T08:52:41.015 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 msgr2=0x7f99a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 0x7f99a806d9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f99ac035000 tx=0x7f99ac030000 comp rx=0 tx=0).stop 2024-03-04T08:52:41.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 msgr2=0x7f99bc1519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f99b000d800 tx=0x7f99b000dcc0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 shutdown_connections 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f99bc15c050 0x7f99bc09ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99bc0ccca0 0x7f99bc1519f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f99a806b500 0x7f99a806d9c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 --2- 172.21.15.19:0/232175053 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f99bc06fb40 0x7f99bc152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 >> 172.21.15.19:0/232175053 conn(0x7f99bc0b3800 msgr2=0x7f99bc070230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 shutdown_connections 2024-03-04T08:52:41.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.021+0000 7f99c1d5e640 1 -- 172.21.15.19:0/232175053 wait complete. 2024-03-04T08:52:41.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:41.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.136+0000 7f01aedd7640 1 Processor -- start 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.136+0000 7f01aedd7640 1 -- start start 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01aedd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a815c050 0x7f01a806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01aedd7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01a806fb40 0x7f01a80cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01aedd7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80cd4b0 con 0x7f01a80ccca0 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01aedd7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a806ff80 con 0x7f01a806fb40 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01aedd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80cd790 con 0x7f01a815c050 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01a7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01a806fb40 0x7f01a80cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01ad374640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f01a80ccca0 0x7f01a80cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41836/0 (socket says 172.21.15.19:41836) 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01ad374640 1 -- 172.21.15.19:0/3923246794 learned_addr learned my addr 172.21.15.19:0/3923246794 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01acb73640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a815c050 0x7f01a806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01a7fff640 1 -- 172.21.15.19:0/3923246794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a815c050 msgr2=0x7f01a806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01a7fff640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a815c050 0x7f01a806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01a7fff640 1 -- 172.21.15.19:0/3923246794 >> v1:172.21.15.19:6789/0 conn(0x7f01a80ccca0 legacy=0x7f01a80cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.137+0000 7f01a7fff640 1 -- 172.21.15.19:0/3923246794 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80cda70 con 0x7f01a806fb40 2024-03-04T08:52:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.138+0000 7f01a7fff640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a806fb40 0x7f01a80cc760 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f01940097a0 tx=0x7f019402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef28cd5b031bd73 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.138+0000 7f01a77fe640 1 -- 172.21.15.19:0/3923246794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940315a0 con 0x7f01a806fb40 2024-03-04T08:52:41.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.138+0000 7f01a77fe640 1 -- 172.21.15.19:0/3923246794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194037070 con 0x7f01a806fb40 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.138+0000 7f01a77fe640 1 -- 172.21.15.19:0/3923246794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194031960 con 0x7f01a806fb40 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 -- 172.21.15.19:0/3923246794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a806fb40 msgr2=0x7f01a80cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a806fb40 0x7f01a80cc760 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f01940097a0 tx=0x7f019402b840 comp rx=0 tx=0).stop 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 -- 172.21.15.19:0/3923246794 shutdown_connections 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a806fb40 0x7f01a80cc760 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3923246794 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a815c050 0x7f01a806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 -- 172.21.15.19:0/3923246794 >> 172.21.15.19:0/3923246794 conn(0x7f01a80b3800 msgr2=0x7f01a80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 -- 172.21.15.19:0/3923246794 shutdown_connections 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.139+0000 7f01aedd7640 1 -- 172.21.15.19:0/3923246794 wait complete. 2024-03-04T08:52:41.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.140+0000 7f01aedd7640 1 Processor -- start 2024-03-04T08:52:41.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.140+0000 7f01aedd7640 1 -- start start 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a806fb40 0x7f01a80b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a80ccca0 0x7f01a81564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80d01f0 con 0x7f01a815c050 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80cd130 con 0x7f01a806fb40 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01aedd7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80d0370 con 0x7f01a80ccca0 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40596/0 (socket says 172.21.15.19:40596) 2024-03-04T08:52:41.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 -- 172.21.15.19:0/3739447629 learned_addr learned my addr 172.21.15.19:0/3739447629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 -- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a80ccca0 msgr2=0x7f01a81564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01a7fff640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a80ccca0 0x7f01a81564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01acb73640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a806fb40 0x7f01a80b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a80ccca0 0x7f01a81564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 -- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a806fb40 msgr2=0x7f01a80b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a806fb40 0x7f01a80b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 -- 172.21.15.19:0/3739447629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8157100 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.141+0000 7f01ad374640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f01a000cbc0 tx=0x7f01a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.142+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0017070 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.142+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000ad40 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.142+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81573e0 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.142+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0012600 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.142+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a8148390 con 0x7f01a815c050 2024-03-04T08:52:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.143+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8068ff0 con 0x7f01a815c050 2024-03-04T08:52:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.143+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f01a001a070 con 0x7f01a815c050 2024-03-04T08:52:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.143+0000 7f01a57fa640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 0x7f018c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.144+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a0089e20 con 0x7f01a815c050 2024-03-04T08:52:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.144+0000 7f01acb73640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 0x7f018c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.144+0000 7f01acb73640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 0x7f018c06d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f019c006fd0 tx=0x7f019c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.148+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f01a00586e0 con 0x7f01a815c050 2024-03-04T08:52:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.328+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01a80d1220 con 0x7f01a815c050 2024-03-04T08:52:41.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.328+0000 7f01a57fa640 1 -- 172.21.15.19:0/3739447629 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01a005c780 con 0x7f01a815c050 2024-03-04T08:52:41.324 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 msgr2=0x7f018c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 0x7f018c06d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f019c006fd0 tx=0x7f019c008040 comp rx=0 tx=0).stop 2024-03-04T08:52:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 msgr2=0x7f01a8156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f01a000cbc0 tx=0x7f01a000a430 comp rx=0 tx=0).stop 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 shutdown_connections 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01a815c050 0x7f01a8156a30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f01a80ccca0 0x7f01a81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f018c06b4d0 0x7f018c06d990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 --2- 172.21.15.19:0/3739447629 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f01a806fb40 0x7f01a80b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 >> 172.21.15.19:0/3739447629 conn(0x7f01a80b3800 msgr2=0x7f01a80cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 shutdown_connections 2024-03-04T08:52:41.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.330+0000 7f01aedd7640 1 -- 172.21.15.19:0/3739447629 wait complete. 2024-03-04T08:52:41.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:41.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.447+0000 7f5580f7a640 1 Processor -- start 2024-03-04T08:52:41.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.447+0000 7f5580f7a640 1 -- start start 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f5580f7a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f557c0d4860 0x7f557c0d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f5580f7a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f557c0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f5580f7a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c1618b0 con 0x7f557c1614d0 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f5580f7a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0d4cf0 con 0x7f557c0d4860 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f5580f7a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cf400 con 0x7f557c0b0e30 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f557a59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f557c1614d0 0x7f557c0d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41838/0 (socket says 172.21.15.19:41838) 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.448+0000 7f557a59c640 1 -- 172.21.15.19:0/1296881556 learned_addr learned my addr 172.21.15.19:0/1296881556 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557ad9d640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f557c0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687248673 0 0) 0x7f557c1618b0 con 0x7f557c1614d0 2024-03-04T08:52:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f5579d9b640 1 --2- 172.21.15.19:0/1296881556 >> v2:172.21.15.204:3300/0 conn(0x7f557c0d4860 0x7f557c0d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5568003520 con 0x7f557c1614d0 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574777110 0 0) 0x7f5568003520 con 0x7f557c1614d0 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 msgr2=0x7f557c0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f557c0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 >> v2:172.21.15.204:3300/0 conn(0x7f557c0d4860 msgr2=0x7f557c0d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 --2- 172.21.15.19:0/1296881556 >> v2:172.21.15.204:3300/0 conn(0x7f557c0d4860 0x7f557c0d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0cf6a0 con 0x7f557c1614d0 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f556c001670 con 0x7f557c1614d0 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 >> v1:172.21.15.19:6789/0 conn(0x7f557c1614d0 legacy=0x7f557c0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f55680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5568003f30 0x7f5568004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568004d40 0x7f55680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0d4cf0 con 0x7f5568003f30 2024-03-04T08:52:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cf400 con 0x7f5568004d40 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556800b9c0 con 0x7f557c0b0e30 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f5579d9b640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5568003f30 0x7f5568004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557a59c640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f55680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.449+0000 7f557ad9d640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568004d40 0x7f55680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 -- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 msgr2=0x7f55680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0b0e30 0x7f55680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 -- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568004d40 msgr2=0x7f55680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568004d40 0x7f55680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 -- 172.21.15.19:0/1296881556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568003520 con 0x7f5568003f30 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f5579d9b640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5568003f30 0x7f5568004800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ac0 tx=0x7f5568005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7398048036fce2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564039070 con 0x7f5568003f30 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556402c6d0 con 0x7f5568003f30 2024-03-04T08:52:41.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.450+0000 7f557959a640 1 -- 172.21.15.19:0/1296881556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564009690 con 0x7f5568003f30 2024-03-04T08:52:41.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 -- 172.21.15.19:0/1296881556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5568003f30 msgr2=0x7f5568004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 --2- 172.21.15.19:0/1296881556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5568003f30 0x7f5568004800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ac0 tx=0x7f5568005830 comp rx=0 tx=0).stop 2024-03-04T08:52:41.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f557ad9d640 1 -- 172.21.15.19:0/1296881556 reap_dead start 2024-03-04T08:52:41.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 -- 172.21.15.19:0/1296881556 shutdown_connections 2024-03-04T08:52:41.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 -- 172.21.15.19:0/1296881556 >> 172.21.15.19:0/1296881556 conn(0x7f557c0d3d40 msgr2=0x7f557c0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 -- 172.21.15.19:0/1296881556 shutdown_connections 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.451+0000 7f5580f7a640 1 -- 172.21.15.19:0/1296881556 wait complete. 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 Processor -- start 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 -- start start 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 0x7f557c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0ca230 0x7f557c0b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b0910 con 0x7f557c0b93f0 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0cfc60 con 0x7f5568003f30 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f5580f7a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0d2560 con 0x7f557c0ca230 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.453+0000 7f557ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40616/0 (socket says 172.21.15.19:40616) 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 -- 172.21.15.19:0/2608270735 learned_addr learned my addr 172.21.15.19:0/2608270735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557a59c640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 0x7f557c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5579d9b640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0ca230 0x7f557c0b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 -- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0ca230 msgr2=0x7f557c0b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0ca230 0x7f557c0b8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 -- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 msgr2=0x7f557c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 0x7f557c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 -- 172.21.15.19:0/2608270735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0c88c0 con 0x7f557c0b93f0 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557a59c640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 0x7f557c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f557ad9d640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f557c0cadc0 tx=0x7f557400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400fde0 con 0x7f557c0b93f0 2024-03-04T08:52:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5574015430 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574015820 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0c8b80 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.454+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0c9140 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.455+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0ce170 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.456+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f55740159c0 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.456+0000 7f5572ffd640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 0x7f555c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.456+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f557408af80 con 0x7f557c0b93f0 2024-03-04T08:52:41.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.456+0000 7f557a59c640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 0x7f555c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.457+0000 7f557a59c640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 0x7f555c06d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f556c001eb0 tx=0x7f556c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.460+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5574019030 con 0x7f557c0b93f0 2024-03-04T08:52:41.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.639+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f557c0d0a50 con 0x7f557c0b93f0 2024-03-04T08:52:41.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.640+0000 7f5572ffd640 1 -- 172.21.15.19:0/2608270735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5574010040 con 0x7f557c0b93f0 2024-03-04T08:52:41.636 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 msgr2=0x7f555c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 0x7f555c06d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f556c001eb0 tx=0x7f556c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 msgr2=0x7f557c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f557c0cadc0 tx=0x7f557400f580 comp rx=0 tx=0).stop 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 shutdown_connections 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f557c0b93f0 0x7f557c0cce20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f557c0ca230 0x7f557c0b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f555c06b4d0 0x7f555c06d990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 --2- 172.21.15.19:0/2608270735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5568003f30 0x7f557c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 >> 172.21.15.19:0/2608270735 conn(0x7f557c0d3d40 msgr2=0x7f557c0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 shutdown_connections 2024-03-04T08:52:41.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.642+0000 7f5580f7a640 1 -- 172.21.15.19:0/2608270735 wait complete. 2024-03-04T08:52:41.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:41.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.769+0000 7f589f429640 1 Processor -- start 2024-03-04T08:52:41.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.769+0000 7f589f429640 1 -- start start 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589f429640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58981586c0 0x7f589815efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589f429640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58980b0240 0x7f589806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589f429640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589815f520 con 0x7f589806b4f0 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589f429640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5898158aa0 con 0x7f58980b0240 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589f429640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589806b8f0 con 0x7f58981586c0 2024-03-04T08:52:41.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58980b0240 0x7f589806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58980b0240 0x7f589806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40626/0 (socket says 172.21.15.19:40626) 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 -- 172.21.15.19:0/941273934 learned_addr learned my addr 172.21.15.19:0/941273934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589d1c5640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58981586c0 0x7f589815efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 -- 172.21.15.19:0/941273934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58981586c0 msgr2=0x7f589815efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58981586c0 0x7f589815efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 -- 172.21.15.19:0/941273934 >> v1:172.21.15.204:6789/0 conn(0x7f589806b4f0 legacy=0x7f58980cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.771+0000 7f589c9c4640 1 -- 172.21.15.19:0/941273934 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980ce510 con 0x7f58980b0240 2024-03-04T08:52:41.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.772+0000 7f589c9c4640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58980b0240 0x7f589806afb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5888009870 tx=0x7f588802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c024ce46611b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.772+0000 7f588ffff640 1 -- 172.21.15.19:0/941273934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888034070 con 0x7f58980b0240 2024-03-04T08:52:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.772+0000 7f588ffff640 1 -- 172.21.15.19:0/941273934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888030840 con 0x7f58980b0240 2024-03-04T08:52:41.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.772+0000 7f588ffff640 1 -- 172.21.15.19:0/941273934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888030c10 con 0x7f58980b0240 2024-03-04T08:52:41.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 -- 172.21.15.19:0/941273934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58980b0240 msgr2=0x7f589806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58980b0240 0x7f589806afb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5888009870 tx=0x7f588802b980 comp rx=0 tx=0).stop 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 -- 172.21.15.19:0/941273934 shutdown_connections 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58980b0240 0x7f589806afb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 --2- 172.21.15.19:0/941273934 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58981586c0 0x7f589815efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 -- 172.21.15.19:0/941273934 >> 172.21.15.19:0/941273934 conn(0x7f58980d09d0 msgr2=0x7f58980d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 -- 172.21.15.19:0/941273934 shutdown_connections 2024-03-04T08:52:41.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.773+0000 7f589f429640 1 -- 172.21.15.19:0/941273934 wait complete. 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.774+0000 7f589f429640 1 Processor -- start 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.774+0000 7f589f429640 1 -- start start 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589806b4f0 0x7f5898158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58980b0240 0x7f58980b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981622b0 con 0x7f58981586c0 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898161fd0 con 0x7f589806b4f0 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589f429640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898162590 con 0x7f58980b0240 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40634/0 (socket says 172.21.15.19:40634) 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 -- 172.21.15.19:0/3522355312 learned_addr learned my addr 172.21.15.19:0/3522355312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 -- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58980b0240 msgr2=0x7f58980b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589c9c4640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58980b0240 0x7f58980b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d1c5640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589806b4f0 0x7f5898158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58980b0240 0x7f58980b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 -- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589806b4f0 msgr2=0x7f5898158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589806b4f0 0x7f5898158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 -- 172.21.15.19:0/3522355312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58981499c0 con 0x7f58981586c0 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f589d9c6640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7a0 tx=0x7f589400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894003b70 con 0x7f58981586c0 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.775+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894003d30 con 0x7f58981586c0 2024-03-04T08:52:41.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.776+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980b49b0 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.776+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400aa90 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.776+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58980b4f70 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.777+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589806deb0 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.777+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f589400ac30 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.777+0000 7f588dffb640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 0x7f587c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.778+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f589408a0c0 con 0x7f58981586c0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.778+0000 7f589d1c5640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 0x7f587c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:41.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.778+0000 7f589d1c5640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 0x7f587c06d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5890006fd0 tx=0x7f5890008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:41.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.782+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f589806deb0 con 0x7f58981586c0 2024-03-04T08:52:41.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.976+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f589804f330 con 0x7f58981586c0 2024-03-04T08:52:41.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.976+0000 7f588dffb640 1 -- 172.21.15.19:0/3522355312 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f58981499c0 con 0x7f58981586c0 2024-03-04T08:52:41.973 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:41.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 msgr2=0x7f587c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 0x7f587c06d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5890006fd0 tx=0x7f5890008040 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 msgr2=0x7f5898149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7a0 tx=0x7f589400cc60 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 shutdown_connections 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58981586c0 0x7f5898149480 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f58980b0240 0x7f58980b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f587c06b4d0 0x7f587c06d990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 --2- 172.21.15.19:0/3522355312 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f589806b4f0 0x7f5898158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 >> 172.21.15.19:0/3522355312 conn(0x7f58980d09d0 msgr2=0x7f5898072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 shutdown_connections 2024-03-04T08:52:41.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:41.978+0000 7f589f429640 1 -- 172.21.15.19:0/3522355312 wait complete. 2024-03-04T08:52:41.985 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:41.985 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:42.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:42.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.145+0000 7f52cac0e640 1 Processor -- start 2024-03-04T08:52:42.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.145+0000 7f52cac0e640 1 -- start start 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52cac0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52c40d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52cac0e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40b3430 con 0x7f52c415dfe0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52cac0e640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40b3710 con 0x7f52c40b41f0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52cac0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40d2c50 con 0x7f52c40d22b0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c89aa640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f52c415dfe0 0x7f52c40cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41846/0 (socket says 172.21.15.19:41846) 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c89aa640 1 -- 172.21.15.19:0/4144908914 learned_addr learned my addr 172.21.15.19:0/4144908914 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081252182 0 0) 0x7f52c40b3430 con 0x7f52c415dfe0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b4003520 con 0x7f52c415dfe0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c3fff640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52c40d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707066481 0 0) 0x7f52b4003520 con 0x7f52c415dfe0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 msgr2=0x7f52c40d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52c40d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 >> v1:172.21.15.204:6789/0 conn(0x7f52c40b41f0 legacy=0x7f52c40b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40b39f0 con 0x7f52c415dfe0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f52b8001670 con 0x7f52c415dfe0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 >> v1:172.21.15.19:6789/0 conn(0x7f52c415dfe0 legacy=0x7f52c40cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b40039e0 0x7f52b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52b4004d40 0x7f52b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b400bb50 con 0x7f52b40039e0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b400bcd0 con 0x7f52b4004d40 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b400bea0 con 0x7f52c40d22b0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.146+0000 7f52c89aa640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b40039e0 0x7f52b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c3fff640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c91ab640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52b4004d40 0x7f52b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c89aa640 1 -- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 msgr2=0x7f52b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c89aa640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52c40d22b0 0x7f52b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c89aa640 1 -- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52b4004d40 msgr2=0x7f52b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c89aa640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52b4004d40 0x7f52b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c89aa640 1 -- 172.21.15.19:0/4144908914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4003520 con 0x7f52b40039e0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.147+0000 7f52c91ab640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52b4004d40 0x7f52b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.148+0000 7f52c89aa640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b40039e0 0x7f52b4003e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c270 tx=0x7f52b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3500ad2cab0e5b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.148+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8007d10 con 0x7f52b40039e0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.148+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8030070 con 0x7f52b40039e0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.148+0000 7f52c37fe640 1 -- 172.21.15.19:0/4144908914 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b802cd60 con 0x7f52b40039e0 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 -- 172.21.15.19:0/4144908914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b40039e0 msgr2=0x7f52b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 --2- 172.21.15.19:0/4144908914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b40039e0 0x7f52b4003e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c270 tx=0x7f52b4005830 comp rx=0 tx=0).stop 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52c91ab640 1 -- 172.21.15.19:0/4144908914 reap_dead start 2024-03-04T08:52:42.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 -- 172.21.15.19:0/4144908914 shutdown_connections 2024-03-04T08:52:42.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 -- 172.21.15.19:0/4144908914 >> 172.21.15.19:0/4144908914 conn(0x7f52c40d3cd0 msgr2=0x7f52c40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:42.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 -- 172.21.15.19:0/4144908914 shutdown_connections 2024-03-04T08:52:42.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.149+0000 7f52cac0e640 1 -- 172.21.15.19:0/4144908914 wait complete. 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.150+0000 7f52cac0e640 1 Processor -- start 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.150+0000 7f52cac0e640 1 -- start start 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52b40039e0 0x7f52c40b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52c415fcf0 0x7f52c41f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b3d60 con 0x7f52c40b2060 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b31e0 con 0x7f52c415fcf0 2024-03-04T08:52:42.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40d1c70 con 0x7f52b40039e0 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40642/0 (socket says 172.21.15.19:40642) 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 -- 172.21.15.19:0/375201033 learned_addr learned my addr 172.21.15.19:0/375201033 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c89aa640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52b40039e0 0x7f52c40b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c3fff640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52c415fcf0 0x7f52c41f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 -- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52b40039e0 msgr2=0x7f52c40b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52b40039e0 0x7f52c40b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 -- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52c415fcf0 msgr2=0x7f52c41f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52c415fcf0 0x7f52c41f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 -- 172.21.15.19:0/375201033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4160380 con 0x7f52c40b2060 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c91ab640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f52c4067800 tx=0x7f52bc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc006b50 con 0x7f52c40b2060 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc006d10 con 0x7f52c40b2060 2024-03-04T08:52:42.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c415e4f0 con 0x7f52c40b2060 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc003970 con 0x7f52c40b2060 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.152+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c415ea70 con 0x7f52c40b2060 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.153+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c404f330 con 0x7f52c40b2060 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.154+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52bc01a020 con 0x7f52c40b2060 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.154+0000 7f52c17fa640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 0x7f52a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.155+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52bc0897b0 con 0x7f52c40b2060 2024-03-04T08:52:42.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.155+0000 7f52c89aa640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 0x7f52a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.155+0000 7f52c89aa640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 0x7f52a806d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f52b8034000 tx=0x7f52b8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.159+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f52bc0586c0 con 0x7f52c40b2060 2024-03-04T08:52:42.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.363+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c41600d0 con 0x7f52c40b2060 2024-03-04T08:52:42.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.364+0000 7f52c17fa640 1 -- 172.21.15.19:0/375201033 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f52bc057fc0 con 0x7f52c40b2060 2024-03-04T08:52:42.360 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:42.361 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 msgr2=0x7f52a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 0x7f52a806d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f52b8034000 tx=0x7f52b8009030 comp rx=0 tx=0).stop 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 msgr2=0x7f52c40b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f52c4067800 tx=0x7f52bc00eb90 comp rx=0 tx=0).stop 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 shutdown_connections 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c40b2060 0x7f52c40b2510 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f52a806b500 0x7f52a806d9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f52c415fcf0 0x7f52c41f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 --2- 172.21.15.19:0/375201033 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f52b40039e0 0x7f52c40b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 >> 172.21.15.19:0/375201033 conn(0x7f52c40d3cd0 msgr2=0x7f52c406ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 shutdown_connections 2024-03-04T08:52:42.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.367+0000 7f52cac0e640 1 -- 172.21.15.19:0/375201033 wait complete. 2024-03-04T08:52:42.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:42.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:42.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.483+0000 7fae43bb5640 1 Processor -- start 2024-03-04T08:52:42.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.484+0000 7fae43bb5640 1 -- start start 2024-03-04T08:52:42.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.484+0000 7fae43bb5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae3c15e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.484+0000 7fae43bb5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0cfa50 con 0x7fae3c0d10c0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.484+0000 7fae43bb5640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0b45c0 con 0x7fae3c15eb00 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.484+0000 7fae43bb5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c15c050 con 0x7fae3c0d14a0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae41951640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fae3c0d10c0 0x7fae3c0d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41860/0 (socket says 172.21.15.19:41860) 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae41951640 1 -- 172.21.15.19:0/2535068020 learned_addr learned my addr 172.21.15.19:0/2535068020 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae41150640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae3c15e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373485188 0 0) 0x7fae3c0cfa50 con 0x7fae3c0d10c0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae28003520 con 0x7fae3c0d10c0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715115218 0 0) 0x7fae3c0b45c0 con 0x7fae3c15eb00 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae3c0cfa50 con 0x7fae3c15eb00 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507977286 0 0) 0x7fae28003520 con 0x7fae3c0d10c0 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 msgr2=0x7fae3c15e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae3c15e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 >> v1:172.21.15.204:6789/0 conn(0x7fae3c15eb00 legacy=0x7fae3c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c15f160 con 0x7fae3c0d10c0 2024-03-04T08:52:42.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fae38001670 con 0x7fae3c0d10c0 2024-03-04T08:52:42.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 >> v1:172.21.15.19:6789/0 conn(0x7fae3c0d10c0 legacy=0x7fae3c0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae28003b70 0x7fae28003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae28004800 0x7fae28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800ba70 con 0x7fae28004800 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800bbf0 con 0x7fae28003b70 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2800bdc0 con 0x7fae3c0d14a0 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae41150640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae28004800 0x7fae28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.485+0000 7fae41951640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae28003b70 0x7fae28003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae42152640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 -- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 msgr2=0x7fae280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 -- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae28003b70 msgr2=0x7fae28003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae28003b70 0x7fae28003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 -- 172.21.15.19:0/2535068020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28003520 con 0x7fae28004800 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae42152640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae3c0d14a0 0x7fae280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.486+0000 7fae41150640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae28004800 0x7fae28004c80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fae30009ac0 tx=0x7fae28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f42f2ba6b904d30 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30039070 con 0x7fae28004800 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3002c660 con 0x7fae28004800 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae4094f640 1 -- 172.21.15.19:0/2535068020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30009690 con 0x7fae28004800 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 -- 172.21.15.19:0/2535068020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae28004800 msgr2=0x7fae28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 --2- 172.21.15.19:0/2535068020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae28004800 0x7fae28004c80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fae30009ac0 tx=0x7fae28005830 comp rx=0 tx=0).stop 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae42152640 1 -- 172.21.15.19:0/2535068020 reap_dead start 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 -- 172.21.15.19:0/2535068020 shutdown_connections 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 -- 172.21.15.19:0/2535068020 >> 172.21.15.19:0/2535068020 conn(0x7fae3c0b3800 msgr2=0x7fae3c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 -- 172.21.15.19:0/2535068020 shutdown_connections 2024-03-04T08:52:42.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.487+0000 7fae43bb5640 1 -- 172.21.15.19:0/2535068020 wait complete. 2024-03-04T08:52:42.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.488+0000 7fae43bb5640 1 Processor -- start 2024-03-04T08:52:42.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.488+0000 7fae43bb5640 1 -- start start 2024-03-04T08:52:42.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 0x7fae3c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae3c09c1b0 0x7fae3c09e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0cfcf0 con 0x7fae3c0ccba0 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0d0060 con 0x7fae3c09c1b0 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae43bb5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c15e5c0 con 0x7fae28004800 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40666/0 (socket says 172.21.15.19:40666) 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 -- 172.21.15.19:0/1560718947 learned_addr learned my addr 172.21.15.19:0/1560718947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae41150640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae3c09c1b0 0x7fae3c09e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae41951640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 0x7fae3c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 -- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 msgr2=0x7fae3c14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 0x7fae3c14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 -- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae3c09c1b0 msgr2=0x7fae3c09e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae3c09c1b0 0x7fae3c09e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae42152640 1 -- 172.21.15.19:0/1560718947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c09ed70 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.489+0000 7fae41951640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 0x7fae3c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae42152640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06ff60 tx=0x7fae3400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34018070 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34003b70 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c09f050 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34005070 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.490+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c09f610 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.491+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c09fe60 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.491+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae34005210 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.492+0000 7fae2e7fc640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 0x7fae2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.492+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae34089820 con 0x7fae3c0ccba0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.492+0000 7fae41951640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 0x7fae2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.492+0000 7fae41951640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 0x7fae2006d9c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae38000c00 tx=0x7fae38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.496+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fae34058110 con 0x7fae3c0ccba0 2024-03-04T08:52:42.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.828+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae3c068ff0 con 0x7fae3c0ccba0 2024-03-04T08:52:42.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.828+0000 7fae2e7fc640 1 -- 172.21.15.19:0/1560718947 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae3405c1b0 con 0x7fae3c0ccba0 2024-03-04T08:52:42.824 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.830+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 msgr2=0x7fae2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.830+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 0x7fae2006d9c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae38000c00 tx=0x7fae38009040 comp rx=0 tx=0).stop 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.830+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 msgr2=0x7fae3c0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.830+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06ff60 tx=0x7fae3400dc00 comp rx=0 tx=0).stop 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.830+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 shutdown_connections 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fae3c0ccba0 0x7fae3c0cd020 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fae2006b500 0x7fae2006d9c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae3c09c1b0 0x7fae3c09e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 --2- 172.21.15.19:0/1560718947 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fae28004800 0x7fae3c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 >> 172.21.15.19:0/1560718947 conn(0x7fae3c0b3800 msgr2=0x7fae3c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:42.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 shutdown_connections 2024-03-04T08:52:42.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.831+0000 7fae43bb5640 1 -- 172.21.15.19:0/1560718947 wait complete. 2024-03-04T08:52:42.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:42.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.946+0000 7f33057a2640 1 Processor -- start 2024-03-04T08:52:42.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f33057a2640 1 -- start start 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f33057a2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33000b3fe0 0x7f33000cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f33057a2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000d06c0 con 0x7f330015bd40 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f33057a2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000cc760 con 0x7f330015f7e0 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f33057a2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000ccdb0 con 0x7f33000b3fe0 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f32ff7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33000b3fe0 0x7f33000cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f32fffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f330015bd40 0x7f33000cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41864/0 (socket says 172.21.15.19:41864) 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.947+0000 7f32fffff640 1 -- 172.21.15.19:0/3916659615 learned_addr learned my addr 172.21.15.19:0/3916659615 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.948+0000 7f32ff7fe640 1 -- 172.21.15.19:0/3916659615 >> v1:172.21.15.204:6789/0 conn(0x7f330015f7e0 legacy=0x7f330015fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.948+0000 7f32ff7fe640 1 -- 172.21.15.19:0/3916659615 >> v1:172.21.15.19:6789/0 conn(0x7f330015bd40 legacy=0x7f33000cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.948+0000 7f32ff7fe640 1 -- 172.21.15.19:0/3916659615 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000cca40 con 0x7f33000b3fe0 2024-03-04T08:52:42.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.948+0000 7f32feffd640 1 -- 172.21.15.19:0/3916659615 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384158122 0 0) 0x7f33000d06c0 con 0x7f330015bd40 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f32ff7fe640 1 --2- 172.21.15.19:0/3916659615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33000b3fe0 0x7f33000cd240 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f32f00097a0 tx=0x7f32f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b99fcc126f50d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f32feffd640 1 -- 172.21.15.19:0/3916659615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0035020 con 0x7f33000b3fe0 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f32feffd640 1 -- 172.21.15.19:0/3916659615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0031830 con 0x7f33000b3fe0 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f32feffd640 1 -- 172.21.15.19:0/3916659615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0031c00 con 0x7f33000b3fe0 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 -- 172.21.15.19:0/3916659615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33000b3fe0 msgr2=0x7f33000cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 --2- 172.21.15.19:0/3916659615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33000b3fe0 0x7f33000cd240 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f32f00097a0 tx=0x7f32f002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 -- 172.21.15.19:0/3916659615 shutdown_connections 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 --2- 172.21.15.19:0/3916659615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33000b3fe0 0x7f33000cd240 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 -- 172.21.15.19:0/3916659615 >> 172.21.15.19:0/3916659615 conn(0x7f33000b3450 msgr2=0x7f33000b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 -- 172.21.15.19:0/3916659615 shutdown_connections 2024-03-04T08:52:42.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.949+0000 7f33057a2640 1 -- 172.21.15.19:0/3916659615 wait complete. 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.950+0000 7f33057a2640 1 Processor -- start 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 -- start start 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 0x7f3300158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f330015bd40 0x7f33001561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000cc3a0 con 0x7f330015f7e0 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330015c120 con 0x7f330015bd40 2024-03-04T08:52:42.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f33057a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000cc520 con 0x7f33000b3fe0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.951+0000 7f3304fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40686/0 (socket says 172.21.15.19:40686) 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 -- 172.21.15.19:0/2166147979 learned_addr learned my addr 172.21.15.19:0/2166147979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32ff7fe640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f330015bd40 0x7f33001561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32fffff640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 0x7f3300158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 -- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 msgr2=0x7f3300158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 0x7f3300158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 -- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f330015bd40 msgr2=0x7f33001561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f330015bd40 0x7f33001561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 -- 172.21.15.19:0/2166147979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000c6140 con 0x7f330015f7e0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32fffff640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 0x7f3300158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f3304fa1640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7b0 tx=0x7f32f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004b60 con 0x7f330015f7e0 2024-03-04T08:52:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8004d00 con 0x7f330015f7e0 2024-03-04T08:52:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33000c6420 con 0x7f330015f7e0 2024-03-04T08:52:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f800aa90 con 0x7f330015f7e0 2024-03-04T08:52:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.952+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33000c69e0 con 0x7f330015f7e0 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.953+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300068f10 con 0x7f330015f7e0 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.954+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f32f800ac30 con 0x7f330015f7e0 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.954+0000 7f32fcff9640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 0x7f32ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.954+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32f808a6f0 con 0x7f330015f7e0 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.954+0000 7f32fffff640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 0x7f32ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:42.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.955+0000 7f32fffff640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 0x7f32ec06d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000f60 tx=0x7f32f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:42.958+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f32f8059600 con 0x7f330015f7e0 2024-03-04T08:52:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.141+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f330015a860 con 0x7f330015f7e0 2024-03-04T08:52:43.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.141+0000 7f32fcff9640 1 -- 172.21.15.19:0/2166147979 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32f8058f00 con 0x7f330015f7e0 2024-03-04T08:52:43.137 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:43.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 msgr2=0x7f32ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 0x7f32ec06d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000f60 tx=0x7f32f4009040 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 msgr2=0x7f3300156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7b0 tx=0x7f32f800cc70 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 shutdown_connections 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f330015f7e0 0x7f3300156700 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f32ec06b4d0 0x7f32ec06d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f330015bd40 0x7f33001561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 --2- 172.21.15.19:0/2166147979 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33000b3fe0 0x7f3300158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 >> 172.21.15.19:0/2166147979 conn(0x7f33000b3450 msgr2=0x7f330015fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 shutdown_connections 2024-03-04T08:52:43.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.143+0000 7f33057a2640 1 -- 172.21.15.19:0/2166147979 wait complete. 2024-03-04T08:52:43.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:43.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.258+0000 7f8ffba37640 1 Processor -- start 2024-03-04T08:52:43.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.258+0000 7f8ffba37640 1 -- start start 2024-03-04T08:52:43.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ffba37640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ffba37640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8ff4066d90 0x7f8ff40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ffba37640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff406b710 con 0x7f8ff40b5410 2024-03-04T08:52:43.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ffba37640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff40b5880 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ffba37640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff406b150 con 0x7f8ff4066d90 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40694/0 (socket says 172.21.15.19:40694) 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3401983182 learned_addr learned my addr 172.21.15.19:0/3401983182 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff8fd2640 1 --2- 172.21.15.19:0/3401983182 >> v2:172.21.15.204:3300/0 conn(0x7f8ff4066d90 0x7f8ff40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3401983182 >> v2:172.21.15.204:3300/0 conn(0x7f8ff4066d90 msgr2=0x7f8ff40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 --2- 172.21.15.19:0/3401983182 >> v2:172.21.15.204:3300/0 conn(0x7f8ff4066d90 0x7f8ff40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3401983182 >> v1:172.21.15.204:6789/0 conn(0x7f8ff40b5410 legacy=0x7f8ff4072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.259+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3401983182 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff406b430 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8ff97d3640 1 --2- 172.21.15.19:0/3401983182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40d11d0 tx=0x7f8ff002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b59c61ad854791b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8febfff640 1 -- 172.21.15.19:0/3401983182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0034070 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8febfff640 1 -- 172.21.15.19:0/3401983182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0030860 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8febfff640 1 -- 172.21.15.19:0/3401983182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0030c30 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8ffba37640 1 -- 172.21.15.19:0/3401983182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff40cf9a0 msgr2=0x7f8ff40b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.260+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3401983182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40d11d0 tx=0x7f8ff002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 -- 172.21.15.19:0/3401983182 shutdown_connections 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3401983182 >> v2:172.21.15.204:3300/0 conn(0x7f8ff4066d90 0x7f8ff40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3401983182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff40b5ab0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 -- 172.21.15.19:0/3401983182 >> 172.21.15.19:0/3401983182 conn(0x7f8ff40b1d70 msgr2=0x7f8ff40b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 -- 172.21.15.19:0/3401983182 shutdown_connections 2024-03-04T08:52:43.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.261+0000 7f8ffba37640 1 -- 172.21.15.19:0/3401983182 wait complete. 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 Processor -- start 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 -- start start 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 0x7f8ff409a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff409d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40b5ff0 con 0x7f8ff4066d90 2024-03-04T08:52:43.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40b0c50 con 0x7f8ff40cf9a0 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.262+0000 7f8ffba37640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40b6170 con 0x7f8ff40b5410 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40702/0 (socket says 172.21.15.19:40702) 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3824971485 learned_addr learned my addr 172.21.15.19:0/3824971485 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff9fd4640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff409d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff8fd2640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 0x7f8ff409a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 msgr2=0x7f8ff409a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 0x7f8ff409a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ff40cf9a0 msgr2=0x7f8ff409d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff409d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 -- 172.21.15.19:0/3824971485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40cd900 con 0x7f8ff4066d90 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff8fd2640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 0x7f8ff409a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ff97d3640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000c00 tx=0x7f8ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0034040 con 0x7f8ff4066d90 2024-03-04T08:52:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0039d90 con 0x7f8ff4066d90 2024-03-04T08:52:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0043630 con 0x7f8ff4066d90 2024-03-04T08:52:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.263+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff409ce20 con 0x7f8ff4066d90 2024-03-04T08:52:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.264+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff40cd560 con 0x7f8ff4066d90 2024-03-04T08:52:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.264+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff409e3d0 con 0x7f8ff4066d90 2024-03-04T08:52:43.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.265+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ff0037070 con 0x7f8ff4066d90 2024-03-04T08:52:43.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.266+0000 7f8fe9ffb640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 0x7f8fd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.266+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ff00ac1e0 con 0x7f8ff4066d90 2024-03-04T08:52:43.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.266+0000 7f8ff8fd2640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 0x7f8fd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.267+0000 7f8ff8fd2640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 0x7f8fd806d9c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4158060 tx=0x7f8fe4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.270+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8ff003e070 con 0x7f8ff4066d90 2024-03-04T08:52:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.449+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ff4068ff0 con 0x7f8ff4066d90 2024-03-04T08:52:43.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.449+0000 7f8fe9ffb640 1 -- 172.21.15.19:0/3824971485 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ff007b0f0 con 0x7f8ff4066d90 2024-03-04T08:52:43.445 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 msgr2=0x7f8fd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 0x7f8fd806d9c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4158060 tx=0x7f8fe4008040 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 msgr2=0x7f8ff406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000c00 tx=0x7f8ff00046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 shutdown_connections 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8fd806b500 0x7f8fd806d9c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ff40cf9a0 0x7f8ff409d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ff40b5410 0x7f8ff409a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 --2- 172.21.15.19:0/3824971485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ff4066d90 0x7f8ff406e540 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 >> 172.21.15.19:0/3824971485 conn(0x7f8ff40b1d70 msgr2=0x7f8ff40af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 shutdown_connections 2024-03-04T08:52:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.451+0000 7f8ffba37640 1 -- 172.21.15.19:0/3824971485 wait complete. 2024-03-04T08:52:43.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.564+0000 7fdde2a9d640 1 Processor -- start 2024-03-04T08:52:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.564+0000 7fdde2a9d640 1 -- start start 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde2a9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdddc162970 0x7fdddc0d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde2a9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc161cf0 0x7fdddc162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde2a9d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0d22c0 con 0x7fdddc0b4460 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde2a9d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc161b00 con 0x7fdddc162970 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde2a9d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0cecc0 con 0x7fdddc161cf0 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdddc162970 0x7fdddc0d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdddc162970 0x7fdddc0d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40710/0 (socket says 172.21.15.19:40710) 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 -- 172.21.15.19:0/3121758824 learned_addr learned my addr 172.21.15.19:0/3121758824 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdde103a640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc161cf0 0x7fdddc162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 -- 172.21.15.19:0/3121758824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc161cf0 msgr2=0x7fdddc162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc161cf0 0x7fdddc162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 -- 172.21.15.19:0/3121758824 >> v1:172.21.15.204:6789/0 conn(0x7fdddc0b4460 legacy=0x7fdddc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:43.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.565+0000 7fdddbfff640 1 -- 172.21.15.19:0/3121758824 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0d25a0 con 0x7fdddc162970 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.566+0000 7fdddbfff640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc162970 0x7fdddc0d4800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf3dccc1e7e4d31 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.566+0000 7fdddb7fe640 1 -- 172.21.15.19:0/3121758824 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8035020 con 0x7fdddc162970 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.566+0000 7fdddb7fe640 1 -- 172.21.15.19:0/3121758824 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8031640 con 0x7fdddc162970 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.566+0000 7fdddb7fe640 1 -- 172.21.15.19:0/3121758824 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc802d040 con 0x7fdddc162970 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3121758824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc162970 msgr2=0x7fdddc0d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc162970 0x7fdddc0d4800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3121758824 shutdown_connections 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc161cf0 0x7fdddc162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3121758824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc162970 0x7fdddc0d4800 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3121758824 >> 172.21.15.19:0/3121758824 conn(0x7fdddc0d3ce0 msgr2=0x7fdddc0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3121758824 shutdown_connections 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.567+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3121758824 wait complete. 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.568+0000 7fdde2a9d640 1 Processor -- start 2024-03-04T08:52:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.568+0000 7fdde2a9d640 1 -- start start 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdddc161cf0 0x7fdddc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc162970 0x7fdddc0b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0ce950 con 0x7fdddc0b4460 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0d2b60 con 0x7fdddc161cf0 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde2a9d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b4840 con 0x7fdddc162970 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40718/0 (socket says 172.21.15.19:40718) 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 -- 172.21.15.19:0/3724747619 learned_addr learned my addr 172.21.15.19:0/3724747619 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdddbfff640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdddc161cf0 0x7fdddc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde103a640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc162970 0x7fdddc0b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 -- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc162970 msgr2=0x7fdddc0b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc162970 0x7fdddc0b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 -- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdddc161cf0 msgr2=0x7fdddc0b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdddc161cf0 0x7fdddc0b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.569+0000 7fdde0839640 1 -- 172.21.15.19:0/3724747619 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0cd1c0 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fdde0839640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fddd000b3f0 tx=0x7fddd000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0015020 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0011830 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc0cd4a0 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0011c20 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.570+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc0cda60 con 0x7fdddc0b4460 2024-03-04T08:52:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.571+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04f330 con 0x7fdddc0b4460 2024-03-04T08:52:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.571+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fddd0018020 con 0x7fdddc0b4460 2024-03-04T08:52:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.572+0000 7fddd97fa640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 0x7fddc006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.572+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd0089ed0 con 0x7fdddc0b4460 2024-03-04T08:52:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.572+0000 7fdddbfff640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 0x7fddc006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.572+0000 7fdddbfff640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 0x7fddc006d9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fddc8036000 tx=0x7fddc803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:43.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.580+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fddd001f030 con 0x7fdddc0b4460 2024-03-04T08:52:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.771+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdddc06b180 con 0x7fdddc0b4460 2024-03-04T08:52:43.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.771+0000 7fddd97fa640 1 -- 172.21.15.19:0/3724747619 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fddd00172c0 con 0x7fdddc0b4460 2024-03-04T08:52:43.768 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 msgr2=0x7fddc006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 0x7fddc006d9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fddc8036000 tx=0x7fddc803c040 comp rx=0 tx=0).stop 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 msgr2=0x7fdddc1f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fddd000b3f0 tx=0x7fddd000b8b0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 shutdown_connections 2024-03-04T08:52:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdddc162970 0x7fdddc0b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fddc006b500 0x7fddc006d9c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdddc161cf0 0x7fdddc0b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 --2- 172.21.15.19:0/3724747619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdddc0b4460 0x7fdddc1f3200 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 >> 172.21.15.19:0/3724747619 conn(0x7fdddc0d3ce0 msgr2=0x7fdddc0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 shutdown_connections 2024-03-04T08:52:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:43.773+0000 7fdde2a9d640 1 -- 172.21.15.19:0/3724747619 wait complete. 2024-03-04T08:52:43.780 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:52:43.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:43.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:43.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[57514]: fuse finished with error 0 and tester_r 0 2024-03-04T08:52:43.808 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:43.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:43.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:43.856 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:43.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:52:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.017+0000 7fbdb8c8d640 1 Processor -- start 2024-03-04T08:52:44.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.017+0000 7fbdb8c8d640 1 -- start start 2024-03-04T08:52:44.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb8c8d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb8c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb40b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb8c8d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40b3430 con 0x7fbdb40cf830 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb8c8d640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40b31e0 con 0x7fbdb415dfe0 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb8c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b3d60 con 0x7fbdb40d29c0 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40734/0 (socket says 172.21.15.19:40734) 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb259c640 1 -- 172.21.15.19:0/2568714938 learned_addr learned my addr 172.21.15.19:0/2568714938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb259c640 1 -- 172.21.15.19:0/2568714938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 msgr2=0x7fbdb40b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.018+0000 7fbdb2d9d640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb40b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb259c640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb40b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb259c640 1 -- 172.21.15.19:0/2568714938 >> v1:172.21.15.204:6789/0 conn(0x7fbdb40cf830 legacy=0x7fbdb40d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb259c640 1 -- 172.21.15.19:0/2568714938 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40b3710 con 0x7fbdb415dfe0 2024-03-04T08:52:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb2d9d640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:44.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb259c640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009870 tx=0x7fbda402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfadcf3bf94d00dc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:44.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb1d9b640 1 -- 172.21.15.19:0/2568714938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4035020 con 0x7fbdb415dfe0 2024-03-04T08:52:44.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb1d9b640 1 -- 172.21.15.19:0/2568714938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4031640 con 0x7fbdb415dfe0 2024-03-04T08:52:44.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.019+0000 7fbdb1d9b640 1 -- 172.21.15.19:0/2568714938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda402d040 con 0x7fbdb415dfe0 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/2568714938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb415dfe0 msgr2=0x7fbdb40cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009870 tx=0x7fbda402b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/2568714938 shutdown_connections 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/2568714938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40cf2f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/2568714938 >> 172.21.15.19:0/2568714938 conn(0x7fbdb40d3cd0 msgr2=0x7fbdb40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/2568714938 shutdown_connections 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.020+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/2568714938 wait complete. 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 Processor -- start 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 -- start start 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40d1df0 con 0x7fbdb40cf830 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40d1c70 con 0x7fbdb415dfe0 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb8c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb415e3c0 con 0x7fbdb40d29c0 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40744/0 (socket says 172.21.15.19:40744) 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.022+0000 7fbdb259c640 1 -- 172.21.15.19:0/1811346963 learned_addr learned my addr 172.21.15.19:0/1811346963 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb2d9d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdabfff640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 -- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 msgr2=0x7fbdb415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 -- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 msgr2=0x7fbdb40b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 -- 172.21.15.19:0/1811346963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40b9b60 con 0x7fbdb40cf830 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb2d9d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdabfff640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb259c640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbda402b930 tx=0x7fbda40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4040070 con 0x7fbdb40cf830 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4039c10 con 0x7fbdb40cf830 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4035040 con 0x7fbdb40cf830 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb40b92c0 con 0x7fbdb40cf830 2024-03-04T08:52:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.023+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb40b9880 con 0x7fbdb40cf830 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.024+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb404f330 con 0x7fbdb40cf830 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.025+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbda404b060 con 0x7fbdb40cf830 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.025+0000 7fbdaaffd640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.025+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda40abd70 con 0x7fbdb40cf830 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.025+0000 7fbdabfff640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.026+0000 7fbdabfff640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 0x7fbd9406d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ca100 tx=0x7fbd9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:44.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.033+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbda402f300 con 0x7fbdb40cf830 2024-03-04T08:52:44.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.252+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbdb4154d00 con 0x7fbdb40cf830 2024-03-04T08:52:44.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.252+0000 7fbdaaffd640 1 -- 172.21.15.19:0/1811346963 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbda407ab70 con 0x7fbdb40cf830 2024-03-04T08:52:44.249 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.254+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 msgr2=0x7fbd9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.254+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 0x7fbd9406d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ca100 tx=0x7fbd9c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.254+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 msgr2=0x7fbdb41547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.254+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbda402b930 tx=0x7fbda40046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 shutdown_connections 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdb415dfe0 0x7fbdb40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdb40d29c0 0x7fbdb415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 --2- 172.21.15.19:0/1811346963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdb40cf830 0x7fbdb41547c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 >> 172.21.15.19:0/1811346963 conn(0x7fbdb40d3cd0 msgr2=0x7fbdb406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 shutdown_connections 2024-03-04T08:52:44.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:44.255+0000 7fbdb8c8d640 1 -- 172.21.15.19:0/1811346963 wait complete. 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:52:44.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:52:44.263 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:44.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.263 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:44.278 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42530sec preferred_lft 42530sec 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:52:44.279 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:44.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.280 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:52:44.344 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:52:44.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.345 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:52:44.400 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:52:44.401 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:52:44.401 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:52:44.401 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:52:44.401 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:52:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.401 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:52:44.401 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:52:44.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:52:44.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:52:44.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:52:44.402 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:52:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.496 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:52:44.510 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:52:44.510 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:52:44.511 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:44.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:52:44.577 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:52:44.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:44.578 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:44.633 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:44.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:44.633 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:44.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:44.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:44.730 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:52:44.754 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:44.835 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:44.835 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:44.835 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:44.836 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:44.837 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:44.838 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:44.838 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:44.838 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:44.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:44.838 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:44.890 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:52:44.890 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:52:44.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:44.959 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:45.016 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:45.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:45.018 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:45.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:52:45.021+0000 7f271c437480 -1 init, newargv = 0x5646a32207a0 newargc=15 2024-03-04T08:52:45.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[58496]: starting ceph client 2024-03-04T08:52:45.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[58496]: starting fuse 2024-03-04T08:52:45.034 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:52:45.034 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:45.035 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:52:45.036 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:52:45.037 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:52:45.037 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:45.037 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:52:45.037 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:45.155 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.58496.asok 2024-03-04T08:52:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:52:45.165 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58496.asok 2024-03-04T08:52:45.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:45.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58496.asok status 2024-03-04T08:52:45.301 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:45.301 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "58496", 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6225, 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:52:45.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 6225 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2296643097 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2296643097 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:45.303 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.6225 192.168.0.1:0/2296643097", 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/2296643097", 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 22, 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 49, 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:52:45.304 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:45.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:45.310 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:52:45.310 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:45.324 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:52:45.324 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:45.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:45.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:45.391 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-03-04T08:52:45.391 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> import errno 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> if False: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> ret = os.read(fd, 1024) 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> else: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> os.write(fd, b'"'"'content'"'"') 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> if e.errno != errno.EPERM: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> raise 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> else: 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("client does not check permission of data pool") 2024-03-04T08:52:45.392 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:45.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:52:45.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-03-04T08:52:45.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.665+0000 7f11631a2640 1 Processor -- start 2024-03-04T08:52:45.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.665+0000 7f11631a2640 1 -- start start 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11631a2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f115c0b41a0 0x7f115c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11631a2640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f115c0b1960 0x7f115c160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11631a2640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0ccf80 con 0x7f115c0b1580 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11631a2640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0cf540 con 0x7f115c0b1960 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11631a2640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0d09e0 con 0x7f115c0b41a0 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f115c0b1960 0x7f115c160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f115c0b1960 0x7f115c160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40746/0 (socket says 172.21.15.19:40746) 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 -- 172.21.15.19:0/3317816979 learned_addr learned my addr 172.21.15.19:0/3317816979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f116199f640 1 --2- 172.21.15.19:0/3317816979 >> v2:172.21.15.204:3300/0 conn(0x7f115c0b41a0 0x7f115c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 -- 172.21.15.19:0/3317816979 >> v2:172.21.15.204:3300/0 conn(0x7f115c0b41a0 msgr2=0x7f115c15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 --2- 172.21.15.19:0/3317816979 >> v2:172.21.15.204:3300/0 conn(0x7f115c0b41a0 0x7f115c15fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 -- 172.21.15.19:0/3317816979 >> v1:172.21.15.204:6789/0 conn(0x7f115c0b1580 legacy=0x7f115c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.666+0000 7f11629a1640 1 -- 172.21.15.19:0/3317816979 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0cd260 con 0x7f115c0b1960 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.667+0000 7f11629a1640 1 --2- 172.21.15.19:0/3317816979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1960 0x7f115c160160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f115c071890 tx=0x7f115402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dce5f9878bec4e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.667+0000 7f116119e640 1 -- 172.21.15.19:0/3317816979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115402cb20 con 0x7f115c0b1960 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.667+0000 7f116119e640 1 -- 172.21.15.19:0/3317816979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115402ccc0 con 0x7f115c0b1960 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.667+0000 7f116119e640 1 -- 172.21.15.19:0/3317816979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154034610 con 0x7f115c0b1960 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 -- 172.21.15.19:0/3317816979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1960 msgr2=0x7f115c160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 --2- 172.21.15.19:0/3317816979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1960 0x7f115c160160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f115c071890 tx=0x7f115402bf80 comp rx=0 tx=0).stop 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 -- 172.21.15.19:0/3317816979 shutdown_connections 2024-03-04T08:52:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 --2- 172.21.15.19:0/3317816979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1960 0x7f115c160160 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 --2- 172.21.15.19:0/3317816979 >> v2:172.21.15.204:3300/0 conn(0x7f115c0b41a0 0x7f115c15fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 -- 172.21.15.19:0/3317816979 >> 172.21.15.19:0/3317816979 conn(0x7f115c0b34c0 msgr2=0x7f115c0b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 -- 172.21.15.19:0/3317816979 shutdown_connections 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.668+0000 7f11631a2640 1 -- 172.21.15.19:0/3317816979 wait complete. 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.669+0000 7f11631a2640 1 Processor -- start 2024-03-04T08:52:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.669+0000 7f11631a2640 1 -- start start 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f115c0b1960 0x7f115c1f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 0x7f115c1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ccc20 con 0x7f115c0b1580 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0cd820 con 0x7f115c0b1960 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11631a2640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ae730 con 0x7f115c0b41a0 2024-03-04T08:52:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40756/0 (socket says 172.21.15.19:40756) 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 -- 172.21.15.19:0/2292153094 learned_addr learned my addr 172.21.15.19:0/2292153094 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f116199f640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f115c0b1960 0x7f115c1f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11629a1640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 0x7f115c1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 -- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 msgr2=0x7f115c1f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 0x7f115c1f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 -- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f115c0b1960 msgr2=0x7f115c1f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f115c0b1960 0x7f115c1f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11621a0640 1 -- 172.21.15.19:0/2292153094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c15da10 con 0x7f115c0b1580 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.670+0000 7f11629a1640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 0x7f115c1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f11621a0640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f115800c3c0 tx=0x7f115800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580052d0 con 0x7f115c0b1580 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1158005490 con 0x7f115c0b1580 2024-03-04T08:52:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c15dcf0 con 0x7f115c0b1580 2024-03-04T08:52:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158007260 con 0x7f115c0b1580 2024-03-04T08:52:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.671+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c15e2b0 con 0x7f115c0b1580 2024-03-04T08:52:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.672+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c068f10 con 0x7f115c0b1580 2024-03-04T08:52:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.673+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1158007400 con 0x7f115c0b1580 2024-03-04T08:52:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.673+0000 7f1152ffd640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 0x7f114006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.673+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1158089600 con 0x7f115c0b1580 2024-03-04T08:52:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.673+0000 7f116199f640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 0x7f114006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.674+0000 7f116199f640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 0x7f114006d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f115c06f470 tx=0x7f114c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:45.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.682+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1158057e30 con 0x7f115c0b1580 2024-03-04T08:52:45.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.931+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f115c0aea30 con 0x7f115c0b1580 2024-03-04T08:52:45.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.933+0000 7f1152ffd640 1 -- 172.21.15.19:0/2292153094 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+140 (secure 0 0 0) 0x7f115805bed0 con 0x7f115c0b1580 2024-03-04T08:52:45.929 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:45.929 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:45.930 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:52:45.930 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:45.930 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow w pool=cephfs_data" 2024-03-04T08:52:45.930 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:45.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 msgr2=0x7f114006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 0x7f114006d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f115c06f470 tx=0x7f114c008040 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 msgr2=0x7f115c15eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f115800c3c0 tx=0x7f115800c880 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 shutdown_connections 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f115c0b41a0 0x7f115c1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f114006b4d0 0x7f114006d990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f115c0b1960 0x7f115c1f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 --2- 172.21.15.19:0/2292153094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f115c0b1580 0x7f115c15eab0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 >> 172.21.15.19:0/2292153094 conn(0x7f115c0b34c0 msgr2=0x7f115c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 shutdown_connections 2024-03-04T08:52:45.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:45.935+0000 7f11631a2640 1 -- 172.21.15.19:0/2292153094 wait complete. 2024-03-04T08:52:45.942 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:45.942 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:45.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:46.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 Processor -- start 2024-03-04T08:52:46.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 -- start start 2024-03-04T08:52:46.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb1b80b4170 0x7fb1b80b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1b80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b80d25d0 con 0x7fb1b80d4760 2024-03-04T08:52:46.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80d4bf0 con 0x7fb1b80b4170 2024-03-04T08:52:46.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1be4d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ce9e0 con 0x7fb1b80d0a80 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1b77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb1b80d4760 0x7fb1b80d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41870/0 (socket says 172.21.15.19:41870) 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.102+0000 7fb1b77fe640 1 -- 172.21.15.19:0/3400179992 learned_addr learned my addr 172.21.15.19:0/3400179992 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1bca71640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1b80cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672234400 0 0) 0x7fb1b80d25d0 con 0x7fb1b80d4760 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b7fff640 1 --2- 172.21.15.19:0/3400179992 >> v2:172.21.15.204:3300/0 conn(0x7fb1b80b4170 0x7fb1b80b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003520 con 0x7fb1b80d4760 2024-03-04T08:52:46.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1974759703 0 0) 0x7fb1a0003520 con 0x7fb1b80d4760 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 msgr2=0x7fb1b80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1b80cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 >> v2:172.21.15.204:3300/0 conn(0x7fb1b80b4170 msgr2=0x7fb1b80b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 --2- 172.21.15.19:0/3400179992 >> v2:172.21.15.204:3300/0 conn(0x7fb1b80b4170 0x7fb1b80b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80d2870 con 0x7fb1b80d4760 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7fb1ac001690 con 0x7fb1b80d4760 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 >> v1:172.21.15.19:6789/0 conn(0x7fb1b80d4760 legacy=0x7fb1b80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a00039b0 0x7fb1a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80d4bf0 con 0x7fb1a0004d40 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ce9e0 con 0x7fb1a00039b0 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000b9c0 con 0x7fb1b80d0a80 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1bca71640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b7fff640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a00039b0 0x7fb1a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.103+0000 7fb1b77fe640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 -- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 msgr2=0x7fb1a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80d0a80 0x7fb1a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 -- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a00039b0 msgr2=0x7fb1a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1a00039b0 0x7fb1a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 -- 172.21.15.19:0/3400179992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0003520 con 0x7fb1a0004d40 2024-03-04T08:52:46.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1bca71640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009fc0 tx=0x7fb1a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da588faa6f424bf server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0039070 con 0x7fb1a0004d40 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b002cbd0 con 0x7fb1a0004d40 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.104+0000 7fb1b6ffd640 1 -- 172.21.15.19:0/3400179992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0009c10 con 0x7fb1a0004d40 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 -- 172.21.15.19:0/3400179992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1a0004d40 msgr2=0x7fb1a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/3400179992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1a0004d40 0x7fb1a00051c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009fc0 tx=0x7fb1a0005830 comp rx=0 tx=0).stop 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1bca71640 1 -- 172.21.15.19:0/3400179992 reap_dead start 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 -- 172.21.15.19:0/3400179992 shutdown_connections 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 -- 172.21.15.19:0/3400179992 >> 172.21.15.19:0/3400179992 conn(0x7fb1b80d3c40 msgr2=0x7fb1b80d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 -- 172.21.15.19:0/3400179992 shutdown_connections 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.105+0000 7fb1be4d4640 1 -- 172.21.15.19:0/3400179992 wait complete. 2024-03-04T08:52:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.107+0000 7fb1be4d4640 1 Processor -- start 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.107+0000 7fb1be4d4640 1 -- start start 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80ca360 0x7fb1b815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b8156e90 0x7fb1b80b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b4dd0 con 0x7fb1b80ca740 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b4550 con 0x7fb1b8156e90 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.108+0000 7fb1be4d4640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b4f50 con 0x7fb1b80ca360 2024-03-04T08:52:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40778/0 (socket says 172.21.15.19:40778) 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 -- 172.21.15.19:0/759874660 learned_addr learned my addr 172.21.15.19:0/759874660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1b7fff640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80ca360 0x7fb1b815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1b77fe640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b8156e90 0x7fb1b80b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 -- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80ca360 msgr2=0x7fb1b815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80ca360 0x7fb1b815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 -- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b8156e90 msgr2=0x7fb1b80b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b8156e90 0x7fb1b80b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 -- 172.21.15.19:0/759874660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b81576e0 con 0x7fb1b80ca740 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1bca71640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0037040 tx=0x7fb1b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0039030 con 0x7fb1b80ca740 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b0043070 con 0x7fb1b80ca740 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b81589e0 con 0x7fb1b80ca740 2024-03-04T08:52:46.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0009c10 con 0x7fb1b80ca740 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.109+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8158fa0 con 0x7fb1b80ca740 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.110+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b804f330 con 0x7fb1b80ca740 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.111+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1b0005d10 con 0x7fb1b80ca740 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.111+0000 7fb1b4ff9640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 0x7fb1a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.111+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1b00ac280 con 0x7fb1b80ca740 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.111+0000 7fb1b7fff640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 0x7fb1a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.112+0000 7fb1b7fff640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 0x7fb1a406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009bc0 tx=0x7fb1a8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.120+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb1b007b250 con 0x7fb1b80ca740 2024-03-04T08:52:46.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.300+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b80733b0 con 0x7fb1b80ca740 2024-03-04T08:52:46.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.301+0000 7fb1b4ff9640 1 -- 172.21.15.19:0/759874660 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7fb1b007ab50 con 0x7fb1b80ca740 2024-03-04T08:52:46.298 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:46.298 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:46.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 msgr2=0x7fb1a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 0x7fb1a406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009bc0 tx=0x7fb1a8009190 comp rx=0 tx=0).stop 2024-03-04T08:52:46.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 msgr2=0x7fb1b80b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0037040 tx=0x7fb1b0009750 comp rx=0 tx=0).stop 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 shutdown_connections 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b80ca740 0x7fb1b80b0d30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb1a406b4d0 0x7fb1a406d990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb1b8156e90 0x7fb1b80b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 --2- 172.21.15.19:0/759874660 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb1b80ca360 0x7fb1b815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 >> 172.21.15.19:0/759874660 conn(0x7fb1b80d3c40 msgr2=0x7fb1b806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 shutdown_connections 2024-03-04T08:52:46.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.304+0000 7fb1be4d4640 1 -- 172.21.15.19:0/759874660 wait complete. 2024-03-04T08:52:46.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:46.311 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:46.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 Processor -- start 2024-03-04T08:52:46.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 -- start start 2024-03-04T08:52:46.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15bbb0 0x7f2f1c06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0cea90 con 0x7f2f1c15ee10 2024-03-04T08:52:46.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c161bc0 con 0x7f2f1c06b4f0 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.422+0000 7f2f22681640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c161970 con 0x7f2f1c15bbb0 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f20c1e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2f1c15ee10 0x7f2f1c071ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41878/0 (socket says 172.21.15.19:41878) 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f20c1e640 1 -- 172.21.15.19:0/965230013 learned_addr learned my addr 172.21.15.19:0/965230013 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15bbb0 0x7f2f1c06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343968417 0 0) 0x7f2f14001490 con 0x7f2f1c15ee10 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f04003520 con 0x7f2f1c15ee10 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565304979 0 0) 0x7f2f04003520 con 0x7f2f1c15ee10 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15bbb0 msgr2=0x7f2f1c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15bbb0 0x7f2f1c06afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 >> v1:172.21.15.204:6789/0 conn(0x7f2f1c06b4f0 legacy=0x7f2f1c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c161ea0 con 0x7f2f1c15ee10 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f2f14001bc0 con 0x7f2f1c15ee10 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 >> v1:172.21.15.19:6789/0 conn(0x7f2f1c15ee10 legacy=0x7f2f1c071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f040039e0 0x7f2f04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f04004390 0x7f2f04004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f04004f80 0x7f2f0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c161970 con 0x7f2f040039e0 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0400bf00 con 0x7f2f04004f80 2024-03-04T08:52:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0400c080 con 0x7f2f04004390 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f040039e0 0x7f2f04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f1b7fe640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f04004390 0x7f2f04004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.423+0000 7f2f20c1e640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f04004f80 0x7f2f0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 -- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f04004390 msgr2=0x7f2f04004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f04004390 0x7f2f04004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 -- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f04004f80 msgr2=0x7f2f0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f04004f80 0x7f2f0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 -- 172.21.15.19:0/965230013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04003520 con 0x7f2f040039e0 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f20c1e640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f04004f80 0x7f2f0400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:46.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f040039e0 0x7f2f04003dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009ac0 tx=0x7f2f04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62404a88ccbb11fb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.424+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c039070 con 0x7f2f040039e0 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c02c6b0 con 0x7f2f040039e0 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f1affd640 1 -- 172.21.15.19:0/965230013 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c009690 con 0x7f2f040039e0 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 -- 172.21.15.19:0/965230013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f040039e0 msgr2=0x7f2f04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 --2- 172.21.15.19:0/965230013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f040039e0 0x7f2f04003dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009ac0 tx=0x7f2f04005830 comp rx=0 tx=0).stop 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f20c1e640 1 -- 172.21.15.19:0/965230013 reap_dead start 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 -- 172.21.15.19:0/965230013 shutdown_connections 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 -- 172.21.15.19:0/965230013 >> 172.21.15.19:0/965230013 conn(0x7f2f1c0b2660 msgr2=0x7f2f1c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 -- 172.21.15.19:0/965230013 shutdown_connections 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.425+0000 7f2f22681640 1 -- 172.21.15.19:0/965230013 wait complete. 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.426+0000 7f2f22681640 1 Processor -- start 2024-03-04T08:52:46.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.426+0000 7f2f22681640 1 -- start start 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f040039e0 0x7f2f1c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15c5c0 0x7f2f1c14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c06afb0 con 0x7f2f1c156b50 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1624f0 con 0x7f2f040039e0 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f22681640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c06b130 con 0x7f2f1c15c5c0 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f20c1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f20c1e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40802/0 (socket says 172.21.15.19:40802) 2024-03-04T08:52:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f20c1e640 1 -- 172.21.15.19:0/3074228451 learned_addr learned my addr 172.21.15.19:0/3074228451 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f040039e0 0x7f2f1c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.427+0000 7f2f1b7fe640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15c5c0 0x7f2f1c14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 -- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15c5c0 msgr2=0x7f2f1c14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15c5c0 0x7f2f1c14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 -- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f040039e0 msgr2=0x7f2f1c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f040039e0 0x7f2f1c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 -- 172.21.15.19:0/3074228451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c154b80 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f20c1e640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2f14002230 tx=0x7f2f14007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400ab90 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400ad30 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c154e60 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14014670 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.428+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c155420 con 0x7f2f1c156b50 2024-03-04T08:52:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.429+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c0733b0 con 0x7f2f1c156b50 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.429+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f14014810 con 0x7f2f1c156b50 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.430+0000 7f2f18ff9640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 0x7f2f0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.430+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f1408a010 con 0x7f2f1c156b50 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.430+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 0x7f2f0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.430+0000 7f2f1bfff640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 0x7f2f0806d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c036000 tx=0x7f2f0c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.434+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2f1c0cea90 con 0x7f2f1c156b50 2024-03-04T08:52:46.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.644+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f1c068ff0 con 0x7f2f1c156b50 2024-03-04T08:52:46.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.645+0000 7f2f18ff9640 1 -- 172.21.15.19:0/3074228451 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f140588d0 con 0x7f2f1c156b50 2024-03-04T08:52:46.641 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 msgr2=0x7f2f0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 0x7f2f0806d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c036000 tx=0x7f2f0c030000 comp rx=0 tx=0).stop 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 msgr2=0x7f2f1c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2f14002230 tx=0x7f2f14007bc0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 shutdown_connections 2024-03-04T08:52:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f1c156b50 0x7f2f1c157000 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f2f1c15c5c0 0x7f2f1c14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f2f0806b4d0 0x7f2f0806d990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 --2- 172.21.15.19:0/3074228451 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2f040039e0 0x7f2f1c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 >> 172.21.15.19:0/3074228451 conn(0x7f2f1c0b2660 msgr2=0x7f2f1c0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 shutdown_connections 2024-03-04T08:52:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.647+0000 7f2f22681640 1 -- 172.21.15.19:0/3074228451 wait complete. 2024-03-04T08:52:46.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.762+0000 7fbdf4365640 1 Processor -- start 2024-03-04T08:52:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.762+0000 7fbdf4365640 1 -- start start 2024-03-04T08:52:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf4365640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 0x7fbdec0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf4365640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fbdec0d1910 0x7fbdec0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf4365640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec0d2740 con 0x7fbdec0d22b0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf4365640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec1618b0 con 0x7fbdec0d1910 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf4365640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0cf400 con 0x7fbdec1614d0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf2902640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbdec0d22b0 0x7fbdec0d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41882/0 (socket says 172.21.15.19:41882) 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf2902640 1 -- 172.21.15.19:0/3596314259 learned_addr learned my addr 172.21.15.19:0/3596314259 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf2101640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 0x7fbdec0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf1900640 1 --2- 172.21.15.19:0/3596314259 >> v2:172.21.15.204:3300/0 conn(0x7fbdec0d1910 0x7fbdec0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf10ff640 1 -- 172.21.15.19:0/3596314259 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455231967 0 0) 0x7fbde4001490 con 0x7fbdec0d22b0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf10ff640 1 -- 172.21.15.19:0/3596314259 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd8003520 con 0x7fbdec0d22b0 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf1900640 1 -- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 msgr2=0x7fbdec0d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf1900640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 0x7fbdec0d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf1900640 1 -- 172.21.15.19:0/3596314259 >> v1:172.21.15.19:6789/0 conn(0x7fbdec0d22b0 legacy=0x7fbdec0d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf1900640 1 -- 172.21.15.19:0/3596314259 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0cf6a0 con 0x7fbdec0d1910 2024-03-04T08:52:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.763+0000 7fbdf2101640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 0x7fbdec0d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.764+0000 7fbdf1900640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d1910 0x7fbdec0d1d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0097a0 tx=0x7fbddc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d6e97111960279 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.764+0000 7fbdf10ff640 1 -- 172.21.15.19:0/3596314259 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc035020 con 0x7fbdec0d1910 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.764+0000 7fbdf10ff640 1 -- 172.21.15.19:0/3596314259 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc031830 con 0x7fbdec0d1910 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.764+0000 7fbdf10ff640 1 -- 172.21.15.19:0/3596314259 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc031be0 con 0x7fbdec0d1910 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 -- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d1910 msgr2=0x7fbdec0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d1910 0x7fbdec0d1d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0097a0 tx=0x7fbddc02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 -- 172.21.15.19:0/3596314259 shutdown_connections 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d1910 0x7fbdec0d1d70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 --2- 172.21.15.19:0/3596314259 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec1614d0 0x7fbdec0d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 -- 172.21.15.19:0/3596314259 >> 172.21.15.19:0/3596314259 conn(0x7fbdec0d3d40 msgr2=0x7fbdec0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 -- 172.21.15.19:0/3596314259 shutdown_connections 2024-03-04T08:52:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.765+0000 7fbdf4365640 1 -- 172.21.15.19:0/3596314259 wait complete. 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.766+0000 7fbdf4365640 1 Processor -- start 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.766+0000 7fbdf4365640 1 -- start start 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec0d1910 0x7fbdec1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d22b0 0x7fbdec0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0b0910 con 0x7fbdec1614d0 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0cfc60 con 0x7fbdec0d22b0 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf4365640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0b1e40 con 0x7fbdec0d1910 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40808/0 (socket says 172.21.15.19:40808) 2024-03-04T08:52:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 -- 172.21.15.19:0/2804076902 learned_addr learned my addr 172.21.15.19:0/2804076902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf1900640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d22b0 0x7fbdec0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2101640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec0d1910 0x7fbdec1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 -- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec0d1910 msgr2=0x7fbdec1f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec0d1910 0x7fbdec1f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 -- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d22b0 msgr2=0x7fbdec0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d22b0 0x7fbdec0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.767+0000 7fbdf2902640 1 -- 172.21.15.19:0/2804076902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0b6e90 con 0x7fbdec1614d0 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbdf2902640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cb50 tx=0x7fbde400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4017070 con 0x7fbdec1614d0 2024-03-04T08:52:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400ace0 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec0b7170 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4012620 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.768+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec0c8ad0 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.769+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec068ff0 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.769+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbde401a070 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.770+0000 7fbde2ffd640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 0x7fbdd006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.770+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbde4089ff0 con 0x7fbdec1614d0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.770+0000 7fbdf2101640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 0x7fbdd006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.770+0000 7fbdf2101640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 0x7fbdd006d9c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009a30 tx=0x7fbde8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.774+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbdec0d2740 con 0x7fbdec1614d0 2024-03-04T08:52:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.960+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdec15f5a0 con 0x7fbdec1614d0 2024-03-04T08:52:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.960+0000 7fbde2ffd640 1 -- 172.21.15.19:0/2804076902 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbde4058e80 con 0x7fbdec1614d0 2024-03-04T08:52:46.957 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 msgr2=0x7fbdd006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 0x7fbdd006d9c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009a30 tx=0x7fbde8008040 comp rx=0 tx=0).stop 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 msgr2=0x7fbdec154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cb50 tx=0x7fbde400a430 comp rx=0 tx=0).stop 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 shutdown_connections 2024-03-04T08:52:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdec1614d0 0x7fbdec154de0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fbdd006b500 0x7fbdd006d9c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbdec0d22b0 0x7fbdec0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 --2- 172.21.15.19:0/2804076902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fbdec0d1910 0x7fbdec1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 >> 172.21.15.19:0/2804076902 conn(0x7fbdec0d3d40 msgr2=0x7fbdec15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 shutdown_connections 2024-03-04T08:52:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:46.962+0000 7fbdf4365640 1 -- 172.21.15.19:0/2804076902 wait complete. 2024-03-04T08:52:46.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:47.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.078+0000 7fa367839640 1 Processor -- start 2024-03-04T08:52:47.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.078+0000 7fa367839640 1 -- start start 2024-03-04T08:52:47.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa367839640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa36006fd10 0x7fa3600cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa367839640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa3600d0af0 0x7fa3600ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa367839640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3600cd1e0 con 0x7fa36015c050 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa367839640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600cd4b0 con 0x7fa36006fd10 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa367839640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600cd790 con 0x7fa3600d0af0 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa364dd4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa36006fd10 0x7fa3600cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa3655d5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa36015c050 0x7fa36006f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41884/0 (socket says 172.21.15.19:41884) 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa3655d5640 1 -- 172.21.15.19:0/3855261421 learned_addr learned my addr 172.21.15.19:0/3855261421 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa365dd6640 1 --2- 172.21.15.19:0/3855261421 >> v2:172.21.15.204:3300/0 conn(0x7fa3600d0af0 0x7fa3600ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa364dd4640 1 -- 172.21.15.19:0/3855261421 >> v2:172.21.15.204:3300/0 conn(0x7fa3600d0af0 msgr2=0x7fa3600ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa364dd4640 1 --2- 172.21.15.19:0/3855261421 >> v2:172.21.15.204:3300/0 conn(0x7fa3600d0af0 0x7fa3600ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa364dd4640 1 -- 172.21.15.19:0/3855261421 >> v1:172.21.15.19:6789/0 conn(0x7fa36015c050 legacy=0x7fa36006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa357fff640 1 -- 172.21.15.19:0/3855261421 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239163196 0 0) 0x7fa3600cd1e0 con 0x7fa36015c050 2024-03-04T08:52:47.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.079+0000 7fa364dd4640 1 -- 172.21.15.19:0/3855261421 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600cda70 con 0x7fa36006fd10 2024-03-04T08:52:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.080+0000 7fa364dd4640 1 --2- 172.21.15.19:0/3855261421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36006fd10 0x7fa3600cc760 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa3600729c0 tx=0x7fa35002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b91f008c64489 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.080+0000 7fa357fff640 1 -- 172.21.15.19:0/3855261421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500315a0 con 0x7fa36006fd10 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.080+0000 7fa357fff640 1 -- 172.21.15.19:0/3855261421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa350037070 con 0x7fa36006fd10 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.080+0000 7fa357fff640 1 -- 172.21.15.19:0/3855261421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350031960 con 0x7fa36006fd10 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 -- 172.21.15.19:0/3855261421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36006fd10 msgr2=0x7fa3600cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 --2- 172.21.15.19:0/3855261421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36006fd10 0x7fa3600cc760 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa3600729c0 tx=0x7fa35002b840 comp rx=0 tx=0).stop 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 -- 172.21.15.19:0/3855261421 shutdown_connections 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 --2- 172.21.15.19:0/3855261421 >> v2:172.21.15.204:3300/0 conn(0x7fa3600d0af0 0x7fa3600ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 --2- 172.21.15.19:0/3855261421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36006fd10 0x7fa3600cc760 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 -- 172.21.15.19:0/3855261421 >> 172.21.15.19:0/3855261421 conn(0x7fa3600b3800 msgr2=0x7fa3600b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 -- 172.21.15.19:0/3855261421 shutdown_connections 2024-03-04T08:52:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.081+0000 7fa367839640 1 -- 172.21.15.19:0/3855261421 wait complete. 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.082+0000 7fa367839640 1 Processor -- start 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.082+0000 7fa367839640 1 -- start start 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa36006fd10 0x7fa360159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3600d0af0 0x7fa3600b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360165c30 con 0x7fa36015c050 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360165ab0 con 0x7fa36006fd10 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa367839640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa360165db0 con 0x7fa3600d0af0 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40814/0 (socket says 172.21.15.19:40814) 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 -- 172.21.15.19:0/1919787405 learned_addr learned my addr 172.21.15.19:0/1919787405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa3655d5640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa36006fd10 0x7fa360159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa364dd4640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3600d0af0 0x7fa3600b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 -- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3600d0af0 msgr2=0x7fa3600b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3600d0af0 0x7fa3600b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 -- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa36006fd10 msgr2=0x7fa360159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa36006fd10 0x7fa360159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 -- 172.21.15.19:0/1919787405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36015a3f0 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa365dd6640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa358007d80 tx=0x7fa35800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.083+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358014420 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.084+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358019070 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.084+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358014800 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.084+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36015a6a0 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.084+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36015ac60 con 0x7fa36015c050 2024-03-04T08:52:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.085+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36009fe60 con 0x7fa36015c050 2024-03-04T08:52:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.085+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa3580149a0 con 0x7fa36015c050 2024-03-04T08:52:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.085+0000 7fa355ffb640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 0x7fa34406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.086+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa35808aa30 con 0x7fa36015c050 2024-03-04T08:52:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.086+0000 7fa3655d5640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 0x7fa34406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.086+0000 7fa3655d5640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 0x7fa34406d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f60 tx=0x7fa35c007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.090+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa3580598b0 con 0x7fa36015c050 2024-03-04T08:52:47.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.273+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa360068ff0 con 0x7fa36015c050 2024-03-04T08:52:47.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.273+0000 7fa355ffb640 1 -- 172.21.15.19:0/1919787405 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3580591b0 con 0x7fa36015c050 2024-03-04T08:52:47.270 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 msgr2=0x7fa34406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 0x7fa34406d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f60 tx=0x7fa35c007c00 comp rx=0 tx=0).stop 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 msgr2=0x7fa360152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa358007d80 tx=0x7fa35800e4b0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 shutdown_connections 2024-03-04T08:52:47.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa36015c050 0x7fa360152720 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa3600d0af0 0x7fa3600b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa34406b4d0 0x7fa34406d990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 --2- 172.21.15.19:0/1919787405 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa36006fd10 0x7fa360159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 >> 172.21.15.19:0/1919787405 conn(0x7fa3600b3800 msgr2=0x7fa3600d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 shutdown_connections 2024-03-04T08:52:47.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.276+0000 7fa367839640 1 -- 172.21.15.19:0/1919787405 wait complete. 2024-03-04T08:52:47.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.392+0000 7f5db917a640 1 Processor -- start 2024-03-04T08:52:47.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.392+0000 7f5db917a640 1 -- start start 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db917a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40b4460 0x7f5db40d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db917a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5db4162970 0x7f5db40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db917a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db40d22c0 con 0x7f5db4161cf0 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db917a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4161b00 con 0x7f5db4162970 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db917a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40cecc0 con 0x7f5db40b4460 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5db4162970 0x7f5db40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5db4162970 0x7f5db40b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55416/0 (socket says 172.21.15.19:55416) 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 -- 172.21.15.19:0/3837424027 learned_addr learned my addr 172.21.15.19:0/3837424027 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db2d9d640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40b4460 0x7f5db40d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 -- 172.21.15.19:0/3837424027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40b4460 msgr2=0x7f5db40d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40b4460 0x7f5db40d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 -- 172.21.15.19:0/3837424027 >> v1:172.21.15.204:6789/0 conn(0x7f5db4161cf0 legacy=0x7f5db40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.393+0000 7f5db259c640 1 -- 172.21.15.19:0/3837424027 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40d25a0 con 0x7f5db4162970 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.394+0000 7f5db259c640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db4162970 0x7f5db40b3580 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009870 tx=0x7f5da802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432da1cfc4ff3ffc server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.394+0000 7f5db1d9b640 1 -- 172.21.15.19:0/3837424027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8035020 con 0x7f5db4162970 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.394+0000 7f5db1d9b640 1 -- 172.21.15.19:0/3837424027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8031640 con 0x7f5db4162970 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.394+0000 7f5db1d9b640 1 -- 172.21.15.19:0/3837424027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da802d040 con 0x7f5db4162970 2024-03-04T08:52:47.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 -- 172.21.15.19:0/3837424027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db4162970 msgr2=0x7f5db40b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db4162970 0x7f5db40b3580 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009870 tx=0x7f5da802b8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 -- 172.21.15.19:0/3837424027 shutdown_connections 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db4162970 0x7f5db40b3580 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 --2- 172.21.15.19:0/3837424027 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db40b4460 0x7f5db40d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 -- 172.21.15.19:0/3837424027 >> 172.21.15.19:0/3837424027 conn(0x7f5db40d3ce0 msgr2=0x7f5db40d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 -- 172.21.15.19:0/3837424027 shutdown_connections 2024-03-04T08:52:47.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.395+0000 7f5db917a640 1 -- 172.21.15.19:0/3837424027 wait complete. 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.396+0000 7f5db917a640 1 Processor -- start 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.396+0000 7f5db917a640 1 -- start start 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db4161cf0 0x7f5db40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 0x7f5db40cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40ce950 con 0x7f5db40b4460 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40d2b60 con 0x7f5db4161cf0 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db917a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40b3ac0 con 0x7f5db4162970 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55430/0 (socket says 172.21.15.19:55430) 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 -- 172.21.15.19:0/2166034352 learned_addr learned my addr 172.21.15.19:0/2166034352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db259c640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db4161cf0 0x7f5db40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db359e640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 0x7f5db40cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 -- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 msgr2=0x7f5db40cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 0x7f5db40cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 -- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db4161cf0 msgr2=0x7f5db40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db4161cf0 0x7f5db40ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db2d9d640 1 -- 172.21.15.19:0/2166034352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40b8720 con 0x7f5db40b4460 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.397+0000 7f5db359e640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 0x7f5db40cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5db2d9d640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5da400d5f0 tx=0x7f5da400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40125f0 con 0x7f5db40b4460 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4019070 con 0x7f5db40b4460 2024-03-04T08:52:47.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40129d0 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db40b6e00 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.398+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40b73c0 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.399+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db404f330 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.399+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5da4012b70 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.400+0000 7f5d9b7fe640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 0x7f5da006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.400+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5da408a610 con 0x7f5db40b4460 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.400+0000 7f5db259c640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 0x7f5da006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.400+0000 7f5db259c640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 0x7f5da006d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5da8036000 tx=0x7f5da803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.408+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5db40b8720 con 0x7f5db40b4460 2024-03-04T08:52:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.601+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5db406b180 con 0x7f5db40b4460 2024-03-04T08:52:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.602+0000 7f5d9b7fe640 1 -- 172.21.15.19:0/2166034352 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5da4059490 con 0x7f5db40b4460 2024-03-04T08:52:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 msgr2=0x7f5da006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 0x7f5da006d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5da8036000 tx=0x7f5da803c040 comp rx=0 tx=0).stop 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 msgr2=0x7f5db40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5da400d5f0 tx=0x7f5da400dab0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 shutdown_connections 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5db4162970 0x7f5db40cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5da006b4d0 0x7f5da006d990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5db4161cf0 0x7f5db40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 --2- 172.21.15.19:0/2166034352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5db40b4460 0x7f5db40b89e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 >> 172.21.15.19:0/2166034352 conn(0x7f5db40d3ce0 msgr2=0x7f5db40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.603+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 shutdown_connections 2024-03-04T08:52:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.604+0000 7f5db917a640 1 -- 172.21.15.19:0/2166034352 wait complete. 2024-03-04T08:52:47.611 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:47.611 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:47.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:47.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.769+0000 7f7c4f65c640 1 Processor -- start 2024-03-04T08:52:47.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4f65c640 1 -- start start 2024-03-04T08:52:47.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4f65c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c480b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4f65c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480b3430 con 0x7f7c480d22b0 2024-03-04T08:52:47.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4f65c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480b3710 con 0x7f7c4815dfe0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4f65c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b31e0 con 0x7f7c480d2710 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4cbf7640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c480d22b0 0x7f7c480b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41010/0 (socket says 172.21.15.19:41010) 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.770+0000 7f7c4cbf7640 1 -- 172.21.15.19:0/4230243278 learned_addr learned my addr 172.21.15.19:0/4230243278 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4dbf9640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c480b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126378950 0 0) 0x7f7c480b3430 con 0x7f7c480d22b0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c34003520 con 0x7f7c480d22b0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269330996 0 0) 0x7f7c480b3710 con 0x7f7c4815dfe0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c480b3430 con 0x7f7c4815dfe0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551424831 0 0) 0x7f7c34003520 con 0x7f7c480d22b0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 msgr2=0x7f7c480b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c480b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 >> v1:172.21.15.204:6789/0 conn(0x7f7c4815dfe0 legacy=0x7f7c480cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480b39f0 con 0x7f7c480d22b0 2024-03-04T08:52:47.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f7c38001670 con 0x7f7c480d22b0 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 >> v1:172.21.15.19:6789/0 conn(0x7f7c480d22b0 legacy=0x7f7c480b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34003b70 0x7f7c34003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b31e0 con 0x7f7c34004800 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3400baa0 con 0x7f7c34003b70 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3400bca0 con 0x7f7c480d2710 2024-03-04T08:52:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4d3f8640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34003b70 0x7f7c34003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4dbf9640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 -- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 msgr2=0x7f7c340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480d2710 0x7f7c340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 -- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34003b70 msgr2=0x7f7c34003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34003b70 0x7f7c34003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4cbf7640 1 -- 172.21.15.19:0/4230243278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34003520 con 0x7f7c34004800 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.771+0000 7f7c4d3f8640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34003b70 0x7f7c34003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.772+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c160 tx=0x7f7c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703244a4a7a9c061 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.772+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38007cc0 con 0x7f7c34004800 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.772+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38030070 con 0x7f7c34004800 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.772+0000 7f7c3ffff640 1 -- 172.21.15.19:0/4230243278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38005d30 con 0x7f7c34004800 2024-03-04T08:52:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 -- 172.21.15.19:0/4230243278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c34004800 msgr2=0x7f7c34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/4230243278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c34004800 0x7f7c34004c80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c160 tx=0x7f7c34005830 comp rx=0 tx=0).stop 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4dbf9640 1 -- 172.21.15.19:0/4230243278 reap_dead start 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 -- 172.21.15.19:0/4230243278 shutdown_connections 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 -- 172.21.15.19:0/4230243278 >> 172.21.15.19:0/4230243278 conn(0x7f7c480d3cd0 msgr2=0x7f7c480d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 -- 172.21.15.19:0/4230243278 shutdown_connections 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.773+0000 7f7c4f65c640 1 -- 172.21.15.19:0/4230243278 wait complete. 2024-03-04T08:52:47.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.774+0000 7f7c4f65c640 1 Processor -- start 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.774+0000 7f7c4f65c640 1 -- start start 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34004800 0x7f7c481f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 0x7f7c4806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480cfa00 con 0x7f7c4815bdc0 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b3d60 con 0x7f7c34004800 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4f65c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480d1c70 con 0x7f7c480b4eb0 2024-03-04T08:52:47.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55454/0 (socket says 172.21.15.19:55454) 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 -- 172.21.15.19:0/3800503925 learned_addr learned my addr 172.21.15.19:0/3800503925 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4d3f8640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34004800 0x7f7c481f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 0x7f7c4806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 -- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 msgr2=0x7f7c4806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 0x7f7c4806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 -- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34004800 msgr2=0x7f7c481f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34004800 0x7f7c481f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4dbf9640 1 -- 172.21.15.19:0/3800503925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4815c780 con 0x7f7c4815bdc0 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.775+0000 7f7c4cbf7640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 0x7f7c4806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c4dbf9640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7c4808c940 tx=0x7f7c440115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44003990 con 0x7f7c4815bdc0 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4401b070 con 0x7f7c4815bdc0 2024-03-04T08:52:47.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44003b70 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c481f4b20 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.776+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c481f50e0 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.777+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4804f330 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.778+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c44005d10 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.778+0000 7f7c3dffb640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 0x7f7c2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.778+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c4408a4d0 con 0x7f7c4815bdc0 2024-03-04T08:52:47.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.778+0000 7f7c4d3f8640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 0x7f7c2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:47.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.779+0000 7f7c4d3f8640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 0x7f7c2c06d9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007fd0 tx=0x7f7c40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:47.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.782+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7c4815c780 con 0x7f7c4815bdc0 2024-03-04T08:52:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.986+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c480b2d90 con 0x7f7c4815bdc0 2024-03-04T08:52:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.987+0000 7f7c3dffb640 1 -- 172.21.15.19:0/3800503925 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f7c440593e0 con 0x7f7c4815bdc0 2024-03-04T08:52:47.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:47.984 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 msgr2=0x7f7c2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 0x7f7c2c06d9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007fd0 tx=0x7f7c40009040 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 msgr2=0x7f7c4815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7c4808c940 tx=0x7f7c440115a0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 shutdown_connections 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4815bdc0 0x7f7c4815c240 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7c480b4eb0 0x7f7c4806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7c2c06b500 0x7f7c2c06d9c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 --2- 172.21.15.19:0/3800503925 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7c34004800 0x7f7c481f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 >> 172.21.15.19:0/3800503925 conn(0x7f7c480d3cd0 msgr2=0x7f7c481603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 shutdown_connections 2024-03-04T08:52:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:47.990+0000 7f7c4f65c640 1 -- 172.21.15.19:0/3800503925 wait complete. 2024-03-04T08:52:47.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:47.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.108+0000 7fb89d66f640 1 Processor -- start 2024-03-04T08:52:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.108+0000 7fb89d66f640 1 -- start start 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb89d66f640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8981614d0 0x7fb8980d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb89d66f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb89d66f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8981618b0 con 0x7fb8980d1910 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb89d66f640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8980cf400 con 0x7fb8981614d0 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb89d66f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980cf6a0 con 0x7fb8980d24b0 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb896ffd640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fb8981614d0 0x7fb8980d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb8977fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb8977fe640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:53544/0 (socket says 172.21.15.19:53544) 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.109+0000 7fb8977fe640 1 -- 172.21.15.19:0/3320835364 learned_addr learned my addr 172.21.15.19:0/3320835364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb896ffd640 1 -- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 msgr2=0x7fb8980b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb896ffd640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb896ffd640 1 -- 172.21.15.19:0/3320835364 >> v1:172.21.15.204:6789/0 conn(0x7fb8980d1910 legacy=0x7fb8980d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb896ffd640 1 -- 172.21.15.19:0/3320835364 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980cf980 con 0x7fb8981614d0 2024-03-04T08:52:48.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb8977fe640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.110+0000 7fb896ffd640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8981614d0 0x7fb8980d4860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097a0 tx=0x7fb88802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d04e6706591ca4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb8967fc640 1 -- 172.21.15.19:0/3320835364 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888035020 con 0x7fb8981614d0 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb8967fc640 1 -- 172.21.15.19:0/3320835364 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888031830 con 0x7fb8981614d0 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb8967fc640 1 -- 172.21.15.19:0/3320835364 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888031c00 con 0x7fb8981614d0 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 -- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8981614d0 msgr2=0x7fb8980d4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8981614d0 0x7fb8980d4860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb8880097a0 tx=0x7fb88802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 -- 172.21.15.19:0/3320835364 shutdown_connections 2024-03-04T08:52:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8980d24b0 0x7fb8980b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 --2- 172.21.15.19:0/3320835364 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8981614d0 0x7fb8980d4860 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 -- 172.21.15.19:0/3320835364 >> 172.21.15.19:0/3320835364 conn(0x7fb8980d3d40 msgr2=0x7fb8980d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 -- 172.21.15.19:0/3320835364 shutdown_connections 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.111+0000 7fb89d66f640 1 -- 172.21.15.19:0/3320835364 wait complete. 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.113+0000 7fb89d66f640 1 Processor -- start 2024-03-04T08:52:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.113+0000 7fb89d66f640 1 -- start start 2024-03-04T08:52:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 0x7fb89814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8981614d0 0x7fb89814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980b1370 con 0x7fb8980d24b0 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980b0910 con 0x7fb8980d1910 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb89d66f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980b14f0 con 0x7fb8981614d0 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55458/0 (socket says 172.21.15.19:55458) 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 -- 172.21.15.19:0/48736867 learned_addr learned my addr 172.21.15.19:0/48736867 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb896ffd640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 0x7fb89814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb8977fe640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8981614d0 0x7fb89814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 -- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8981614d0 msgr2=0x7fb89814ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8981614d0 0x7fb89814ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 -- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 msgr2=0x7fb89814b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 0x7fb89814b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb88ffff640 1 -- 172.21.15.19:0/48736867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980b95a0 con 0x7fb8980d24b0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.114+0000 7fb896ffd640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 0x7fb89814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb88ffff640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c430 tx=0x7fb88000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800052d0 con 0x7fb8980d24b0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880005490 con 0x7fb8980d24b0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8980ca480 con 0x7fb8980d24b0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880007260 con 0x7fb8980d24b0 2024-03-04T08:52:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.115+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89814b960 con 0x7fb8980d24b0 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.116+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb898068ff0 con 0x7fb8980d24b0 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.116+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb880007400 con 0x7fb8980d24b0 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.117+0000 7fb88f7fe640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 0x7fb87806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.117+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb880089640 con 0x7fb8980d24b0 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.117+0000 7fb896ffd640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 0x7fb87806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.118+0000 7fb896ffd640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 0x7fb87806d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb888036000 tx=0x7fb88803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.121+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb880057e70 con 0x7fb8980d24b0 2024-03-04T08:52:48.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.371+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8980d20b0 con 0x7fb8980d24b0 2024-03-04T08:52:48.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.371+0000 7fb88f7fe640 1 -- 172.21.15.19:0/48736867 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb88005bf10 con 0x7fb8980d24b0 2024-03-04T08:52:48.368 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 msgr2=0x7fb87806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 0x7fb87806d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb888036000 tx=0x7fb88803c040 comp rx=0 tx=0).stop 2024-03-04T08:52:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 msgr2=0x7fb89814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c430 tx=0x7fb88000c8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 shutdown_connections 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fb8981614d0 0x7fb89814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8980d24b0 0x7fb89814a860 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fb87806b4d0 0x7fb87806d990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 --2- 172.21.15.19:0/48736867 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb8980d1910 0x7fb89814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 >> 172.21.15.19:0/48736867 conn(0x7fb8980d3d40 msgr2=0x7fb8980d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 shutdown_connections 2024-03-04T08:52:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.373+0000 7fb89d66f640 1 -- 172.21.15.19:0/48736867 wait complete. 2024-03-04T08:52:48.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.492+0000 7fd74b68f640 1 Processor -- start 2024-03-04T08:52:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.492+0000 7fd74b68f640 1 -- start start 2024-03-04T08:52:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd74b68f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74415e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd74b68f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd74415ec40 0x7fd744071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd74b68f640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7440cea90 con 0x7fd74415bbb0 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd74b68f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd744161970 con 0x7fd74415ec40 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd74b68f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7441624f0 con 0x7fd74406b6c0 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd74415ec40 0x7fd744071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd74415ec40 0x7fd744071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55470/0 (socket says 172.21.15.19:55470) 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 -- 172.21.15.19:0/2309208274 learned_addr learned my addr 172.21.15.19:0/2309208274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 -- 172.21.15.19:0/2309208274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 msgr2=0x7fd74415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 --2- 172.21.15.19:0/2309208274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 -- 172.21.15.19:0/2309208274 >> v1:172.21.15.204:6789/0 conn(0x7fd74415bbb0 legacy=0x7fd74406afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.493+0000 7fd749c2c640 1 -- 172.21.15.19:0/2309208274 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744161bc0 con 0x7fd74415ec40 2024-03-04T08:52:48.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.494+0000 7fd749c2c640 1 --2- 172.21.15.19:0/2309208274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744071ca0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e50 tx=0x7fd73c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7964544f7004d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd73bfff640 1 -- 172.21.15.19:0/2309208274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c02ca70 con 0x7fd74415ec40 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd73bfff640 1 -- 172.21.15.19:0/2309208274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c02cc10 con 0x7fd74415ec40 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd73bfff640 1 -- 172.21.15.19:0/2309208274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0343f0 con 0x7fd74415ec40 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 -- 172.21.15.19:0/2309208274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 msgr2=0x7fd744071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 --2- 172.21.15.19:0/2309208274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744071ca0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e50 tx=0x7fd73c02bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 -- 172.21.15.19:0/2309208274 shutdown_connections 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 --2- 172.21.15.19:0/2309208274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744071ca0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 --2- 172.21.15.19:0/2309208274 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 -- 172.21.15.19:0/2309208274 >> 172.21.15.19:0/2309208274 conn(0x7fd7440b2660 msgr2=0x7fd7440b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 -- 172.21.15.19:0/2309208274 shutdown_connections 2024-03-04T08:52:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.495+0000 7fd74b68f640 1 -- 172.21.15.19:0/2309208274 wait complete. 2024-03-04T08:52:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.497+0000 7fd74b68f640 1 Processor -- start 2024-03-04T08:52:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.497+0000 7fd74b68f640 1 -- start start 2024-03-04T08:52:48.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd744161250 0x7fd744156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74415f0f0 con 0x7fd74415ec40 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744162180 con 0x7fd744161250 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74b68f640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440721e0 con 0x7fd74406b6c0 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd748c2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd748c2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55472/0 (socket says 172.21.15.19:55472) 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd748c2a640 1 -- 172.21.15.19:0/3965036495 learned_addr learned my addr 172.21.15.19:0/3965036495 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd749c2c640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd744161250 0x7fd744156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.498+0000 7fd74942b640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 -- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 msgr2=0x7fd74414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 -- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd744161250 msgr2=0x7fd744156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd744161250 0x7fd744156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 -- 172.21.15.19:0/3965036495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744160920 con 0x7fd74415ec40 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd748c2a640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd73400b4d0 tx=0x7fd73400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734014070 con 0x7fd74415ec40 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734010870 con 0x7fd74415ec40 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74415f880 con 0x7fd74415ec40 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734010c60 con 0x7fd74415ec40 2024-03-04T08:52:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.499+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74415fe40 con 0x7fd74415ec40 2024-03-04T08:52:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.500+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7440733b0 con 0x7fd74415ec40 2024-03-04T08:52:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.500+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd734017070 con 0x7fd74415ec40 2024-03-04T08:52:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.501+0000 7fd739ffb640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 0x7fd72806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.501+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd734089f70 con 0x7fd74415ec40 2024-03-04T08:52:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.501+0000 7fd74942b640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 0x7fd72806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.502+0000 7fd74942b640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 0x7fd72806d990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd740004f60 tx=0x7fd740007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.505+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd744160920 con 0x7fd74415ec40 2024-03-04T08:52:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.687+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd744068ff0 con 0x7fd74415ec40 2024-03-04T08:52:48.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.687+0000 7fd739ffb640 1 -- 172.21.15.19:0/3965036495 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7340587a0 con 0x7fd74415ec40 2024-03-04T08:52:48.683 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:48.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 msgr2=0x7fd72806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 0x7fd72806d990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd740004f60 tx=0x7fd740007e30 comp rx=0 tx=0).stop 2024-03-04T08:52:48.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 msgr2=0x7fd744160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd73400b4d0 tx=0x7fd73400b990 comp rx=0 tx=0).stop 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 shutdown_connections 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd72806b4d0 0x7fd72806d990 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd744161250 0x7fd744156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd74415ec40 0x7fd744160d10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 --2- 172.21.15.19:0/3965036495 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd74406b6c0 0x7fd74414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 >> 172.21.15.19:0/3965036495 conn(0x7fd7440b2660 msgr2=0x7fd7440cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 shutdown_connections 2024-03-04T08:52:48.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.689+0000 7fd74b68f640 1 -- 172.21.15.19:0/3965036495 wait complete. 2024-03-04T08:52:48.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.804+0000 7f832f925640 1 Processor -- start 2024-03-04T08:52:48.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.804+0000 7f832f925640 1 -- start start 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832f925640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280d4860 0x7f83280d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832f925640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83281618b0 con 0x7f83281614d0 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832f925640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83280cf400 con 0x7f83280b0e30 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832f925640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280d4cc0 con 0x7f83280d4860 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832d6c1640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f83281614d0 0x7f83280d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41026/0 (socket says 172.21.15.19:41026) 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832d6c1640 1 -- 172.21.15.19:0/95937359 learned_addr learned my addr 172.21.15.19:0/95937359 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280d4860 0x7f83280d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750490581 0 0) 0x7f83281618b0 con 0x7f83281614d0 2024-03-04T08:52:48.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8314003520 con 0x7f83281614d0 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474501611 0 0) 0x7f83280cf400 con 0x7f83280b0e30 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> v1:172.21.15.204:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83281618b0 con 0x7f83280b0e30 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761017778 0 0) 0x7f8314003520 con 0x7f83281614d0 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280d4860 msgr2=0x7f83280d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280d4860 0x7f83280d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 >> v1:172.21.15.204:6789/0 conn(0x7f83280b0e30 legacy=0x7f83280b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280cf6a0 con 0x7f83281614d0 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.805+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f8324001670 con 0x7f83281614d0 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 >> v1:172.21.15.19:6789/0 conn(0x7f83281614d0 legacy=0x7f83280d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314003b70 0x7f8314003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8314004800 0x7f8314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140051c0 0x7f831400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280d4cc0 con 0x7f8314004800 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831400bfb0 con 0x7f8314003b70 2024-03-04T08:52:48.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831400c1b0 con 0x7f83140051c0 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280d4860 0x7f83280d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8314004800 0x7f8314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832d6c1640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314003b70 0x7f8314003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832dec2640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140051c0 0x7f831400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 -- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140051c0 msgr2=0x7f831400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140051c0 0x7f831400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 -- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314003b70 msgr2=0x7f8314003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314003b70 0x7f8314003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832cec0640 1 -- 172.21.15.19:0/95937359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314003520 con 0x7f8314004800 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.806+0000 7f832dec2640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83140051c0 0x7f831400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832cec0640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8314004800 0x7f8314004c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8318009b00 tx=0x7f8314005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e849827943076261 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180097d0 con 0x7f8314004800 2024-03-04T08:52:48.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318004030 con 0x7f8314004800 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f831ffff640 1 -- 172.21.15.19:0/95937359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318004400 con 0x7f8314004800 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832f925640 1 -- 172.21.15.19:0/95937359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8314004800 msgr2=0x7f8314004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832f925640 1 --2- 172.21.15.19:0/95937359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8314004800 0x7f8314004c80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8318009b00 tx=0x7f8314005830 comp rx=0 tx=0).stop 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832dec2640 1 -- 172.21.15.19:0/95937359 reap_dead start 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832f925640 1 -- 172.21.15.19:0/95937359 shutdown_connections 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.807+0000 7f832f925640 1 -- 172.21.15.19:0/95937359 >> 172.21.15.19:0/95937359 conn(0x7f83280d3d40 msgr2=0x7f83280d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.808+0000 7f832f925640 1 -- 172.21.15.19:0/95937359 shutdown_connections 2024-03-04T08:52:48.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.808+0000 7f832f925640 1 -- 172.21.15.19:0/95937359 wait complete. 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 Processor -- start 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 -- start start 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314004800 0x7f8328155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 0x7f83280b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280b0910 con 0x7f83280c8a90 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280cfc60 con 0x7f8314004800 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.809+0000 7f832f925640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280d2020 con 0x7f83280b5a00 2024-03-04T08:52:48.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55496/0 (socket says 172.21.15.19:55496) 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 -- 172.21.15.19:0/3224838303 learned_addr learned my addr 172.21.15.19:0/3224838303 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832d6c1640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314004800 0x7f8328155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832cec0640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 0x7f83280b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 -- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 msgr2=0x7f83280b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 0x7f83280b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 -- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314004800 msgr2=0x7f8328155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314004800 0x7f8328155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 -- 172.21.15.19:0/3224838303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280b35e0 con 0x7f83280c8a90 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832cec0640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 0x7f83280b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832dec2640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f83280b6900 tx=0x7f832000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000ee50 con 0x7f83280c8a90 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320003b80 con 0x7f83280c8a90 2024-03-04T08:52:48.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83281f5170 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320003d70 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.810+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83280c9a60 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.811+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832806c160 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.812+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f832001a020 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.812+0000 7f831dffb640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 0x7f830c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.812+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83200895d0 con 0x7f83280c8a90 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.812+0000 7f832d6c1640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 0x7f830c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.813+0000 7f832d6c1640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 0x7f830c06d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8324000c00 tx=0x7f8324001c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:48.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.816+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8320021020 con 0x7f83280c8a90 2024-03-04T08:52:48.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.997+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8328068ff0 con 0x7f83280c8a90 2024-03-04T08:52:48.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.997+0000 7f831dffb640 1 -- 172.21.15.19:0/3224838303 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8320058450 con 0x7f83280c8a90 2024-03-04T08:52:48.993 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 msgr2=0x7f830c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 0x7f830c06d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8324000c00 tx=0x7f8324001c10 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 msgr2=0x7f83280c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f83280b6900 tx=0x7f832000ec00 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 shutdown_connections 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83280c8a90 0x7f83280c8f10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f83280b5a00 0x7f83280b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f830c06b4d0 0x7f830c06d990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 --2- 172.21.15.19:0/3224838303 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8314004800 0x7f8328155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 >> 172.21.15.19:0/3224838303 conn(0x7f83280d3d40 msgr2=0x7f83280d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 shutdown_connections 2024-03-04T08:52:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:48.999+0000 7f832f925640 1 -- 172.21.15.19:0/3224838303 wait complete. 2024-03-04T08:52:49.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 Processor -- start 2024-03-04T08:52:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 -- start start 2024-03-04T08:52:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a900d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4a90161cf0 0x7f4a90162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a900d22c0 con 0x7f4a90162970 2024-03-04T08:52:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a90161b00 con 0x7f4a90161cf0 2024-03-04T08:52:49.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.113+0000 7f4a96483640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900cecc0 con 0x7f4a900b4460 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a8ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a900d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a94a20640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4a90161cf0 0x7f4a90162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a8ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a900d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3301/0 says I am v2:172.21.15.19:53602/0 (socket says 172.21.15.19:53602) 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a8ffff640 1 -- 172.21.15.19:0/987675394 learned_addr learned my addr 172.21.15.19:0/987675394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a94a20640 1 -- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 msgr2=0x7f4a900d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a94a20640 1 --2- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a900d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a94a20640 1 -- 172.21.15.19:0/987675394 >> v1:172.21.15.204:6789/0 conn(0x7f4a90162970 legacy=0x7f4a900b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.114+0000 7f4a94a20640 1 -- 172.21.15.19:0/987675394 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900d25a0 con 0x7f4a90161cf0 2024-03-04T08:52:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.115+0000 7f4a94a20640 1 --2- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90161cf0 0x7f4a90162180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009d90 tx=0x7f4a8802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7839e5e86197ff5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.115+0000 7f4a8effd640 1 -- 172.21.15.19:0/987675394 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a88039070 con 0x7f4a90161cf0 2024-03-04T08:52:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.115+0000 7f4a8effd640 1 -- 172.21.15.19:0/987675394 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8802cc50 con 0x7f4a90161cf0 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.115+0000 7f4a8effd640 1 -- 172.21.15.19:0/987675394 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a88034440 con 0x7f4a90161cf0 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 -- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90161cf0 msgr2=0x7f4a90162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 --2- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90161cf0 0x7f4a90162180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009d90 tx=0x7f4a8802bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 -- 172.21.15.19:0/987675394 shutdown_connections 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 --2- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90161cf0 0x7f4a90162180 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 --2- 172.21.15.19:0/987675394 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a900d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 -- 172.21.15.19:0/987675394 >> 172.21.15.19:0/987675394 conn(0x7f4a900d3ce0 msgr2=0x7f4a900d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 -- 172.21.15.19:0/987675394 shutdown_connections 2024-03-04T08:52:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.116+0000 7f4a96483640 1 -- 172.21.15.19:0/987675394 wait complete. 2024-03-04T08:52:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.117+0000 7f4a96483640 1 Processor -- start 2024-03-04T08:52:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.117+0000 7f4a96483640 1 -- start start 2024-03-04T08:52:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a901580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90162970 0x7f4a9015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900ce950 con 0x7f4a90161cf0 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900d2b60 con 0x7f4a90162970 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a96483640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900b4840 con 0x7f4a900b4460 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a8ffff640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a901580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55508/0 (socket says 172.21.15.19:55508) 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a8f7fe640 1 -- 172.21.15.19:0/523215847 learned_addr learned my addr 172.21.15.19:0/523215847 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.118+0000 7f4a94a20640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90162970 0x7f4a9015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 -- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90162970 msgr2=0x7f4a9015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90162970 0x7f4a9015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 -- 172.21.15.19:0/523215847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 msgr2=0x7f4a900ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 -- 172.21.15.19:0/523215847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90158730 con 0x7f4a900b4460 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8f7fe640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8ffff640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a901580c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000e870 tx=0x7f4a8000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80017070 con 0x7f4a900b4460 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8000ee60 con 0x7f4a900b4460 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a90158a10 con 0x7f4a900b4460 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000cb60 con 0x7f4a900b4460 2024-03-04T08:52:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.119+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a90158fd0 con 0x7f4a900b4460 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.120+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9004f330 con 0x7f4a900b4460 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.121+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a8001a070 con 0x7f4a900b4460 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.121+0000 7f4a8cff9640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 0x7f4a7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.121+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a8008a2e0 con 0x7f4a900b4460 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.121+0000 7f4a8f7fe640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 0x7f4a7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.122+0000 7f4a8f7fe640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 0x7f4a7c06d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a900cbe80 tx=0x7f4a84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.126+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4a80058b20 con 0x7f4a900b4460 2024-03-04T08:52:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.319+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a9006b180 con 0x7f4a900b4460 2024-03-04T08:52:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.320+0000 7f4a8cff9640 1 -- 172.21.15.19:0/523215847 <== mon.2 v2:172.21.15.204:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a8005cbc0 con 0x7f4a900b4460 2024-03-04T08:52:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 msgr2=0x7f4a7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 0x7f4a7c06d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a900cbe80 tx=0x7f4a84009040 comp rx=0 tx=0).stop 2024-03-04T08:52:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 msgr2=0x7f4a901580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a901580c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000e870 tx=0x7f4a8000ed30 comp rx=0 tx=0).stop 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 shutdown_connections 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4a7c06b4d0 0x7f4a7c06d990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4a90162970 0x7f4a9015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a90161cf0 0x7f4a900ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 --2- 172.21.15.19:0/523215847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4a900b4460 0x7f4a901580c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 >> 172.21.15.19:0/523215847 conn(0x7f4a900d3ce0 msgr2=0x7f4a9006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 shutdown_connections 2024-03-04T08:52:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.322+0000 7f4a96483640 1 -- 172.21.15.19:0/523215847 wait complete. 2024-03-04T08:52:49.329 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:52:49.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.329 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:49.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[58496]: fuse finished with error 0 and tester_r 0 2024-03-04T08:52:49.359 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:52:49.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:49.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.410 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:49.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-04T08:52:49.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.570+0000 7f4e5a688640 1 Processor -- start 2024-03-04T08:52:49.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.570+0000 7f4e5a688640 1 -- start start 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.571+0000 7f4e5a688640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e5415bdd0 0x7f4e540c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.571+0000 7f4e5a688640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f4e540d16e0 0x7f4e540d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.571+0000 7f4e5a688640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cebe0 con 0x7f4e5415fa10 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.571+0000 7f4e5a688640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540ce980 con 0x7f4e5415bdd0 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.571+0000 7f4e5a688640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540ceec0 con 0x7f4e540d16e0 2024-03-04T08:52:49.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e5415bdd0 0x7f4e540c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e537fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4e5415fa10 0x7f4e540ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41034/0 (socket says 172.21.15.19:41034) 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e537fe640 1 -- 172.21.15.19:0/876960638 learned_addr learned my addr 172.21.15.19:0/876960638 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e5415bdd0 0x7f4e540c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55512/0 (socket says 172.21.15.19:55512) 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e58c25640 1 --2- 172.21.15.19:0/876960638 >> v2:172.21.15.204:3300/0 conn(0x7f4e540d16e0 0x7f4e540d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 -- 172.21.15.19:0/876960638 >> v2:172.21.15.204:3300/0 conn(0x7f4e540d16e0 msgr2=0x7f4e540d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 --2- 172.21.15.19:0/876960638 >> v2:172.21.15.204:3300/0 conn(0x7f4e540d16e0 0x7f4e540d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 -- 172.21.15.19:0/876960638 >> v1:172.21.15.19:6789/0 conn(0x7f4e5415fa10 legacy=0x7f4e540ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e53fff640 1 -- 172.21.15.19:0/876960638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540cf1a0 con 0x7f4e5415bdd0 2024-03-04T08:52:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.572+0000 7f4e52ffd640 1 -- 172.21.15.19:0/876960638 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214392928 0 0) 0x7f4e540cebe0 con 0x7f4e5415fa10 2024-03-04T08:52:49.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e53fff640 1 --2- 172.21.15.19:0/876960638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5415bdd0 0x7f4e540c5610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4e540c5520 tx=0x7f4e4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6ce763f1e5395 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e52ffd640 1 -- 172.21.15.19:0/876960638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440315a0 con 0x7f4e5415bdd0 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e52ffd640 1 -- 172.21.15.19:0/876960638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e44037070 con 0x7f4e5415bdd0 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e52ffd640 1 -- 172.21.15.19:0/876960638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44031960 con 0x7f4e5415bdd0 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e5a688640 1 -- 172.21.15.19:0/876960638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5415bdd0 msgr2=0x7f4e540c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e5a688640 1 --2- 172.21.15.19:0/876960638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5415bdd0 0x7f4e540c5610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4e540c5520 tx=0x7f4e4402b840 comp rx=0 tx=0).stop 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e5a688640 1 -- 172.21.15.19:0/876960638 shutdown_connections 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e5a688640 1 --2- 172.21.15.19:0/876960638 >> v2:172.21.15.204:3300/0 conn(0x7f4e540d16e0 0x7f4e540d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.573+0000 7f4e5a688640 1 --2- 172.21.15.19:0/876960638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e5415bdd0 0x7f4e540c5610 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.574+0000 7f4e5a688640 1 -- 172.21.15.19:0/876960638 >> 172.21.15.19:0/876960638 conn(0x7f4e5409a9f0 msgr2=0x7f4e5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.574+0000 7f4e5a688640 1 -- 172.21.15.19:0/876960638 shutdown_connections 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.574+0000 7f4e5a688640 1 -- 172.21.15.19:0/876960638 wait complete. 2024-03-04T08:52:49.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.575+0000 7f4e5a688640 1 Processor -- start 2024-03-04T08:52:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.575+0000 7f4e5a688640 1 -- start start 2024-03-04T08:52:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e5415bdd0 0x7f4e540b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e5415fa10 0x7f4e540b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540cc5d0 con 0x7f4e540d16e0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c5b50 con 0x7f4e5415bdd0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5415c1b0 con 0x7f4e5415fa10 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55524/0 (socket says 172.21.15.19:55524) 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 -- 172.21.15.19:0/2359657216 learned_addr learned my addr 172.21.15.19:0/2359657216 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e58c25640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e5415fa10 0x7f4e540b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e537fe640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e5415bdd0 0x7f4e540b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 -- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e5415fa10 msgr2=0x7f4e540b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e5415fa10 0x7f4e540b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 -- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e5415bdd0 msgr2=0x7f4e540b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e5415bdd0 0x7f4e540b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 -- 172.21.15.19:0/2359657216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540cbc50 con 0x7f4e540d16e0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e53fff640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009890 tx=0x7f4e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44004230 con 0x7f4e540d16e0 2024-03-04T08:52:49.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e44004410 con 0x7f4e540d16e0 2024-03-04T08:52:49.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540cb970 con 0x7f4e540d16e0 2024-03-04T08:52:49.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44003850 con 0x7f4e540d16e0 2024-03-04T08:52:49.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.576+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5406c4d0 con 0x7f4e540d16e0 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.578+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5404f330 con 0x7f4e540d16e0 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.578+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e440039f0 con 0x7f4e540d16e0 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.578+0000 7f4e50ff9640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 0x7f4e4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.578+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e4402f030 con 0x7f4e540d16e0 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.578+0000 7f4e537fe640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 0x7f4e4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:49.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.579+0000 7f4e537fe640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 0x7f4e4006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e540b75f0 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:49.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.583+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4e44041070 con 0x7f4e540d16e0 2024-03-04T08:52:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.801+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e540cbed0 con 0x7f4e540d16e0 2024-03-04T08:52:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.802+0000 7f4e50ff9640 1 -- 172.21.15.19:0/2359657216 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e4407b230 con 0x7f4e540d16e0 2024-03-04T08:52:49.798 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 msgr2=0x7f4e4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 0x7f4e4006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4e540b75f0 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 msgr2=0x7f4e540ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009890 tx=0x7f4e440046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 shutdown_connections 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f4e5415fa10 0x7f4e540b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f4e4006b4d0 0x7f4e4006d990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e5415bdd0 0x7f4e540b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 --2- 172.21.15.19:0/2359657216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e540d16e0 0x7f4e540ae8f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 >> 172.21.15.19:0/2359657216 conn(0x7f4e5409a9f0 msgr2=0x7f4e5406eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 shutdown_connections 2024-03-04T08:52:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:49.804+0000 7f4e5a688640 1 -- 172.21.15.19:0/2359657216 wait complete. 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T08:52:49.811 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:49.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.812 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-04T08:52:49.826 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-04T08:52:49.827 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42524sec preferred_lft 42524sec 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.828 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6cff:22ff:fe98:d2ed/64 scope link 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 86:3d:cc:95:c7:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::843d:ccff:fe95:c7dc/64 scope link 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 06:4c:17:d5:b7:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::44c:17ff:fed5:b712/64 scope link 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-04T08:52:49.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.829 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T08:52:49.892 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-04T08:52:49.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.894 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T08:52:49.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-04T08:52:49.950 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-04T08:52:50.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.045 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:52:50.060 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:52:50.060 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:52:50.061 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:50.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-04T08:52:50.127 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-04T08:52:50.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:50.127 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:50.181 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T08:52:50.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T08:52:50.181 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:50.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:50.306 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:50.361 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:50.361 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:50.362 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:50.363 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:50.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.365 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:50.416 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T08:52:50.416 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-04T08:52:50.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-03-04T08:52:50.485 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-03-04T08:52:50.541 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-03-04T08:52:50.542 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-0 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-1 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-2 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph/osd/ceph-3 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:52:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.543 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-03-04T08:52:50.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-03-04T08:52:50.547+0000 7f106e064480 -1 init, newargv = 0x55652bf03650 newargc=15 2024-03-04T08:52:50.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[59458]: starting ceph client 2024-03-04T08:52:50.548 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[59458]: starting fuse 2024-03-04T08:52:50.560 INFO:teuthology.orchestra.run.smithi019.stdout:42 2024-03-04T08:52:50.560 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-04T08:52:50.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-03-04T08:52:50.560 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-03-04T08:52:50.560 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-03-04T08:52:50.560 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:50.560 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T08:52:50.561 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-03-04T08:52:50.562 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:50.680 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.59458.asok 2024-03-04T08:52:50.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T08:52:50.690 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59458.asok 2024-03-04T08:52:50.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59458.asok status 2024-03-04T08:52:50.826 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "59458", 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-03-04T08:52:50.827 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 6306, 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 6306 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1297869703 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-03-04T08:52:50.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1297869703 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.6306 192.168.0.1:0/1297869703", 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/1297869703", 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 22, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 49, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-03-04T08:52:50.829 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:52:50.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.835 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-03-04T08:52:50.835 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:50.850 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-03-04T08:52:50.850 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:50.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:50.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> import errno 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> if True: 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> ret = os.read(fd, 1024) 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> else: 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> os.write(fd, b'"'"'content'"'"') 2024-03-04T08:52:50.917 DEBUG:teuthology.orchestra.run.smithi019:> except OSError as e: 2024-03-04T08:52:50.918 DEBUG:teuthology.orchestra.run.smithi019:> if e.errno != errno.EPERM: 2024-03-04T08:52:50.918 DEBUG:teuthology.orchestra.run.smithi019:> raise 2024-03-04T08:52:50.918 DEBUG:teuthology.orchestra.run.smithi019:> else: 2024-03-04T08:52:50.918 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("client does not check permission of data pool") 2024-03-04T08:52:50.918 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-04T08:52:51.038 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last): 2024-03-04T08:52:51.038 INFO:teuthology.orchestra.run.smithi019.stderr: File "", line 15, in 2024-03-04T08:52:51.038 INFO:teuthology.orchestra.run.smithi019.stderr:RuntimeError: client does not check permission of data pool 2024-03-04T08:52:51.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-03-04T08:52:51.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:51.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-03-04T08:52:51.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.199+0000 7fd5b3735640 1 Processor -- start 2024-03-04T08:52:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.199+0000 7fd5b3735640 1 -- start start 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b3735640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b3735640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd5ac0b15c0 0x7fd5ac0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b3735640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0d0240 con 0x7fd5ac0ce300 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b3735640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cf4f0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b3735640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0d0850 con 0x7fd5ac0b15c0 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55534/0 (socket says 172.21.15.19:55534) 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b0cd0640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5ac0ce300 0x7fd5ac0ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41050/0 (socket says 172.21.15.19:41050) 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 -- 172.21.15.19:0/2473124387 learned_addr learned my addr 172.21.15.19:0/2473124387 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b1cd2640 1 --2- 172.21.15.19:0/2473124387 >> v2:172.21.15.204:3300/0 conn(0x7fd5ac0b15c0 0x7fd5ac0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 -- 172.21.15.19:0/2473124387 >> v2:172.21.15.204:3300/0 conn(0x7fd5ac0b15c0 msgr2=0x7fd5ac0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 --2- 172.21.15.19:0/2473124387 >> v2:172.21.15.204:3300/0 conn(0x7fd5ac0b15c0 0x7fd5ac0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 -- 172.21.15.19:0/2473124387 >> v1:172.21.15.19:6789/0 conn(0x7fd5ac0ce300 legacy=0x7fd5ac0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5b14d1640 1 -- 172.21.15.19:0/2473124387 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0cf210 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.201+0000 7fd5a3fff640 1 -- 172.21.15.19:0/2473124387 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236797816 0 0) 0x7fd5ac0d0240 con 0x7fd5ac0ce300 2024-03-04T08:52:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.202+0000 7fd5b14d1640 1 --2- 172.21.15.19:0/2473124387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac072b70 tx=0x7fd5a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3ff5dd514dc71b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.202+0000 7fd5a3fff640 1 -- 172.21.15.19:0/2473124387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4034070 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.202+0000 7fd5a3fff640 1 -- 172.21.15.19:0/2473124387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4030860 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.202+0000 7fd5a3fff640 1 -- 172.21.15.19:0/2473124387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4030c30 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 -- 172.21.15.19:0/2473124387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 msgr2=0x7fd5ac0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 --2- 172.21.15.19:0/2473124387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac072b70 tx=0x7fd5a402b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 -- 172.21.15.19:0/2473124387 shutdown_connections 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 --2- 172.21.15.19:0/2473124387 >> v2:172.21.15.204:3300/0 conn(0x7fd5ac0b15c0 0x7fd5ac0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 --2- 172.21.15.19:0/2473124387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac0b41b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 -- 172.21.15.19:0/2473124387 >> 172.21.15.19:0/2473124387 conn(0x7fd5ac0b3690 msgr2=0x7fd5ac0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 -- 172.21.15.19:0/2473124387 shutdown_connections 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.203+0000 7fd5b3735640 1 -- 172.21.15.19:0/2473124387 wait complete. 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.204+0000 7fd5b3735640 1 Processor -- start 2024-03-04T08:52:51.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.204+0000 7fd5b3735640 1 -- start start 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.205+0000 7fd5b3735640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5ac0b15c0 0x7fd5ac0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 0x7fd5ac0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15c1b0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0ceea0 con 0x7fd5ac0ce300 2024-03-04T08:52:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0b10c0 con 0x7fd5ac0b15c0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55540/0 (socket says 172.21.15.19:55540) 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 -- 172.21.15.19:0/430066209 learned_addr learned my addr 172.21.15.19:0/430066209 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b0cd0640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 0x7fd5ac0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b14d1640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5ac0b15c0 0x7fd5ac0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 -- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5ac0b15c0 msgr2=0x7fd5ac0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5ac0b15c0 0x7fd5ac0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 -- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 msgr2=0x7fd5ac0c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 0x7fd5ac0c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 -- 172.21.15.19:0/430066209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac15c3d0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b0cd0640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 0x7fd5ac0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b1cd2640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8007e90 tx=0x7fd5a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8014420 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8019070 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8014800 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.206+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac15c6b0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.207+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac0c6b20 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.208+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac09fcf0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.208+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd5a80149a0 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.208+0000 7fd5a1ffb640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 0x7fd59006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.208+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5a808aa40 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.209+0000 7fd5b14d1640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 0x7fd59006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.209+0000 7fd5b14d1640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 0x7fd59006d9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4036000 tx=0x7fd5a4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.217+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd5a8059830 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.469+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd5ac15b480 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.471+0000 7fd5a1ffb640 1 -- 172.21.15.19:0/430066209 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+141 (secure 0 0 0) 0x7fd5a808ae20 con 0x7fd5ac15bdd0 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAri+VlINuMERAAzIct1xOUHfeibS5Qd+410A== 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-04T08:52:51.467 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw pool=cephfs_data" 2024-03-04T08:52:51.468 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-04T08:52:51.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 msgr2=0x7fd59006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 0x7fd59006d9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4036000 tx=0x7fd5a4008030 comp rx=0 tx=0).stop 2024-03-04T08:52:51.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 msgr2=0x7fd5ac145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8007e90 tx=0x7fd5a800e4b0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 shutdown_connections 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5ac15bdd0 0x7fd5ac145c20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd59006b500 0x7fd59006d9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd5ac0ce300 0x7fd5ac0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 --2- 172.21.15.19:0/430066209 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd5ac0b15c0 0x7fd5ac0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 >> 172.21.15.19:0/430066209 conn(0x7fd5ac0b3690 msgr2=0x7fd5ac0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 shutdown_connections 2024-03-04T08:52:51.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.473+0000 7fd5b3735640 1 -- 172.21.15.19:0/430066209 wait complete. 2024-03-04T08:52:51.480 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-04T08:52:51.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:51.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-04T08:52:51.574 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-04T08:52:51.575 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:51.575 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:51.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:51.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 Processor -- start 2024-03-04T08:52:51.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 -- start start 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f231806c6d0 0x7f231815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2318066d90 0x7f23180ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180cd450 con 0x7f23180b4f70 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231815e9f0 con 0x7f2318066d90 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.734+0000 7f231d60e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180cda10 con 0x7f231806c6d0 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f23177fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2318066d90 0x7f23180ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f2316ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f23180b4f70 0x7f23180b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41058/0 (socket says 172.21.15.19:41058) 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f2316ffd640 1 -- 172.21.15.19:0/1235522375 learned_addr learned my addr 172.21.15.19:0/1235522375 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f23177fe640 1 -- 172.21.15.19:0/1235522375 >> v2:172.21.15.204:3300/0 conn(0x7f231806c6d0 msgr2=0x7f231815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f23177fe640 1 --2- 172.21.15.19:0/1235522375 >> v2:172.21.15.204:3300/0 conn(0x7f231806c6d0 0x7f231815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f23177fe640 1 -- 172.21.15.19:0/1235522375 >> v1:172.21.15.19:6789/0 conn(0x7f23180b4f70 legacy=0x7f23180b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f23177fe640 1 -- 172.21.15.19:0/1235522375 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180cd730 con 0x7f2318066d90 2024-03-04T08:52:51.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.735+0000 7f2315ffb640 1 -- 172.21.15.19:0/1235522375 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286064464 0 0) 0x7f23180cd450 con 0x7f23180b4f70 2024-03-04T08:52:51.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.736+0000 7f23177fe640 1 --2- 172.21.15.19:0/1235522375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f23180ccb50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f23180ccb00 tx=0x7f231002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bfbe4405cc965a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.736+0000 7f2315ffb640 1 -- 172.21.15.19:0/1235522375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310039070 con 0x7f2318066d90 2024-03-04T08:52:51.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.736+0000 7f2315ffb640 1 -- 172.21.15.19:0/1235522375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231002cc80 con 0x7f2318066d90 2024-03-04T08:52:51.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.736+0000 7f2315ffb640 1 -- 172.21.15.19:0/1235522375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310034660 con 0x7f2318066d90 2024-03-04T08:52:51.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 -- 172.21.15.19:0/1235522375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 msgr2=0x7f23180ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 --2- 172.21.15.19:0/1235522375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f23180ccb50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f23180ccb00 tx=0x7f231002bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 -- 172.21.15.19:0/1235522375 shutdown_connections 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 --2- 172.21.15.19:0/1235522375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f23180ccb50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 --2- 172.21.15.19:0/1235522375 >> v2:172.21.15.204:3300/0 conn(0x7f231806c6d0 0x7f231815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 -- 172.21.15.19:0/1235522375 >> 172.21.15.19:0/1235522375 conn(0x7f23180724d0 msgr2=0x7f23180728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 -- 172.21.15.19:0/1235522375 shutdown_connections 2024-03-04T08:52:51.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.737+0000 7f231d60e640 1 -- 172.21.15.19:0/1235522375 wait complete. 2024-03-04T08:52:51.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.738+0000 7f231d60e640 1 Processor -- start 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.738+0000 7f231d60e640 1 -- start start 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 0x7f231815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23180c9490 0x7f231814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180cd090 con 0x7f2318066d90 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231815f3c0 con 0x7f23180b4f70 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f231d60e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180cd210 con 0x7f23180c9490 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55548/0 (socket says 172.21.15.19:55548) 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 -- 172.21.15.19:0/1995847952 learned_addr learned my addr 172.21.15.19:0/1995847952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:51.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 -- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23180c9490 msgr2=0x7f231814b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23180c9490 0x7f231814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 -- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 msgr2=0x7f231815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f23167fc640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 0x7f231815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 0x7f231815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 -- 172.21.15.19:0/1995847952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180c9a00 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f23167fc640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 0x7f231815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.739+0000 7f2316ffd640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f230800c430 tx=0x7f230800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.740+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080074e0 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.740+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080047e0 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.740+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23180c9ce0 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.740+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004bd0 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.740+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23180ca2a0 con 0x7f2318066d90 2024-03-04T08:52:51.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.741+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180ca6e0 con 0x7f2318066d90 2024-03-04T08:52:51.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.741+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2308011070 con 0x7f2318066d90 2024-03-04T08:52:51.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.741+0000 7f22ff7fe640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 0x7f230406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:51.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.742+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2308089ec0 con 0x7f2318066d90 2024-03-04T08:52:51.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.742+0000 7f23167fc640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 0x7f230406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:51.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.743+0000 7f23167fc640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 0x7f230406d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f230c006fd0 tx=0x7f230c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.746+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2308058d40 con 0x7f2318066d90 2024-03-04T08:52:51.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.929+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f231804f330 con 0x7f2318066d90 2024-03-04T08:52:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.930+0000 7f22ff7fe640 1 -- 172.21.15.19:0/1995847952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f2308058640 con 0x7f2318066d90 2024-03-04T08:52:51.926 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:51.926 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 msgr2=0x7f230406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 0x7f230406d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f230c006fd0 tx=0x7f230c008040 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 msgr2=0x7f231815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f230800c430 tx=0x7f230800c8f0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 shutdown_connections 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f23180c9490 0x7f231814b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f230406b4d0 0x7f230406d990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f23180b4f70 0x7f231815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 --2- 172.21.15.19:0/1995847952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2318066d90 0x7f231815b000 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 >> 172.21.15.19:0/1995847952 conn(0x7f23180724d0 msgr2=0x7f23180b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 shutdown_connections 2024-03-04T08:52:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:51.932+0000 7f231d60e640 1 -- 172.21.15.19:0/1995847952 wait complete. 2024-03-04T08:52:51.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:51.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:52.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.048+0000 7ffb80df6640 1 Processor -- start 2024-03-04T08:52:52.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.048+0000 7ffb80df6640 1 -- start start 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb80df6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb7c0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb80df6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ffb7c0d2480 0x7ffb7c0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb80df6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c1618b0 con 0x7ffb7c0d1910 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb80df6640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0cf400 con 0x7ffb7c0d2480 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb80df6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0cf6a0 con 0x7ffb7c1614d0 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb73fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb7c0d1910 0x7ffb7c0d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41068/0 (socket says 172.21.15.19:41068) 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.049+0000 7ffb73fff640 1 -- 172.21.15.19:0/2156769798 learned_addr learned my addr 172.21.15.19:0/2156769798 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb7ad9d640 1 --2- 172.21.15.19:0/2156769798 >> v2:172.21.15.204:3300/0 conn(0x7ffb7c0d2480 0x7ffb7c0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669549106 0 0) 0x7ffb7c1618b0 con 0x7ffb7c0d1910 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb68003520 con 0x7ffb7c0d1910 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb7c0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2257857392 0 0) 0x7ffb68003520 con 0x7ffb7c0d1910 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 msgr2=0x7ffb7c0d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb7c0d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 >> v2:172.21.15.204:3300/0 conn(0x7ffb7c0d2480 msgr2=0x7ffb7c0b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 --2- 172.21.15.19:0/2156769798 >> v2:172.21.15.204:3300/0 conn(0x7ffb7c0d2480 0x7ffb7c0b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0cf980 con 0x7ffb7c0d1910 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7ffb64001670 con 0x7ffb7c0d1910 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 >> v1:172.21.15.19:6789/0 conn(0x7ffb7c0d1910 legacy=0x7ffb7c0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb68003f30 0x7ffb68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68004d40 0x7ffb680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0cf400 con 0x7ffb68003f30 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0cf6a0 con 0x7ffb68004d40 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6800b9c0 con 0x7ffb7c1614d0 2024-03-04T08:52:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb68003f30 0x7ffb68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb7ad9d640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68004d40 0x7ffb680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 -- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 msgr2=0x7ffb680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c1614d0 0x7ffb680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 -- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68004d40 msgr2=0x7ffb680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68004d40 0x7ffb680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.050+0000 7ffb73fff640 1 -- 172.21.15.19:0/2156769798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68003520 con 0x7ffb68003f30 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.051+0000 7ffb73fff640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb68003f30 0x7ffb68004800 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb64001050 tx=0x7ffb68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f946c4b5453bb6f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.051+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64007d70 con 0x7ffb68003f30 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.051+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64030070 con 0x7ffb68003f30 2024-03-04T08:52:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.051+0000 7ffb79d9b640 1 -- 172.21.15.19:0/2156769798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6402cd70 con 0x7ffb68003f30 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 -- 172.21.15.19:0/2156769798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb68003f30 msgr2=0x7ffb68004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 --2- 172.21.15.19:0/2156769798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb68003f30 0x7ffb68004800 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb64001050 tx=0x7ffb68005830 comp rx=0 tx=0).stop 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb7ad9d640 1 -- 172.21.15.19:0/2156769798 reap_dead start 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 -- 172.21.15.19:0/2156769798 shutdown_connections 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 -- 172.21.15.19:0/2156769798 >> 172.21.15.19:0/2156769798 conn(0x7ffb7c0d3d40 msgr2=0x7ffb7c0d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 -- 172.21.15.19:0/2156769798 shutdown_connections 2024-03-04T08:52:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.052+0000 7ffb80df6640 1 -- 172.21.15.19:0/2156769798 wait complete. 2024-03-04T08:52:52.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.053+0000 7ffb80df6640 1 Processor -- start 2024-03-04T08:52:52.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.053+0000 7ffb80df6640 1 -- start start 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 0x7ffb7c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c0cae10 0x7ffb7c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0d4860 con 0x7ffb7c0cb290 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b0910 con 0x7ffb68003f30 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb80df6640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0d49e0 con 0x7ffb7c0cae10 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55572/0 (socket says 172.21.15.19:55572) 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 -- 172.21.15.19:0/1684114450 learned_addr learned my addr 172.21.15.19:0/1684114450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 0x7ffb7c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb73fff640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c0cae10 0x7ffb7c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 -- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c0cae10 msgr2=0x7ffb7c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c0cae10 0x7ffb7c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 -- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 msgr2=0x7ffb7c14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 0x7ffb7c14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7ad9d640 1 -- 172.21.15.19:0/1684114450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0cb860 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.054+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 0x7ffb7c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb7ad9d640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b2a70 tx=0x7ffb7400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400fd80 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7401d070 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0cbb40 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74015670 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.055+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c0cc100 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.056+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c068ff0 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.056+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb74015810 con 0x7ffb7c0cb290 2024-03-04T08:52:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.057+0000 7ffb72ffd640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.057+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb7408ab90 con 0x7ffb7c0cb290 2024-03-04T08:52:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.057+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.058+0000 7ffb7a59c640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009ae0 tx=0x7ffb6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.062+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffb74010040 con 0x7ffb7c0cb290 2024-03-04T08:52:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.242+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb7c06ba00 con 0x7ffb7c0cb290 2024-03-04T08:52:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.243+0000 7ffb72ffd640 1 -- 172.21.15.19:0/1684114450 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb74059970 con 0x7ffb7c0cb290 2024-03-04T08:52:52.240 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 msgr2=0x7ffb5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009ae0 tx=0x7ffb6c008040 comp rx=0 tx=0).stop 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 msgr2=0x7ffb7c0cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b2a70 tx=0x7ffb7400f580 comp rx=0 tx=0).stop 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 shutdown_connections 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb7c0cb290 0x7ffb7c0cdce0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ffb7c0cae10 0x7ffb7c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 --2- 172.21.15.19:0/1684114450 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ffb68003f30 0x7ffb7c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 >> 172.21.15.19:0/1684114450 conn(0x7ffb7c0d3d40 msgr2=0x7ffb7c0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 shutdown_connections 2024-03-04T08:52:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.245+0000 7ffb80df6640 1 -- 172.21.15.19:0/1684114450 wait complete. 2024-03-04T08:52:52.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:52.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.365+0000 7fdce87bc640 1 Processor -- start 2024-03-04T08:52:52.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.365+0000 7fdce87bc640 1 -- start start 2024-03-04T08:52:52.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.366+0000 7fdce87bc640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 0x7fdce00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.366+0000 7fdce87bc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 0x7fdce00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.366+0000 7fdce87bc640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00d03f0 con 0x7fdce00cffd0 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.366+0000 7fdce87bc640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce0158ac0 con 0x7fdce01586e0 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.366+0000 7fdce87bc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce015b2a0 con 0x7fdce00aef80 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce6558640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 0x7fdce00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5d57640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 0x7fdce00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce6d59640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fdce00cffd0 0x7fdce006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51182/0 (socket says 172.21.15.19:51182) 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce6d59640 1 -- 172.21.15.19:0/2101044004 learned_addr learned my addr 172.21.15.19:0/2101044004 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5d57640 1 -- 172.21.15.19:0/2101044004 >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 msgr2=0x7fdce00aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5d57640 1 --2- 172.21.15.19:0/2101044004 >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 0x7fdce00aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5d57640 1 -- 172.21.15.19:0/2101044004 >> v1:172.21.15.204:6789/0 conn(0x7fdce00cffd0 legacy=0x7fdce006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5d57640 1 -- 172.21.15.19:0/2101044004 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce015b540 con 0x7fdce00aef80 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce5556640 1 -- 172.21.15.19:0/2101044004 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816023583 0 0) 0x7fdce00d03f0 con 0x7fdce00cffd0 2024-03-04T08:52:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.367+0000 7fdce6558640 1 --2- 172.21.15.19:0/2101044004 >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 0x7fdce00aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.368+0000 7fdce5d57640 1 --2- 172.21.15.19:0/2101044004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 0x7fdce00cfa90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097a0 tx=0x7fdcdc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c7ff16315a5e69 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.368+0000 7fdce5556640 1 -- 172.21.15.19:0/2101044004 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035020 con 0x7fdce00aef80 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.368+0000 7fdce5556640 1 -- 172.21.15.19:0/2101044004 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc031830 con 0x7fdce00aef80 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.368+0000 7fdce5556640 1 -- 172.21.15.19:0/2101044004 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc031c00 con 0x7fdce00aef80 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 -- 172.21.15.19:0/2101044004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 msgr2=0x7fdce00cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 --2- 172.21.15.19:0/2101044004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 0x7fdce00cfa90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0097a0 tx=0x7fdcdc02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 -- 172.21.15.19:0/2101044004 shutdown_connections 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 --2- 172.21.15.19:0/2101044004 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce00aef80 0x7fdce00cfa90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 --2- 172.21.15.19:0/2101044004 >> v2:172.21.15.204:3300/0 conn(0x7fdce01586e0 0x7fdce00aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 -- 172.21.15.19:0/2101044004 >> 172.21.15.19:0/2101044004 conn(0x7fdce006b190 msgr2=0x7fdce006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 -- 172.21.15.19:0/2101044004 shutdown_connections 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.369+0000 7fdce87bc640 1 -- 172.21.15.19:0/2101044004 wait complete. 2024-03-04T08:52:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.371+0000 7fdce87bc640 1 Processor -- start 2024-03-04T08:52:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.371+0000 7fdce87bc640 1 -- start start 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce00aef80 0x7fdce00adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce01586e0 0x7fdce01486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce015bde0 con 0x7fdce00cffd0 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce015bb00 con 0x7fdce00aef80 2024-03-04T08:52:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce87bc640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0071350 con 0x7fdce01586e0 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce5d57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce5d57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55574/0 (socket says 172.21.15.19:55574) 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce5d57640 1 -- 172.21.15.19:0/546068266 learned_addr learned my addr 172.21.15.19:0/546068266 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce6558640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce00aef80 0x7fdce00adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.372+0000 7fdce6d59640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce01586e0 0x7fdce01486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 -- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce01586e0 msgr2=0x7fdce01486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce01586e0 0x7fdce01486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 -- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce00aef80 msgr2=0x7fdce00adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce00aef80 0x7fdce00adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 -- 172.21.15.19:0/546068266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00b1150 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce5d57640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009890 tx=0x7fdcdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035040 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc03b920 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce01f4980 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc03bd10 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.373+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce01f3ea0 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.374+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00732b0 con 0x7fdce00cffd0 2024-03-04T08:52:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.375+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcdc038020 con 0x7fdce00cffd0 2024-03-04T08:52:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.375+0000 7fdcd6ffd640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 0x7fdcc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.375+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcdc0ac180 con 0x7fdce00cffd0 2024-03-04T08:52:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.375+0000 7fdce6558640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 0x7fdcc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.376+0000 7fdce6558640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 0x7fdcc406d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000b800 tx=0x7fdcd000b3a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.379+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdcdc031800 con 0x7fdce00cffd0 2024-03-04T08:52:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.562+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdce006e930 con 0x7fdce00cffd0 2024-03-04T08:52:52.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.562+0000 7fdcd6ffd640 1 -- 172.21.15.19:0/546068266 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdcdc07a9c0 con 0x7fdce00cffd0 2024-03-04T08:52:52.738 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 msgr2=0x7fdcc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 0x7fdcc406d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000b800 tx=0x7fdcd000b3a0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 msgr2=0x7fdce01481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009890 tx=0x7fdcdc0046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 shutdown_connections 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fdce01586e0 0x7fdce01486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdce00cffd0 0x7fdce01481a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fdcc406b4d0 0x7fdcc406d990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 --2- 172.21.15.19:0/546068266 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdce00aef80 0x7fdce00adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 >> 172.21.15.19:0/546068266 conn(0x7fdce006b190 msgr2=0x7fdce00b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 shutdown_connections 2024-03-04T08:52:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.565+0000 7fdce87bc640 1 -- 172.21.15.19:0/546068266 wait complete. 2024-03-04T08:52:52.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 Processor -- start 2024-03-04T08:52:52.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 -- start start 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5cf815dcf0 0x7f5cf80d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cf815e0d0 0x7f5cf80d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80cfa10 con 0x7f5cf80ca250 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80cf730 con 0x7f5cf815e0d0 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.851+0000 7f5cfda02640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80c7760 con 0x7f5cf815dcf0 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cf815e0d0 0x7f5cf80d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cf815e0d0 0x7f5cf80d2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55588/0 (socket says 172.21.15.19:55588) 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 -- 172.21.15.19:0/3955149499 learned_addr learned my addr 172.21.15.19:0/3955149499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5cf6ffd640 1 --2- 172.21.15.19:0/3955149499 >> v2:172.21.15.204:3300/0 conn(0x7f5cf815dcf0 0x7f5cf80d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 -- 172.21.15.19:0/3955149499 >> v2:172.21.15.204:3300/0 conn(0x7f5cf815dcf0 msgr2=0x7f5cf80d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 --2- 172.21.15.19:0/3955149499 >> v2:172.21.15.204:3300/0 conn(0x7f5cf815dcf0 0x7f5cf80d2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 -- 172.21.15.19:0/3955149499 >> v1:172.21.15.204:6789/0 conn(0x7f5cf80ca250 legacy=0x7f5cf80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.852+0000 7f5ceffff640 1 -- 172.21.15.19:0/3955149499 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80c7a40 con 0x7f5cf815e0d0 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5ceffff640 1 --2- 172.21.15.19:0/3955149499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815e0d0 0x7f5cf80d2690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5cf808cc30 tx=0x7f5ce002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f39362bcd4394fe server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cf67fc640 1 -- 172.21.15.19:0/3955149499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0034070 con 0x7f5cf815e0d0 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cf67fc640 1 -- 172.21.15.19:0/3955149499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0030860 con 0x7f5cf815e0d0 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cf67fc640 1 -- 172.21.15.19:0/3955149499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0030c30 con 0x7f5cf815e0d0 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 -- 172.21.15.19:0/3955149499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815e0d0 msgr2=0x7f5cf80d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 --2- 172.21.15.19:0/3955149499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815e0d0 0x7f5cf80d2690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5cf808cc30 tx=0x7f5ce002b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 -- 172.21.15.19:0/3955149499 shutdown_connections 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 --2- 172.21.15.19:0/3955149499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815e0d0 0x7f5cf80d2690 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 --2- 172.21.15.19:0/3955149499 >> v2:172.21.15.204:3300/0 conn(0x7f5cf815dcf0 0x7f5cf80d2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 -- 172.21.15.19:0/3955149499 >> 172.21.15.19:0/3955149499 conn(0x7f5cf809ce40 msgr2=0x7f5cf80d3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 -- 172.21.15.19:0/3955149499 shutdown_connections 2024-03-04T08:52:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.853+0000 7f5cfda02640 1 -- 172.21.15.19:0/3955149499 wait complete. 2024-03-04T08:52:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 Processor -- start 2024-03-04T08:52:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 -- start start 2024-03-04T08:52:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 0x7f5cf8153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cf815e0d0 0x7f5cf8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80cf260 con 0x7f5cf815dcf0 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80cf0e0 con 0x7f5cf80ca250 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.855+0000 7f5cfda02640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80cf3e0 con 0x7f5cf815e0d0 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55590/0 (socket says 172.21.15.19:55590) 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 -- 172.21.15.19:0/1071589969 learned_addr learned my addr 172.21.15.19:0/1071589969 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf6ffd640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 0x7f5cf8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf77fe640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cf815e0d0 0x7f5cf8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 -- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cf815e0d0 msgr2=0x7f5cf8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cf815e0d0 0x7f5cf8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 -- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 msgr2=0x7f5cf8153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 0x7f5cf8153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 -- 172.21.15.19:0/1071589969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80b8fb0 con 0x7f5cf815dcf0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf6ffd640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 0x7f5cf8153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5ceffff640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000c00 tx=0x7f5ce0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0048070 con 0x7f5cf815dcf0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0030660 con 0x7f5cf815dcf0 2024-03-04T08:52:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0034040 con 0x7f5cf815dcf0 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf80b9290 con 0x7f5cf815dcf0 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.856+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf80b9850 con 0x7f5cf815dcf0 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.857+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf8068f10 con 0x7f5cf815dcf0 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.858+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ce004b070 con 0x7f5cf815dcf0 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.858+0000 7f5cf4ff9640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 0x7f5cd806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.858+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce00ac210 con 0x7f5cf815dcf0 2024-03-04T08:52:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.859+0000 7f5cf6ffd640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 0x7f5cd806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.859+0000 7f5cf6ffd640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 0x7f5cd806d9e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8006fd0 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:52.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:52.863+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5ce007b290 con 0x7f5cf815dcf0 2024-03-04T08:52:53.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.044+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cf806b730 con 0x7f5cf815dcf0 2024-03-04T08:52:53.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.044+0000 7f5cf4ff9640 1 -- 172.21.15.19:0/1071589969 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ce007ab90 con 0x7f5cf815dcf0 2024-03-04T08:52:53.041 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 msgr2=0x7f5cd806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 0x7f5cd806d9e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8006fd0 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 msgr2=0x7f5cf8156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000c00 tx=0x7f5ce0004730 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 shutdown_connections 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5cf815e0d0 0x7f5cf8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cf815dcf0 0x7f5cf8156640 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5cd806b520 0x7f5cd806d9e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 --2- 172.21.15.19:0/1071589969 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5cf80ca250 0x7f5cf8153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 >> 172.21.15.19:0/1071589969 conn(0x7f5cf809ce40 msgr2=0x7f5cf80c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:53.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 shutdown_connections 2024-03-04T08:52:53.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.046+0000 7f5cfda02640 1 -- 172.21.15.19:0/1071589969 wait complete. 2024-03-04T08:52:53.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T08:52:53.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.163+0000 7f5fd8a0e640 1 Processor -- start 2024-03-04T08:52:53.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.163+0000 7f5fd8a0e640 1 -- start start 2024-03-04T08:52:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd8a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fd406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd8a0e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f5fd40b4ef0 0x7f5fd40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd8a0e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40b4450 con 0x7f5fd406ee10 2024-03-04T08:52:53.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd8a0e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40b4a60 con 0x7f5fd40b4ef0 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd8a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b5b60 con 0x7f5fd4144030 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd259c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5fd406ee10 0x7f5fd406f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41074/0 (socket says 172.21.15.19:41074) 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.164+0000 7f5fd259c640 1 -- 172.21.15.19:0/4105089283 learned_addr learned my addr 172.21.15.19:0/4105089283 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd2d9d640 1 --2- 172.21.15.19:0/4105089283 >> v2:172.21.15.204:3300/0 conn(0x7f5fd40b4ef0 0x7f5fd40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fcbfff640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fd406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800576821 0 0) 0x7f5fd40b4450 con 0x7f5fd406ee10 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc0003520 con 0x7f5fd406ee10 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481165388 0 0) 0x7f5fc0003520 con 0x7f5fd406ee10 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 msgr2=0x7f5fd406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fd406e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 >> v2:172.21.15.204:3300/0 conn(0x7f5fd40b4ef0 msgr2=0x7f5fd40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 --2- 172.21.15.19:0/4105089283 >> v2:172.21.15.204:3300/0 conn(0x7f5fd40b4ef0 0x7f5fd40cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40b5e40 con 0x7f5fd406ee10 2024-03-04T08:52:53.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f5fc4001670 con 0x7f5fd406ee10 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 >> v1:172.21.15.19:6789/0 conn(0x7f5fd406ee10 legacy=0x7f5fd406f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b4a60 con 0x7f5fc00039b0 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b5b60 con 0x7f5fc0004d40 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc000b9c0 con 0x7f5fd4144030 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd2d9d640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fcbfff640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 -- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 msgr2=0x7f5fc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd4144030 0x7f5fc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 -- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc0004d40 msgr2=0x7f5fc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc0004d40 0x7f5fc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.165+0000 7f5fd259c640 1 -- 172.21.15.19:0/4105089283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0003520 con 0x7f5fc00039b0 2024-03-04T08:52:53.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd259c640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fc0003dd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c210 tx=0x7f5fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a9f5cca6276c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4007d30 con 0x7f5fc00039b0 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4030070 con 0x7f5fc00039b0 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd1d9b640 1 -- 172.21.15.19:0/4105089283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc402cd60 con 0x7f5fc00039b0 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/4105089283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 msgr2=0x7f5fc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/4105089283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fc0003dd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c210 tx=0x7f5fc0005830 comp rx=0 tx=0).stop 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd2d9d640 1 -- 172.21.15.19:0/4105089283 reap_dead start 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/4105089283 shutdown_connections 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/4105089283 >> 172.21.15.19:0/4105089283 conn(0x7f5fd40d0a10 msgr2=0x7f5fd40d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/4105089283 shutdown_connections 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.167+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/4105089283 wait complete. 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.169+0000 7f5fd8a0e640 1 Processor -- start 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.169+0000 7f5fd8a0e640 1 -- start start 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd41f2f80 0x7f5fd41f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd41e0160 0x7f5fd41e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b5380 con 0x7f5fc00039b0 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4144840 con 0x7f5fd41f2f80 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b5500 con 0x7f5fd41e0160 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55612/0 (socket says 172.21.15.19:55612) 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 -- 172.21.15.19:0/544020046 learned_addr learned my addr 172.21.15.19:0/544020046 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fcbfff640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd41f2f80 0x7f5fd41f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd2d9d640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd41e0160 0x7f5fd41e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 -- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd41e0160 msgr2=0x7f5fd41e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd41e0160 0x7f5fd41e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 -- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd41f2f80 msgr2=0x7f5fd41f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd41f2f80 0x7f5fd41f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 -- 172.21.15.19:0/544020046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd41f3a40 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd259c640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c300 tx=0x7f5fc4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4045070 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4000ed0 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd41f3d20 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4004e10 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.171+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd4130150 con 0x7f5fc00039b0 2024-03-04T08:52:53.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.173+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd4143c40 con 0x7f5fc00039b0 2024-03-04T08:52:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.174+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5fc4048070 con 0x7f5fc00039b0 2024-03-04T08:52:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.174+0000 7f5fcaffd640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 0x7f5fb406d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.174+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc40ab3e0 con 0x7f5fc00039b0 2024-03-04T08:52:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.174+0000 7f5fcbfff640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 0x7f5fb406d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.175+0000 7f5fcbfff640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 0x7f5fb406d960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4134210 tx=0x7f5fbc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.178+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5fd4143c40 con 0x7f5fc00039b0 2024-03-04T08:52:53.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.372+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5fd404f330 con 0x7f5fc00039b0 2024-03-04T08:52:53.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.372+0000 7f5fcaffd640 1 -- 172.21.15.19:0/544020046 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5fc407a260 con 0x7f5fc00039b0 2024-03-04T08:52:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 msgr2=0x7f5fb406d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 0x7f5fb406d960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4134210 tx=0x7f5fbc008040 comp rx=0 tx=0).stop 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 msgr2=0x7f5fd4130670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400c300 tx=0x7f5fc4001a40 comp rx=0 tx=0).stop 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 shutdown_connections 2024-03-04T08:52:53.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5fd41e0160 0x7f5fd41e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5fb406b4a0 0x7f5fb406d960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fd41f2f80 0x7f5fd41f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 --2- 172.21.15.19:0/544020046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc00039b0 0x7f5fd4130670 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 >> 172.21.15.19:0/544020046 conn(0x7f5fd40d0a10 msgr2=0x7f5fd41e1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 shutdown_connections 2024-03-04T08:52:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.374+0000 7f5fd8a0e640 1 -- 172.21.15.19:0/544020046 wait complete. 2024-03-04T08:52:53.381 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-03-04T08:52:53.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:53.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T08:52:53.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[59458]: fuse finished with error 0 and tester_r 0 2024-03-04T08:52:53.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:53.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:53.410 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T08:52:53.535 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:53.536 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:53.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:53.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:52:53.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:53.555 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-04T08:52:53.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:53.613 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-04T08:52:53.613 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:52:53.613 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:53.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:52:53.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:52:53.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:53.628 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-04T08:52:53.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-04T08:52:53.683 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:52:53.683 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:52:53.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:52:53.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:52:53.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:52:53.702 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-04T08:52:53.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:52:53.760 INFO:teuthology.orchestra.run.smithi204.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-04T08:52:53.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:53.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.866+0000 7f3395e81640 1 Processor -- start 2024-03-04T08:52:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.866+0000 7f3395e81640 1 -- start start 2024-03-04T08:52:53.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3395e81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f33900d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3395e81640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900cebe0 con 0x7f339015fa10 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3395e81640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900ceec0 con 0x7f339015bdd0 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3395e81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900ce980 con 0x7f33900d16e0 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3387fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f339015fa10 0x7f33900ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41076/0 (socket says 172.21.15.19:41076) 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f3387fff640 1 -- 172.21.15.19:0/1547148847 learned_addr learned my addr 172.21.15.19:0/1547148847 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603815168 0 0) 0x7f33900cebe0 con 0x7f339015fa10 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f338ffff640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f33900d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.867+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003520 con 0x7f339015fa10 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961238949 0 0) 0x7f337c003520 con 0x7f339015fa10 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 msgr2=0x7f33900d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f33900d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 >> v1:172.21.15.204:6789/0 conn(0x7f339015bdd0 legacy=0x7f33900c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900cf1a0 con 0x7f339015fa10 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f3378001670 con 0x7f339015fa10 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 >> v1:172.21.15.19:6789/0 conn(0x7f339015fa10 legacy=0x7f33900ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f337c0039e0 0x7f337c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f337c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c004d40 0x7f337c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900ce980 con 0x7f337c0039e0 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00ba70 con 0x7f337c004d40 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bc70 con 0x7f33900d16e0 2024-03-04T08:52:53.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f337c0039e0 0x7f337c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f3387fff640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f337c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338ffff640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c004d40 0x7f337c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 -- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 msgr2=0x7f337c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900d16e0 0x7f337c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 -- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c004d40 msgr2=0x7f337c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c004d40 0x7f337c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338f7fe640 1 -- 172.21.15.19:0/1547148847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c003520 con 0x7f337c0039e0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.868+0000 7f338ffff640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c004d40 0x7f337c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.869+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f337c0039e0 0x7f337c003dc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3380001860 tx=0x7f337c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9dedf24269fae6f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.869+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338002f050 con 0x7f337c0039e0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.869+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380033650 con 0x7f337c0039e0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.869+0000 7f338effd640 1 -- 172.21.15.19:0/1547148847 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380001430 con 0x7f337c0039e0 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 -- 172.21.15.19:0/1547148847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f337c0039e0 msgr2=0x7f337c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 --2- 172.21.15.19:0/1547148847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f337c0039e0 0x7f337c003dc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3380001860 tx=0x7f337c005830 comp rx=0 tx=0).stop 2024-03-04T08:52:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f338ffff640 1 -- 172.21.15.19:0/1547148847 reap_dead start 2024-03-04T08:52:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 -- 172.21.15.19:0/1547148847 shutdown_connections 2024-03-04T08:52:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 -- 172.21.15.19:0/1547148847 >> 172.21.15.19:0/1547148847 conn(0x7f339009a9f0 msgr2=0x7f339009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 -- 172.21.15.19:0/1547148847 shutdown_connections 2024-03-04T08:52:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.870+0000 7f3395e81640 1 -- 172.21.15.19:0/1547148847 wait complete. 2024-03-04T08:52:53.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.871+0000 7f3395e81640 1 Processor -- start 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.871+0000 7f3395e81640 1 -- start start 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 0x7f3390152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 0x7f33900c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339015c1b0 con 0x7f33900b6e30 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900cc5d0 con 0x7f337c0039e0 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3395e81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900d1b10 con 0x7f33900b72b0 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55628/0 (socket says 172.21.15.19:55628) 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 -- 172.21.15.19:0/1046849397 learned_addr learned my addr 172.21.15.19:0/1046849397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f338ffff640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 0x7f33900c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 0x7f3390152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 -- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 msgr2=0x7f33900c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 0x7f33900c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 -- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 msgr2=0x7f3390152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 0x7f3390152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 -- 172.21.15.19:0/1046849397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b6070 con 0x7f33900b6e30 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 0x7f3390152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f338ffff640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 0x7f33900c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:53.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.872+0000 7f3387fff640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3378004f70 tx=0x7f33780074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.873+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378007740 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.873+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378018070 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.873+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33900b6350 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.873+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800fba0 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.873+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33900b6910 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.874+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3390069e80 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.874+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f337800fd40 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.875+0000 7f338cff9640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 0x7f337006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.875+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f337808a240 con 0x7f33900b6e30 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.875+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 0x7f337006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:53.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.876+0000 7f338f7fe640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 0x7f337006db30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3380036000 tx=0x7f3380031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:53.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:53.879+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3390069e80 con 0x7f33900b6e30 2024-03-04T08:52:54.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.162+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f339004f330 con 0x7f33900b6e30 2024-03-04T08:52:54.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.162+0000 7f338cff9640 1 -- 172.21.15.19:0/1046849397 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f33780590c0 con 0x7f33900b6e30 2024-03-04T08:52:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:54.159 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.164+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 msgr2=0x7f337006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.164+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 0x7f337006db30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3380036000 tx=0x7f3380031000 comp rx=0 tx=0).stop 2024-03-04T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.164+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 msgr2=0x7f33900c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.164+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3378004f70 tx=0x7f33780074f0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 shutdown_connections 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f33900b72b0 0x7f33900c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33900b6e30 0x7f33900c7080 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f337006b670 0x7f337006db30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 --2- 172.21.15.19:0/1046849397 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f337c0039e0 0x7f3390152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 >> 172.21.15.19:0/1046849397 conn(0x7f339009a9f0 msgr2=0x7f339006eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 shutdown_connections 2024-03-04T08:52:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.165+0000 7f3395e81640 1 -- 172.21.15.19:0/1046849397 wait complete. 2024-03-04T08:52:54.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:54.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.278+0000 7f6d7f97a640 1 Processor -- start 2024-03-04T08:52:54.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 -- start start 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d7815dfe0 0x7f6d780cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d780d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d780b3430 con 0x7f6d780d27f0 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d780d2c50 con 0x7f6d7815dfe0 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7f97a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780b31e0 con 0x7f6d780cf830 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.279+0000 7f6d7d716640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d7815dfe0 0x7f6d780cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d7815dfe0 0x7f6d780cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55640/0 (socket says 172.21.15.19:55640) 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 -- 172.21.15.19:0/2035452852 learned_addr learned my addr 172.21.15.19:0/2035452852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:54.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7cf15640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d780d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 -- 172.21.15.19:0/2035452852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 msgr2=0x7f6d780d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:54.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d780d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 -- 172.21.15.19:0/2035452852 >> v1:172.21.15.204:6789/0 conn(0x7f6d780d27f0 legacy=0x7f6d780d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 -- 172.21.15.19:0/2035452852 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780b3710 con 0x7f6d7815dfe0 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.280+0000 7f6d7d716640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cf2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009e50 tx=0x7f6d7402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a345c3f465733532 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d6ffff640 1 -- 172.21.15.19:0/2035452852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7402cb00 con 0x7f6d7815dfe0 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d6ffff640 1 -- 172.21.15.19:0/2035452852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7402cca0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d6ffff640 1 -- 172.21.15.19:0/2035452852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74034610 con 0x7f6d7815dfe0 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 -- 172.21.15.19:0/2035452852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 msgr2=0x7f6d780cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cf2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009e50 tx=0x7f6d7402bf60 comp rx=0 tx=0).stop 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 -- 172.21.15.19:0/2035452852 shutdown_connections 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d780d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/2035452852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cf2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 -- 172.21.15.19:0/2035452852 >> 172.21.15.19:0/2035452852 conn(0x7f6d780d3cd0 msgr2=0x7f6d780d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 -- 172.21.15.19:0/2035452852 shutdown_connections 2024-03-04T08:52:54.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.281+0000 7f6d7f97a640 1 -- 172.21.15.19:0/2035452852 wait complete. 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.282+0000 7f6d7f97a640 1 Processor -- start 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 -- start start 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d7814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d780d27f0 0x7f6d780cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780d1c70 con 0x7f6d7815dfe0 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780b3d60 con 0x7f6d780d27f0 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7f97a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780d1df0 con 0x7f6d780cf830 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7df17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7df17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55648/0 (socket says 172.21.15.19:55648) 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7df17640 1 -- 172.21.15.19:0/3825620396 learned_addr learned my addr 172.21.15.19:0/3825620396 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7cf15640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d780d27f0 0x7f6d780cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.283+0000 7f6d7d716640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d7814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 -- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 msgr2=0x7f6d7814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d7814e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 -- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d780d27f0 msgr2=0x7f6d780cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d780d27f0 0x7f6d780cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 -- 172.21.15.19:0/3825620396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7814e6c0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7df17640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6d70001eb0 tx=0x7f6d7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70017070 con 0x7f6d7815dfe0 2024-03-04T08:52:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d700052d0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d780b7900 con 0x7f6d7815dfe0 2024-03-04T08:52:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70003810 con 0x7f6d7815dfe0 2024-03-04T08:52:54.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.284+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780b7ec0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.285+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d780ce3c0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.286+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d7001a070 con 0x7f6d7815dfe0 2024-03-04T08:52:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.286+0000 7f6d6dffb640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 0x7f6d5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.286+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d700894f0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.286+0000 7f6d7d716640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 0x7f6d5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.287+0000 7f6d7d716640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 0x7f6d5c06d990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6d74035000 tx=0x7f6d74030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.290+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6d780ce3c0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.472+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d780cf5f0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.473+0000 7f6d6dffb640 1 -- 172.21.15.19:0/3825620396 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f6d780cf5f0 con 0x7f6d7815dfe0 2024-03-04T08:52:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:54.470 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.475+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 msgr2=0x7f6d5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 0x7f6d5c06d990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6d74035000 tx=0x7f6d74030000 comp rx=0 tx=0).stop 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 msgr2=0x7f6d780cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6d70001eb0 tx=0x7f6d7000c890 comp rx=0 tx=0).stop 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 shutdown_connections 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d7815dfe0 0x7f6d780cd690 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d5c06b4d0 0x7f6d5c06d990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d780d27f0 0x7f6d780cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 --2- 172.21.15.19:0/3825620396 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d780cf830 0x7f6d7814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 >> 172.21.15.19:0/3825620396 conn(0x7f6d780d3cd0 msgr2=0x7f6d7806ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 shutdown_connections 2024-03-04T08:52:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.476+0000 7f6d7f97a640 1 -- 172.21.15.19:0/3825620396 wait complete. 2024-03-04T08:52:54.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T08:50:29.208714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T08:52:29.465211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T08:52:30.158067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T08:52:54.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T08:52:54.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.591+0000 7fc13d0af640 1 Processor -- start 2024-03-04T08:52:54.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.591+0000 7fc13d0af640 1 -- start start 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13d0af640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc13815ecd0 0x7fc1380cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13d0af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1380cfa50 con 0x7fc1380d10c0 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13d0af640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1380b45c0 con 0x7fc1380d14a0 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13d0af640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13815c050 con 0x7fc13815ecd0 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc13815ecd0 0x7fc1380cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc136d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc1380d10c0 0x7fc1380d04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41090/0 (socket says 172.21.15.19:41090) 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc13815ecd0 0x7fc1380cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55664/0 (socket says 172.21.15.19:55664) 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc136d9d640 1 -- 172.21.15.19:0/610124349 learned_addr learned my addr 172.21.15.19:0/610124349 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13759e640 1 -- 172.21.15.19:0/610124349 >> v1:172.21.15.204:6789/0 conn(0x7fc1380d14a0 legacy=0x7fc13815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13759e640 1 -- 172.21.15.19:0/610124349 >> v1:172.21.15.19:6789/0 conn(0x7fc1380d10c0 legacy=0x7fc1380d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc135d9b640 1 -- 172.21.15.19:0/610124349 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507913971 0 0) 0x7fc1380cfa50 con 0x7fc1380d10c0 2024-03-04T08:52:54.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.592+0000 7fc13759e640 1 -- 172.21.15.19:0/610124349 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13815f160 con 0x7fc13815ecd0 2024-03-04T08:52:54.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.593+0000 7fc13759e640 1 --2- 172.21.15.19:0/610124349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13815ecd0 0x7fc1380cae80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc1300097a0 tx=0x7fc13002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab8b40d5d89b0b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.593+0000 7fc135d9b640 1 -- 172.21.15.19:0/610124349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130034070 con 0x7fc13815ecd0 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.593+0000 7fc135d9b640 1 -- 172.21.15.19:0/610124349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130030610 con 0x7fc13815ecd0 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.593+0000 7fc135d9b640 1 -- 172.21.15.19:0/610124349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300309e0 con 0x7fc13815ecd0 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 -- 172.21.15.19:0/610124349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13815ecd0 msgr2=0x7fc1380cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 --2- 172.21.15.19:0/610124349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13815ecd0 0x7fc1380cae80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc1300097a0 tx=0x7fc13002b960 comp rx=0 tx=0).stop 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 -- 172.21.15.19:0/610124349 shutdown_connections 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 --2- 172.21.15.19:0/610124349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13815ecd0 0x7fc1380cae80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 -- 172.21.15.19:0/610124349 >> 172.21.15.19:0/610124349 conn(0x7fc1380b3800 msgr2=0x7fc1380b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 -- 172.21.15.19:0/610124349 shutdown_connections 2024-03-04T08:52:54.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.594+0000 7fc13d0af640 1 -- 172.21.15.19:0/610124349 wait complete. 2024-03-04T08:52:54.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.596+0000 7fc13d0af640 1 Processor -- start 2024-03-04T08:52:54.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.596+0000 7fc13d0af640 1 -- start start 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 0x7fc13814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 0x7fc1380b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380cfcf0 con 0x7fc1380b6aa0 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380d0060 con 0x7fc1380d10c0 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13d0af640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380cb3c0 con 0x7fc1380d14a0 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55676/0 (socket says 172.21.15.19:55676) 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13759e640 1 -- 172.21.15.19:0/494432735 learned_addr learned my addr 172.21.15.19:0/494432735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc136d9d640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 0x7fc13814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.597+0000 7fc13659c640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 0x7fc1380b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 -- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 msgr2=0x7fc1380b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 0x7fc1380b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 -- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 msgr2=0x7fc13814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 0x7fc13814c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 -- 172.21.15.19:0/494432735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380b5570 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc136d9d640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 0x7fc13814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13659c640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 0x7fc1380b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13759e640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc1300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130034040 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13003ac20 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380b5850 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300443f0 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.598+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380aec80 con 0x7fc1380b6aa0 2024-03-04T08:52:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.599+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13809fe60 con 0x7fc1380b6aa0 2024-03-04T08:52:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.599+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc130037070 con 0x7fc1380b6aa0 2024-03-04T08:52:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.600+0000 7fc11f7fe640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 0x7fc12406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.600+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1300ac090 con 0x7fc1380b6aa0 2024-03-04T08:52:54.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.600+0000 7fc136d9d640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 0x7fc12406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.601+0000 7fc136d9d640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 0x7fc12406d9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc128000f60 tx=0x7fc128007c50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.604+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc13003f070 con 0x7fc1380b6aa0 2024-03-04T08:52:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.784+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc138068ff0 con 0x7fc1380b6aa0 2024-03-04T08:52:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.785+0000 7fc11f7fe640 1 -- 172.21.15.19:0/494432735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc13007afa0 con 0x7fc1380b6aa0 2024-03-04T08:52:54.781 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-04T08:52:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 msgr2=0x7fc12406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 0x7fc12406d9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc128000f60 tx=0x7fc128007c50 comp rx=0 tx=0).stop 2024-03-04T08:52:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 msgr2=0x7fc1380b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc1300046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 shutdown_connections 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1380b6aa0 0x7fc1380b48f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc1380d14a0 0x7fc1380b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc12406b500 0x7fc12406d9c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 --2- 172.21.15.19:0/494432735 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc1380d10c0 0x7fc13814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 >> 172.21.15.19:0/494432735 conn(0x7fc1380b3800 msgr2=0x7fc1380b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 shutdown_connections 2024-03-04T08:52:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.788+0000 7fc13d0af640 1 -- 172.21.15.19:0/494432735 wait complete. 2024-03-04T08:52:54.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T08:52:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.929+0000 7f3d8f8df640 1 Processor -- start 2024-03-04T08:52:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.929+0000 7f3d8f8df640 1 -- start start 2024-03-04T08:52:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8f8df640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d8806fd10 0x7f3d880cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8f8df640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880cd4b0 con 0x7f3d880d0af0 2024-03-04T08:52:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8f8df640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880cd790 con 0x7f3d8815c050 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8f8df640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880cda70 con 0x7f3d8806fd10 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8ce7a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d8806fd10 0x7f3d880cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8de7c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3d880d0af0 0x7f3d880ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41096/0 (socket says 172.21.15.19:41096) 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8de7c640 1 -- 172.21.15.19:0/1098738078 learned_addr learned my addr 172.21.15.19:0/1098738078 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1098738078 >> v1:172.21.15.204:6789/0 conn(0x7f3d8815c050 legacy=0x7f3d8806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1098738078 >> v1:172.21.15.19:6789/0 conn(0x7f3d880d0af0 legacy=0x7f3d880ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1098738078 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880cdd50 con 0x7f3d8806fd10 2024-03-04T08:52:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.930+0000 7f3d7ffff640 1 -- 172.21.15.19:0/1098738078 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853234523 0 0) 0x7f3d880cd4b0 con 0x7f3d880d0af0 2024-03-04T08:52:54.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d8ce7a640 1 --2- 172.21.15.19:0/1098738078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8806fd10 0x7f3d880cc760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a962562848861a7f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d7ffff640 1 -- 172.21.15.19:0/1098738078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780315a0 con 0x7f3d8806fd10 2024-03-04T08:52:54.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d7ffff640 1 -- 172.21.15.19:0/1098738078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78037070 con 0x7f3d8806fd10 2024-03-04T08:52:54.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d7ffff640 1 -- 172.21.15.19:0/1098738078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78031960 con 0x7f3d8806fd10 2024-03-04T08:52:54.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1098738078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8806fd10 msgr2=0x7f3d880cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.931+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1098738078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8806fd10 0x7f3d880cc760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b840 comp rx=0 tx=0).stop 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.932+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1098738078 shutdown_connections 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.932+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1098738078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8806fd10 0x7f3d880cc760 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.932+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1098738078 >> 172.21.15.19:0/1098738078 conn(0x7f3d880b3800 msgr2=0x7f3d880b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.932+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1098738078 shutdown_connections 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.932+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1098738078 wait complete. 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.933+0000 7f3d8f8df640 1 Processor -- start 2024-03-04T08:52:54.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.933+0000 7f3d8f8df640 1 -- start start 2024-03-04T08:52:54.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 0x7f3d88150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 0x7f3d8814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88166e50 con 0x7f3d880d0af0 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88166cd0 con 0x7f3d8815c050 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8f8df640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88166fd0 con 0x7f3d8806fd10 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55694/0 (socket says 172.21.15.19:55694) 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1935977164 learned_addr learned my addr 172.21.15.19:0/1935977164 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8de7c640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 0x7f3d8814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8d67b640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 0x7f3d88150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 msgr2=0x7f3d88150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 0x7f3d88150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 msgr2=0x7f3d8814c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 0x7f3d8814c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8ce7a640 1 -- 172.21.15.19:0/1935977164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8814f010 con 0x7f3d880d0af0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8de7c640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 0x7f3d8814c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.934+0000 7f3d8d67b640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 0x7f3d88150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d8ce7a640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78032840 con 0x7f3d880d0af0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780329e0 con 0x7f3d880d0af0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8814e250 con 0x7f3d880d0af0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78032dd0 con 0x7f3d880d0af0 2024-03-04T08:52:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.935+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8814e810 con 0x7f3d880d0af0 2024-03-04T08:52:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.936+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d880b4650 con 0x7f3d880d0af0 2024-03-04T08:52:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.936+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d7803b3f0 con 0x7f3d880d0af0 2024-03-04T08:52:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.937+0000 7f3d7dffb640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 0x7f3d6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.937+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d7802f030 con 0x7f3d880d0af0 2024-03-04T08:52:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.937+0000 7f3d8d67b640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 0x7f3d6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.938+0000 7f3d8d67b640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 0x7f3d6c06d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d84003eb0 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:54.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:54.945+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3d880b4650 con 0x7f3d880d0af0 2024-03-04T08:52:55.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.125+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d8809fe60 con 0x7f3d880d0af0 2024-03-04T08:52:55.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.126+0000 7f3d7dffb640 1 -- 172.21.15.19:0/1935977164 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d78040070 con 0x7f3d880d0af0 2024-03-04T08:52:55.122 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-04T08:52:55.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 msgr2=0x7f3d6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 0x7f3d6c06d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d84003eb0 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 msgr2=0x7f3d88148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d780046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 shutdown_connections 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f3d6c06b4d0 0x7f3d6c06d990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3d8815c050 0x7f3d8814c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d880d0af0 0x7f3d88148960 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 --2- 172.21.15.19:0/1935977164 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f3d8806fd10 0x7f3d88150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 >> 172.21.15.19:0/1935977164 conn(0x7f3d880b3800 msgr2=0x7f3d8806f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 shutdown_connections 2024-03-04T08:52:55.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.128+0000 7f3d8f8df640 1 -- 172.21.15.19:0/1935977164 wait complete. 2024-03-04T08:52:55.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T08:52:55.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 Processor -- start 2024-03-04T08:52:55.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 -- start start 2024-03-04T08:52:55.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f815def0 0x7fd2f80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 0x7fd2f80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f80cecf0 con 0x7fd2f815def0 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f80cf1c0 con 0x7fd2f806cab0 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.244+0000 7fd2fda2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80cc760 con 0x7fd2f80ce880 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f815def0 0x7fd2f80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd2f815def0 0x7fd2f80b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55704/0 (socket says 172.21.15.19:55704) 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 -- 172.21.15.19:0/4024226852 learned_addr learned my addr 172.21.15.19:0/4024226852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f67fc640 1 --2- 172.21.15.19:0/4024226852 >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 0x7fd2f80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f77fe640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 -- 172.21.15.19:0/4024226852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 msgr2=0x7fd2f80cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 -- 172.21.15.19:0/4024226852 >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 msgr2=0x7fd2f80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/4024226852 >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 0x7fd2f80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f6ffd640 1 -- 172.21.15.19:0/4024226852 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f806d030 con 0x7fd2f815def0 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.245+0000 7fd2f67fc640 1 --2- 172.21.15.19:0/4024226852 >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 0x7fd2f80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80b41b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80b3660 tx=0x7fd2e802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f85eb2d440ffe4b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2f5ffb640 1 -- 172.21.15.19:0/4024226852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8034070 con 0x7fd2f815def0 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2f5ffb640 1 -- 172.21.15.19:0/4024226852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8030860 con 0x7fd2f815def0 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2f5ffb640 1 -- 172.21.15.19:0/4024226852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8030c30 con 0x7fd2f815def0 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 -- 172.21.15.19:0/4024226852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 msgr2=0x7fd2f80b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80b41b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80b3660 tx=0x7fd2e802b9a0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 -- 172.21.15.19:0/4024226852 shutdown_connections 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/4024226852 >> v2:172.21.15.204:3300/0 conn(0x7fd2f806cab0 0x7fd2f80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/4024226852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80b41b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 -- 172.21.15.19:0/4024226852 >> 172.21.15.19:0/4024226852 conn(0x7fd2f80b3690 msgr2=0x7fd2f80b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 -- 172.21.15.19:0/4024226852 shutdown_connections 2024-03-04T08:52:55.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.246+0000 7fd2fda2a640 1 -- 172.21.15.19:0/4024226852 wait complete. 2024-03-04T08:52:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 Processor -- start 2024-03-04T08:52:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 -- start start 2024-03-04T08:52:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2f806cab0 0x7fd2f8153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80cc3f0 con 0x7fd2f815def0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80cc110 con 0x7fd2f806cab0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.248+0000 7fd2fda2a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f815e2d0 con 0x7fd2f80ce880 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55708/0 (socket says 172.21.15.19:55708) 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 -- 172.21.15.19:0/3870038348 learned_addr learned my addr 172.21.15.19:0/3870038348 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2f806cab0 0x7fd2f8153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f67fc640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 -- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 msgr2=0x7fd2f80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 -- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2f806cab0 msgr2=0x7fd2f8153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2f806cab0 0x7fd2f8153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 -- 172.21.15.19:0/3870038348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8154200 con 0x7fd2f815def0 2024-03-04T08:52:55.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f67fc640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2f77fe640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0007e40 tx=0x7fd2f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0014620 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0019070 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f80c8cc0 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0014a20 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.249+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f80c9280 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.250+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f809fcf0 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.251+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2f0014bc0 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.251+0000 7fd2dffff640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 0x7fd2e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.251+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2f008a920 con 0x7fd2f815def0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.252+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 0x7fd2e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.252+0000 7fd2f6ffd640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 0x7fd2e406d9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8036000 tx=0x7fd2e803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.256+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd2f0059830 con 0x7fd2f815def0 2024-03-04T08:52:55.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.434+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2f8068ff0 con 0x7fd2f815def0 2024-03-04T08:52:55.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.434+0000 7fd2dffff640 1 -- 172.21.15.19:0/3870038348 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2f0059130 con 0x7fd2f815def0 2024-03-04T08:52:55.431 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 msgr2=0x7fd2e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 0x7fd2e406d9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8036000 tx=0x7fd2e803b040 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 msgr2=0x7fd2f80ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0007e40 tx=0x7fd2f000e4b0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 shutdown_connections 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f815def0 0x7fd2f80ccbf0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fd2f80ce880 0x7fd2f80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fd2e406b500 0x7fd2e406d9c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 --2- 172.21.15.19:0/3870038348 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd2f806cab0 0x7fd2f8153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 >> 172.21.15.19:0/3870038348 conn(0x7fd2f80b3690 msgr2=0x7fd2f80d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.436+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 shutdown_connections 2024-03-04T08:52:55.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.437+0000 7fd2fda2a640 1 -- 172.21.15.19:0/3870038348 wait complete. 2024-03-04T08:52:55.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 Processor -- start 2024-03-04T08:52:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 -- start start 2024-03-04T08:52:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 0x7f8b980d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b980cc8b0 0x7f8b980ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b98161980 con 0x7f8b9815bb20 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980d2500 con 0x7f8b980cc8b0 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.553+0000 7f8b9ec71640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b98161c60 con 0x7f8b980cfff0 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b980cc8b0 0x7f8b980ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b980cc8b0 0x7f8b980ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55712/0 (socket says 172.21.15.19:55712) 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 -- 172.21.15.19:0/4109871321 learned_addr learned my addr 172.21.15.19:0/4109871321 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b97fff640 1 --2- 172.21.15.19:0/4109871321 >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 0x7f8b980d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 -- 172.21.15.19:0/4109871321 >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 msgr2=0x7f8b980d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 --2- 172.21.15.19:0/4109871321 >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 0x7f8b980d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 -- 172.21.15.19:0/4109871321 >> v1:172.21.15.204:6789/0 conn(0x7f8b9815bb20 legacy=0x7f8b980d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b9d20e640 1 -- 172.21.15.19:0/4109871321 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98161f40 con 0x7f8b980cc8b0 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.554+0000 7f8b97fff640 1 --2- 172.21.15.19:0/4109871321 >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 0x7f8b980d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9d20e640 1 --2- 172.21.15.19:0/4109871321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b980ccce0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8b98071290 tx=0x7f8b9002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd010ffead81f25e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b977fe640 1 -- 172.21.15.19:0/4109871321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9002cb20 con 0x7f8b980cc8b0 2024-03-04T08:52:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b977fe640 1 -- 172.21.15.19:0/4109871321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9002ccc0 con 0x7f8b980cc8b0 2024-03-04T08:52:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b977fe640 1 -- 172.21.15.19:0/4109871321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90034610 con 0x7f8b980cc8b0 2024-03-04T08:52:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 -- 172.21.15.19:0/4109871321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 msgr2=0x7f8b980ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/4109871321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b980ccce0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8b98071290 tx=0x7f8b9002bf80 comp rx=0 tx=0).stop 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 -- 172.21.15.19:0/4109871321 shutdown_connections 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/4109871321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b980ccce0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/4109871321 >> v2:172.21.15.204:3300/0 conn(0x7f8b980cfff0 0x7f8b980d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 -- 172.21.15.19:0/4109871321 >> 172.21.15.19:0/4109871321 conn(0x7f8b9809a9f0 msgr2=0x7f8b9809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 -- 172.21.15.19:0/4109871321 shutdown_connections 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.555+0000 7f8b9ec71640 1 -- 172.21.15.19:0/4109871321 wait complete. 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 Processor -- start 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 -- start start 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 0x7f8b9806cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 0x7f8b9806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980d1980 con 0x7f8b980cc8b0 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98162500 con 0x7f8b980cfff0 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.557+0000 7f8b9ec71640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980d1b00 con 0x7f8b9815bb20 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55716/0 (socket says 172.21.15.19:55716) 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 -- 172.21.15.19:0/1421442071 learned_addr learned my addr 172.21.15.19:0/1421442071 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b97fff640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 0x7f8b9806cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9d20e640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 0x7f8b9806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 -- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 msgr2=0x7f8b9806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 0x7f8b9806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 -- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 msgr2=0x7f8b9806cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 0x7f8b9806cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 -- 172.21.15.19:0/1421442071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9806d490 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b97fff640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 0x7f8b9806cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9d20e640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 0x7f8b9806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ca0d640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c3c0 tx=0x7f8b8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0052d0 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c005490 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c007260 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9815a960 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.558+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b980cada0 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.559+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980ca8f0 con 0x7f8b980cc8b0 2024-03-04T08:52:55.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.560+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b8c007400 con 0x7f8b980cc8b0 2024-03-04T08:52:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.560+0000 7f8b957fa640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.560+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b8c089650 con 0x7f8b980cc8b0 2024-03-04T08:52:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.560+0000 7f8b97fff640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.561+0000 7f8b97fff640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8b981f7420 tx=0x7f8b84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.565+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8b8c058560 con 0x7f8b980cc8b0 2024-03-04T08:52:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.783+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b9804f330 con 0x7f8b980cc8b0 2024-03-04T08:52:55.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.784+0000 7f8b957fa640 1 -- 172.21.15.19:0/1421442071 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f8b8c057e60 con 0x7f8b980cc8b0 2024-03-04T08:52:55.780 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:55.780 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:55.781 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 msgr2=0x7f8b7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8b981f7420 tx=0x7f8b84008040 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 msgr2=0x7f8b98154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c3c0 tx=0x7f8b8c00c880 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 shutdown_connections 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8b9815bb20 0x7f8b9806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b980cfff0 0x7f8b9806cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 --2- 172.21.15.19:0/1421442071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b980cc8b0 0x7f8b98154c40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.786+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 >> 172.21.15.19:0/1421442071 conn(0x7f8b9809a9f0 msgr2=0x7f8b9815c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.787+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 shutdown_connections 2024-03-04T08:52:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.787+0000 7f8b9ec71640 1 -- 172.21.15.19:0/1421442071 wait complete. 2024-03-04T08:52:55.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.906+0000 7f095a017640 1 Processor -- start 2024-03-04T08:52:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.906+0000 7f095a017640 1 -- start start 2024-03-04T08:52:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f095a017640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f09540b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f095a017640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540b3430 con 0x7f095415dfe0 2024-03-04T08:52:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f095a017640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540b3710 con 0x7f09540d22b0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f095a017640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540b31e0 con 0x7f09540d2710 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09537fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f095415dfe0 0x7f09540cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41112/0 (socket says 172.21.15.19:41112) 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09537fe640 1 -- 172.21.15.19:0/526570652 learned_addr learned my addr 172.21.15.19:0/526570652 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283083630 0 0) 0x7f09540b3430 con 0x7f095415dfe0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f093c003520 con 0x7f095415dfe0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f0953fff640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f09540b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607587875 0 0) 0x7f093c003520 con 0x7f095415dfe0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 msgr2=0x7f09540b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f09540b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 >> v1:172.21.15.204:6789/0 conn(0x7f09540d22b0 legacy=0x7f09540b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540b39f0 con 0x7f095415dfe0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.907+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f0944001670 con 0x7f095415dfe0 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 >> v1:172.21.15.19:6789/0 conn(0x7f095415dfe0 legacy=0x7f09540cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f093c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c003fd0 0x7f093c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c004d40 0x7f093c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540b31e0 con 0x7f093c003fd0 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c00bb20 con 0x7f093c004d40 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c00bd20 con 0x7f09540d2710 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c003fd0 0x7f093c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f09537fe640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f093c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0953fff640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c004d40 0x7f093c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 -- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 msgr2=0x7f093c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f09540d2710 0x7f093c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 -- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c004d40 msgr2=0x7f093c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c004d40 0x7f093c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0952ffd640 1 -- 172.21.15.19:0/526570652 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c003520 con 0x7f093c003fd0 2024-03-04T08:52:55.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.908+0000 7f0953fff640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f093c004d40 0x7f093c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.909+0000 7f0952ffd640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c003fd0 0x7f093c004800 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0948001750 tx=0x7f093c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3774f6a8e2a368 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.909+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948001370 con 0x7f093c003fd0 2024-03-04T08:52:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.909+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480052d0 con 0x7f093c003fd0 2024-03-04T08:52:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.909+0000 7f09527fc640 1 -- 172.21.15.19:0/526570652 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948003830 con 0x7f093c003fd0 2024-03-04T08:52:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 -- 172.21.15.19:0/526570652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c003fd0 msgr2=0x7f093c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 --2- 172.21.15.19:0/526570652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f093c003fd0 0x7f093c004800 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0948001750 tx=0x7f093c005830 comp rx=0 tx=0).stop 2024-03-04T08:52:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f0953fff640 1 -- 172.21.15.19:0/526570652 reap_dead start 2024-03-04T08:52:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 -- 172.21.15.19:0/526570652 shutdown_connections 2024-03-04T08:52:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 -- 172.21.15.19:0/526570652 >> 172.21.15.19:0/526570652 conn(0x7f09540d3cd0 msgr2=0x7f09540d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 -- 172.21.15.19:0/526570652 shutdown_connections 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.910+0000 7f095a017640 1 -- 172.21.15.19:0/526570652 wait complete. 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.912+0000 7f095a017640 1 Processor -- start 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.912+0000 7f095a017640 1 -- start start 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c003fd0 0x7f09541f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09540ccb40 0x7f09540ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540cfa00 con 0x7f09540b7790 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540b3d60 con 0x7f09540ccb40 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f095a017640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540d1c70 con 0x7f093c003fd0 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f0953fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f0953fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55742/0 (socket says 172.21.15.19:55742) 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f0953fff640 1 -- 172.21.15.19:0/1255062916 learned_addr learned my addr 172.21.15.19:0/1255062916 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f09537fe640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c003fd0 0x7f09541f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.913+0000 7f0952ffd640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09540ccb40 0x7f09540ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 -- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c003fd0 msgr2=0x7f09541f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c003fd0 0x7f09541f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 -- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09540ccb40 msgr2=0x7f09540ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09540ccb40 0x7f09540ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 -- 172.21.15.19:0/1255062916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09541f36f0 con 0x7f09540b7790 2024-03-04T08:52:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f0953fff640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f095408c940 tx=0x7f094c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c01a030 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c010e60 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095415e560 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c003bd0 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.914+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095415eae0 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.915+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095404f330 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.915+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f094c005d10 con 0x7f09540b7790 2024-03-04T08:52:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.916+0000 7f093bfff640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 0x7f094006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.916+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f094c08a6c0 con 0x7f09540b7790 2024-03-04T08:52:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.916+0000 7f09537fe640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 0x7f094006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.917+0000 7f09537fe640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 0x7f094006d9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0944001050 tx=0x7f0944000fa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:55.920+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f094c025020 con 0x7f09540b7790 2024-03-04T08:52:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.105+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f095415d550 con 0x7f09540b7790 2024-03-04T08:52:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.106+0000 7f093bfff640 1 -- 172.21.15.19:0/1255062916 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f09541f36f0 con 0x7f09540b7790 2024-03-04T08:52:56.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:56.116 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 msgr2=0x7f094006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 0x7f094006d9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0944001050 tx=0x7f0944000fa0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 msgr2=0x7f09540b7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f095408c940 tx=0x7f094c010590 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 shutdown_connections 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09540b7790 0x7f09540b7c10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f094006b500 0x7f094006d9c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f09540ccb40 0x7f09540ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 --2- 172.21.15.19:0/1255062916 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f093c003fd0 0x7f09541f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 >> 172.21.15.19:0/1255062916 conn(0x7f09540d3cd0 msgr2=0x7f095406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 shutdown_connections 2024-03-04T08:52:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.108+0000 7f095a017640 1 -- 172.21.15.19:0/1255062916 wait complete. 2024-03-04T08:52:56.119 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T08:52:56.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:56.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.227+0000 7f8c91a81640 1 Processor -- start 2024-03-04T08:52:56.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.227+0000 7f8c91a81640 1 -- start start 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c91a81640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f8c8c06c5c0 0x7f8c8c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c91a81640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0cc090 con 0x7f8c8c06bc00 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c91a81640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0ae170 con 0x7f8c8c15bd10 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c91a81640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c0cc330 con 0x7f8c8c06c5c0 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8c8c06bc00 0x7f8c8c06d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41122/0 (socket says 172.21.15.19:41122) 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8bfff640 1 -- 172.21.15.19:0/444001919 learned_addr learned my addr 172.21.15.19:0/444001919 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:56.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597717691 0 0) 0x7f8c8c0cc090 con 0x7f8c8c06bc00 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/444001919 >> v2:172.21.15.204:3300/0 conn(0x7f8c8c06c5c0 0x7f8c8c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c78003520 con 0x7f8c8c06bc00 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1629831238 0 0) 0x7f8c78003520 con 0x7f8c8c06bc00 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 >> v2:172.21.15.204:3300/0 conn(0x7f8c8c06c5c0 msgr2=0x7f8c8c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 --2- 172.21.15.19:0/444001919 >> v2:172.21.15.204:3300/0 conn(0x7f8c8c06c5c0 0x7f8c8c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 >> v1:172.21.15.204:6789/0 conn(0x7f8c8c15bd10 legacy=0x7f8c8c06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0cc610 con 0x7f8c8c06bc00 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f8c840019f0 con 0x7f8c8c06bc00 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 >> v1:172.21.15.19:6789/0 conn(0x7f8c8c06bc00 legacy=0x7f8c8c06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c780039b0 0x7f8c78003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c780051c0 0x7f8c7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c0cc330 con 0x7f8c78004800 2024-03-04T08:52:56.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7800c090 con 0x7f8c780051c0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.229+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7800c290 con 0x7f8c780039b0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c8bfff640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c780051c0 0x7f8c7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c8b7fe640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c780039b0 0x7f8c78003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 -- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c780039b0 msgr2=0x7f8c78003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c780039b0 0x7f8c78003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 -- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c780051c0 msgr2=0x7f8c7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c780051c0 0x7f8c7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c82ffd640 1 -- 172.21.15.19:0/444001919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78003520 con 0x7f8c78004800 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c8bfff640 1 -- 172.21.15.19:0/444001919 reap_dead start 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.230+0000 7f8c8b7fe640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c780039b0 0x7f8c78003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c78004c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009a90 tx=0x7f8c78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95424ee7138d686b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74039070 con 0x7f8c78004800 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7402c680 con 0x7f8c78004800 2024-03-04T08:52:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c8affd640 1 -- 172.21.15.19:0/444001919 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74009690 con 0x7f8c78004800 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 -- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 msgr2=0x7f8c78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c78004c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009a90 tx=0x7f8c78005830 comp rx=0 tx=0).stop 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 -- 172.21.15.19:0/444001919 shutdown_connections 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 --2- 172.21.15.19:0/444001919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c78004c80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 -- 172.21.15.19:0/444001919 >> 172.21.15.19:0/444001919 conn(0x7f8c8c0d00e0 msgr2=0x7f8c8c0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 -- 172.21.15.19:0/444001919 shutdown_connections 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.231+0000 7f8c91a81640 1 -- 172.21.15.19:0/444001919 wait complete. 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.233+0000 7f8c91a81640 1 Processor -- start 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.233+0000 7f8c91a81640 1 -- start start 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8c15c9b0 0x7f8c8c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c8c0b3690 0x7f8c8c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c15c270 con 0x7f8c78004800 2024-03-04T08:52:56.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c15c0f0 con 0x7f8c8c0b3690 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c91a81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c06afb0 con 0x7f8c8c15c9b0 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55758/0 (socket says 172.21.15.19:55758) 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 -- 172.21.15.19:0/2421278247 learned_addr learned my addr 172.21.15.19:0/2421278247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8bfff640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c8c0b3690 0x7f8c8c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8c15c9b0 0x7f8c8c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 -- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8c15c9b0 msgr2=0x7f8c8c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8c15c9b0 0x7f8c8c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 -- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c8c0b3690 msgr2=0x7f8c8c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c8c0b3690 0x7f8c8c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 -- 172.21.15.19:0/2421278247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0c8270 con 0x7f8c78004800 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.234+0000 7f8c8b7fe640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00e4e0 tx=0x7f8c7c00e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.236+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c019070 con 0x7f8c78004800 2024-03-04T08:52:56.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.236+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0052e0 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.236+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c003830 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.236+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c0b3c00 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.236+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c0c8530 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.237+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c7c0039d0 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.237+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c04f330 con 0x7f8c78004800 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.238+0000 7f8c88ff9640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 0x7f8c6c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.238+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c7c0896f0 con 0x7f8c78004800 2024-03-04T08:52:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.238+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 0x7f8c6c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.238+0000 7f8c82ffd640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 0x7f8c6c06d9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009a90 tx=0x7f8c74030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.242+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c7c057f20 con 0x7f8c78004800 2024-03-04T08:52:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.459+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c8c0cbe50 con 0x7f8c78004800 2024-03-04T08:52:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.460+0000 7f8c88ff9640 1 -- 172.21.15.19:0/2421278247 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f8c7c05bfc0 con 0x7f8c78004800 2024-03-04T08:52:56.457 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:56.457 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 msgr2=0x7f8c6c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 0x7f8c6c06d9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009a90 tx=0x7f8c74030000 comp rx=0 tx=0).stop 2024-03-04T08:52:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 msgr2=0x7f8c8c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00e4e0 tx=0x7f8c7c00e8e0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 shutdown_connections 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8c6c06b500 0x7f8c6c06d9c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8c8c0b3690 0x7f8c8c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8c8c15c9b0 0x7f8c8c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 --2- 172.21.15.19:0/2421278247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c78004800 0x7f8c8c0cec10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 >> 172.21.15.19:0/2421278247 conn(0x7f8c8c0d00e0 msgr2=0x7f8c8c0cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 shutdown_connections 2024-03-04T08:52:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.462+0000 7f8c91a81640 1 -- 172.21.15.19:0/2421278247 wait complete. 2024-03-04T08:52:56.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:52:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.587+0000 7f60ec4c9640 1 Processor -- start 2024-03-04T08:52:56.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.587+0000 7f60ec4c9640 1 -- start start 2024-03-04T08:52:56.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60ec4c9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f60e415dec0 0x7f60e40b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60ec4c9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60e4162650 0x7f60e40b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60ec4c9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40b4060 con 0x7f60e4071950 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60ec4c9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40b3e30 con 0x7f60e4162650 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60ec4c9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40b4340 con 0x7f60e415dec0 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60e9a64640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60e4162650 0x7f60e40b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60eaa66640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f60e4071950 0x7f60e406d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41134/0 (socket says 172.21.15.19:41134) 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.588+0000 7f60eaa66640 1 -- 172.21.15.19:0/2126917114 learned_addr learned my addr 172.21.15.19:0/2126917114 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60ea265640 1 --2- 172.21.15.19:0/2126917114 >> v2:172.21.15.204:3300/0 conn(0x7f60e415dec0 0x7f60e40b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9a64640 1 -- 172.21.15.19:0/2126917114 >> v2:172.21.15.204:3300/0 conn(0x7f60e415dec0 msgr2=0x7f60e40b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9a64640 1 --2- 172.21.15.19:0/2126917114 >> v2:172.21.15.204:3300/0 conn(0x7f60e415dec0 0x7f60e40b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9a64640 1 -- 172.21.15.19:0/2126917114 >> v1:172.21.15.19:6789/0 conn(0x7f60e4071950 legacy=0x7f60e406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9a64640 1 -- 172.21.15.19:0/2126917114 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4161b70 con 0x7f60e4162650 2024-03-04T08:52:56.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9263640 1 -- 172.21.15.19:0/2126917114 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832469435 0 0) 0x7f60e40b4060 con 0x7f60e4071950 2024-03-04T08:52:56.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.589+0000 7f60e9a64640 1 --2- 172.21.15.19:0/2126917114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e4162650 0x7f60e40b38f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f60e40d1a00 tx=0x7f60d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473cf90b4b11edd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60e9263640 1 -- 172.21.15.19:0/2126917114 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4035020 con 0x7f60e4162650 2024-03-04T08:52:56.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60e9263640 1 -- 172.21.15.19:0/2126917114 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4031830 con 0x7f60e4162650 2024-03-04T08:52:56.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60e9263640 1 -- 172.21.15.19:0/2126917114 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4031c00 con 0x7f60e4162650 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 -- 172.21.15.19:0/2126917114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e4162650 msgr2=0x7f60e40b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/2126917114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e4162650 0x7f60e40b38f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f60e40d1a00 tx=0x7f60d402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 -- 172.21.15.19:0/2126917114 shutdown_connections 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/2126917114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e4162650 0x7f60e40b38f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/2126917114 >> v2:172.21.15.204:3300/0 conn(0x7f60e415dec0 0x7f60e40b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 -- 172.21.15.19:0/2126917114 >> 172.21.15.19:0/2126917114 conn(0x7f60e40b25f0 msgr2=0x7f60e40b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 -- 172.21.15.19:0/2126917114 shutdown_connections 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.590+0000 7f60ec4c9640 1 -- 172.21.15.19:0/2126917114 wait complete. 2024-03-04T08:52:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.591+0000 7f60ec4c9640 1 Processor -- start 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.591+0000 7f60ec4c9640 1 -- start start 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 0x7f60e4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60e4162650 0x7f60e4146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4162130 con 0x7f60e415dec0 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e415f2b0 con 0x7f60e4071950 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ec4c9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4071dc0 con 0x7f60e4162650 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55774/0 (socket says 172.21.15.19:55774) 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 -- 172.21.15.19:0/3639747644 learned_addr learned my addr 172.21.15.19:0/3639747644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 -- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60e4162650 msgr2=0x7f60e4146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60e4162650 0x7f60e4146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 -- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 msgr2=0x7f60e4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ea265640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 0x7f60e4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 0x7f60e4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60e9a64640 1 -- 172.21.15.19:0/3639747644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4155de0 con 0x7f60e415dec0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.592+0000 7f60ea265640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 0x7f60e4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60e9a64640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60d4034040 tx=0x7f60d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4035040 con 0x7f60e415dec0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4004230 con 0x7f60e415dec0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d403a700 con 0x7f60e415dec0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e41543c0 con 0x7f60e415dec0 2024-03-04T08:52:56.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.593+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e4156080 con 0x7f60e415dec0 2024-03-04T08:52:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.594+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e404f330 con 0x7f60e415dec0 2024-03-04T08:52:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.594+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60d4038020 con 0x7f60e415dec0 2024-03-04T08:52:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.595+0000 7f60daffd640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 0x7f60c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.595+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60d40abfb0 con 0x7f60e415dec0 2024-03-04T08:52:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.595+0000 7f60ea265640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 0x7f60c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.596+0000 7f60ea265640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 0x7f60c806d9c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60e0006fd0 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.599+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f60d407ae30 con 0x7f60e415dec0 2024-03-04T08:52:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.817+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e4157cf0 con 0x7f60e415dec0 2024-03-04T08:52:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.817+0000 7f60daffd640 1 -- 172.21.15.19:0/3639747644 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4974 (secure 0 0 0) 0x7f60d407a730 con 0x7f60e415dec0 2024-03-04T08:52:56.814 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:56.814 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T08:52:31.193124+0000","modified":"2024-03-04T08:52:34.201909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6833/245913424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":245913424},{"type":"v1","addr":"172.21.15.19:6833","nonce":245913424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":3}]} 2024-03-04T08:52:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 22 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 msgr2=0x7f60c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 0x7f60c806d9c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60e0006fd0 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 msgr2=0x7f60e4157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60d4034040 tx=0x7f60d40046c0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 shutdown_connections 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f60e4162650 0x7f60e4146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60e415dec0 0x7f60e4157f30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f60c806b500 0x7f60c806d9c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 --2- 172.21.15.19:0/3639747644 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f60e4071950 0x7f60e4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 >> 172.21.15.19:0/3639747644 conn(0x7f60e40b25f0 msgr2=0x7f60e406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 shutdown_connections 2024-03-04T08:52:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.819+0000 7f60ec4c9640 1 -- 172.21.15.19:0/3639747644 wait complete. 2024-03-04T08:52:56.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:52:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.936+0000 7f0c0985c640 1 Processor -- start 2024-03-04T08:52:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.936+0000 7f0c0985c640 1 -- start start 2024-03-04T08:52:56.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c0985c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c0415dfe0 0x7f0c040cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c0985c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c040b3430 con 0x7f0c040cf830 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c0985c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c040b3710 con 0x7f0c040d29c0 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c0985c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040b31e0 con 0x7f0c0415dfe0 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c02ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c0415dfe0 0x7f0c040cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c027fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c040cf830 0x7f0c040d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41148/0 (socket says 172.21.15.19:41148) 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c027fc640 1 -- 172.21.15.19:0/634389135 learned_addr learned my addr 172.21.15.19:0/634389135 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c01ffb640 1 -- 172.21.15.19:0/634389135 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452354817 0 0) 0x7f0c040b3430 con 0x7f0c040cf830 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c01ffb640 1 -- 172.21.15.19:0/634389135 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf0003520 con 0x7f0c040cf830 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c02ffd640 1 -- 172.21.15.19:0/634389135 >> v1:172.21.15.204:6789/0 conn(0x7f0c040d29c0 legacy=0x7f0c040b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.937+0000 7f0c02ffd640 1 -- 172.21.15.19:0/634389135 >> v1:172.21.15.19:6789/0 conn(0x7f0c040cf830 legacy=0x7f0c040d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.938+0000 7f0c02ffd640 1 -- 172.21.15.19:0/634389135 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040b39f0 con 0x7f0c0415dfe0 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.938+0000 7f0c02ffd640 1 --2- 172.21.15.19:0/634389135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0415dfe0 0x7f0c040cf2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c040b3360 tx=0x7f0bec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c919f97c6c44f7d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.938+0000 7f0c01ffb640 1 -- 172.21.15.19:0/634389135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec035020 con 0x7f0c0415dfe0 2024-03-04T08:52:56.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.938+0000 7f0c01ffb640 1 -- 172.21.15.19:0/634389135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec031830 con 0x7f0c0415dfe0 2024-03-04T08:52:56.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.938+0000 7f0c01ffb640 1 -- 172.21.15.19:0/634389135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec031c00 con 0x7f0c0415dfe0 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 -- 172.21.15.19:0/634389135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0415dfe0 msgr2=0x7f0c040cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 --2- 172.21.15.19:0/634389135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0415dfe0 0x7f0c040cf2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c040b3360 tx=0x7f0bec02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 -- 172.21.15.19:0/634389135 shutdown_connections 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 --2- 172.21.15.19:0/634389135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0415dfe0 0x7f0c040cf2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 -- 172.21.15.19:0/634389135 >> 172.21.15.19:0/634389135 conn(0x7f0c040d3cd0 msgr2=0x7f0c040d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 -- 172.21.15.19:0/634389135 shutdown_connections 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.939+0000 7f0c0985c640 1 -- 172.21.15.19:0/634389135 wait complete. 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.940+0000 7f0c0985c640 1 Processor -- start 2024-03-04T08:52:56.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.940+0000 7f0c0985c640 1 -- start start 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 0x7f0c040b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 0x7f0c041520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0415e3c0 con 0x7f0c040d29c0 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040b3d60 con 0x7f0c0415dfe0 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c0985c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0415e540 con 0x7f0c040cf830 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55794/0 (socket says 172.21.15.19:55794) 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 -- 172.21.15.19:0/3935717337 learned_addr learned my addr 172.21.15.19:0/3935717337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c037fe640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 0x7f0c041520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c02ffd640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 0x7f0c040b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 -- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 msgr2=0x7f0c040b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 0x7f0c040b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 -- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 msgr2=0x7f0c041520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 0x7f0c041520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c027fc640 1 -- 172.21.15.19:0/3935717337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040cc0d0 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c037fe640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 0x7f0c041520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.941+0000 7f0c02ffd640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 0x7f0c040b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0c027fc640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c400 tx=0x7f0bf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4017070 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf4005d00 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c040cc3b0 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4007310 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.942+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c040cc970 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.943+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0404f330 con 0x7f0c040d29c0 2024-03-04T08:52:56.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.943+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bf401a070 con 0x7f0c040d29c0 2024-03-04T08:52:56.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.943+0000 7f0bfbfff640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 0x7f0be406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:56.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.944+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bf4089670 con 0x7f0c040d29c0 2024-03-04T08:52:56.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.944+0000 7f0c02ffd640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 0x7f0be406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:56.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.944+0000 7f0c02ffd640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 0x7f0be406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0bec036000 tx=0x7f0bec03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:56.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:56.948+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0bf40584e0 con 0x7f0c040d29c0 2024-03-04T08:52:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.130+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c041f43a0 con 0x7f0c040d29c0 2024-03-04T08:52:57.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.131+0000 7f0bfbfff640 1 -- 172.21.15.19:0/3935717337 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f0bf4057de0 con 0x7f0c040d29c0 2024-03-04T08:52:57.130 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:52:57.130 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":49,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:52:32.845342+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-04T08:52:29.465211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-04T08:52:30.158067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:52:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 msgr2=0x7f0be406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 0x7f0be406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0bec036000 tx=0x7f0bec03c040 comp rx=0 tx=0).stop 2024-03-04T08:52:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 msgr2=0x7f0c041f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c400 tx=0x7f0bf400c8c0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 shutdown_connections 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0be406b4d0 0x7f0be406d990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0c0415dfe0 0x7f0c041520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c040d29c0 0x7f0c041f3e60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 --2- 172.21.15.19:0/3935717337 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0c040cf830 0x7f0c040b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 >> 172.21.15.19:0/3935717337 conn(0x7f0c040d3cd0 msgr2=0x7f0c0406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:57.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 shutdown_connections 2024-03-04T08:52:57.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.134+0000 7f0c0985c640 1 -- 172.21.15.19:0/3935717337 wait complete. 2024-03-04T08:52:57.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T08:52:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.250+0000 7ff261284640 1 Processor -- start 2024-03-04T08:52:57.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.250+0000 7ff261284640 1 -- start start 2024-03-04T08:52:57.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff261284640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0b4460 0x7ff25c0d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff261284640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff25c161cf0 0x7ff25c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff261284640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0d22c0 con 0x7ff25c162970 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff261284640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c161b00 con 0x7ff25c161cf0 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff261284640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0cecc0 con 0x7ff25c0b4460 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff25c161cf0 0x7ff25c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25a7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff25c162970 0x7ff25c0b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41152/0 (socket says 172.21.15.19:41152) 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25a7fc640 1 -- 172.21.15.19:0/3499912764 learned_addr learned my addr 172.21.15.19:0/3499912764 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25affd640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0b4460 0x7ff25c0d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25b7fe640 1 -- 172.21.15.19:0/3499912764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0b4460 msgr2=0x7ff25c0d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25b7fe640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0b4460 0x7ff25c0d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25b7fe640 1 -- 172.21.15.19:0/3499912764 >> v1:172.21.15.19:6789/0 conn(0x7ff25c162970 legacy=0x7ff25c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff25b7fe640 1 -- 172.21.15.19:0/3499912764 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0d25a0 con 0x7ff25c161cf0 2024-03-04T08:52:57.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.251+0000 7ff259ffb640 1 -- 172.21.15.19:0/3499912764 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294257016 0 0) 0x7ff25c0d22c0 con 0x7ff25c162970 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.252+0000 7ff25b7fe640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c161cf0 0x7ff25c162180 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff254009d90 tx=0x7ff25402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3a6f66e3e7b27f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.252+0000 7ff259ffb640 1 -- 172.21.15.19:0/3499912764 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254039070 con 0x7ff25c161cf0 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.252+0000 7ff259ffb640 1 -- 172.21.15.19:0/3499912764 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25402cc50 con 0x7ff25c161cf0 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.252+0000 7ff259ffb640 1 -- 172.21.15.19:0/3499912764 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254034440 con 0x7ff25c161cf0 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 -- 172.21.15.19:0/3499912764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c161cf0 msgr2=0x7ff25c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c161cf0 0x7ff25c162180 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff254009d90 tx=0x7ff25402bea0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 -- 172.21.15.19:0/3499912764 shutdown_connections 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c161cf0 0x7ff25c162180 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 --2- 172.21.15.19:0/3499912764 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c0b4460 0x7ff25c0d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 -- 172.21.15.19:0/3499912764 >> 172.21.15.19:0/3499912764 conn(0x7ff25c0d3ce0 msgr2=0x7ff25c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 -- 172.21.15.19:0/3499912764 shutdown_connections 2024-03-04T08:52:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.253+0000 7ff261284640 1 -- 172.21.15.19:0/3499912764 wait complete. 2024-03-04T08:52:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.254+0000 7ff261284640 1 Processor -- start 2024-03-04T08:52:57.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.254+0000 7ff261284640 1 -- start start 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 0x7ff25c0b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c162970 0x7ff25c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0ce950 con 0x7ff25c0b4460 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0d2b60 con 0x7ff25c161cf0 2024-03-04T08:52:57.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff261284640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0b4840 con 0x7ff25c162970 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55824/0 (socket says 172.21.15.19:55824) 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 -- 172.21.15.19:0/875082489 learned_addr learned my addr 172.21.15.19:0/875082489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25b7fe640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c162970 0x7ff25c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25a7fc640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 0x7ff25c0b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 -- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c162970 msgr2=0x7ff25c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c162970 0x7ff25c0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 -- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 msgr2=0x7ff25c0b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 0x7ff25c0b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 -- 172.21.15.19:0/875082489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c1f7910 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25a7fc640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 0x7ff25c0b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.255+0000 7ff25affd640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d5f0 tx=0x7ff25000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.256+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500125f0 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.256+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff250019070 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.256+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c1f7bf0 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.256+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500129d0 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.256+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c0cb2f0 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.257+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c04f330 con 0x7ff25c0b4460 2024-03-04T08:52:57.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.257+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff250012b70 con 0x7ff25c0b4460 2024-03-04T08:52:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.258+0000 7ff2437fe640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 0x7ff24806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.258+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff25008aff0 con 0x7ff25c0b4460 2024-03-04T08:52:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.258+0000 7ff25a7fc640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 0x7ff24806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.259+0000 7ff25a7fc640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 0x7ff24806d990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0c9dc0 tx=0x7ff24c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.262+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff250059fe0 con 0x7ff25c0b4460 2024-03-04T08:52:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.598+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff25c0ca620 con 0x7ff25c0b4460 2024-03-04T08:52:57.596 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-03-04T08:52:57.598+0000 7f9856575640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T08:52:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.600+0000 7ff2437fe640 1 -- 172.21.15.19:0/875082489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff2500598e0 con 0x7ff25c0b4460 2024-03-04T08:52:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T08:52:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.602+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 msgr2=0x7ff24806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.602+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 0x7ff24806d990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0c9dc0 tx=0x7ff24c009040 comp rx=0 tx=0).stop 2024-03-04T08:52:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.602+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 msgr2=0x7ff25c1f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.602+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d5f0 tx=0x7ff25000dab0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 shutdown_connections 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff25c162970 0x7ff25c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff24806b4d0 0x7ff24806d990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff25c161cf0 0x7ff25c0b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 --2- 172.21.15.19:0/875082489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25c0b4460 0x7ff25c1f7230 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 >> 172.21.15.19:0/875082489 conn(0x7ff25c0d3ce0 msgr2=0x7ff25c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 shutdown_connections 2024-03-04T08:52:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.603+0000 7ff261284640 1 -- 172.21.15.19:0/875082489 wait complete. 2024-03-04T08:52:57.601 INFO:tasks.ceph.mds.a.smithi019.stderr: -2542> 2024-03-04T08:52:37.819+0000 7f01d2ee9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T08:52:57.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T08:52:57.629 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-04T08:52:57.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 Processor -- start 2024-03-04T08:52:57.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 -- start start 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f720015def0 0x7f72000b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f720006cab0 0x7f72000ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720006d030 con 0x7f72000ce880 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72000cecf0 con 0x7f720006cab0 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.720+0000 7f7204e4e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000cf1c0 con 0x7f720015def0 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71f7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f720006cab0 0x7f72000ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71fed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f72000ce880 0x7f72000cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44758/0 (socket says 172.21.15.19:44758) 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71fed9d640 1 -- 172.21.15.19:0/2705490793 learned_addr learned my addr 172.21.15.19:0/2705490793 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:52:57.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71fe59c640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f720015def0 0x7f72000b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71f7fff640 1 -- 172.21.15.19:0/2705490793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f720015def0 msgr2=0x7f72000b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71f7fff640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f720015def0 0x7f72000b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71f7fff640 1 -- 172.21.15.19:0/2705490793 >> v1:172.21.15.19:6789/0 conn(0x7f72000ce880 legacy=0x7f72000cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71f7fff640 1 -- 172.21.15.19:0/2705490793 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720006d310 con 0x7f720006cab0 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.721+0000 7f71fdd9b640 1 -- 172.21.15.19:0/2705490793 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556890271 0 0) 0x7f720006d030 con 0x7f72000ce880 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f71f7fff640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720006cab0 0x7f72000ce340 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71e80097a0 tx=0x7f71e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656caf306f1225cd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f71fdd9b640 1 -- 172.21.15.19:0/2705490793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8034070 con 0x7f720006cab0 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f71fdd9b640 1 -- 172.21.15.19:0/2705490793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8030610 con 0x7f720006cab0 2024-03-04T08:52:57.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f71fdd9b640 1 -- 172.21.15.19:0/2705490793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80309e0 con 0x7f720006cab0 2024-03-04T08:52:57.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 -- 172.21.15.19:0/2705490793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720006cab0 msgr2=0x7f72000ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720006cab0 0x7f72000ce340 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71e80097a0 tx=0x7f71e802b960 comp rx=0 tx=0).stop 2024-03-04T08:52:57.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 -- 172.21.15.19:0/2705490793 shutdown_connections 2024-03-04T08:52:57.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720006cab0 0x7f72000ce340 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 --2- 172.21.15.19:0/2705490793 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f720015def0 0x7f72000b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.722+0000 7f7204e4e640 1 -- 172.21.15.19:0/2705490793 >> 172.21.15.19:0/2705490793 conn(0x7f72000b3690 msgr2=0x7f72000b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.723+0000 7f7204e4e640 1 -- 172.21.15.19:0/2705490793 shutdown_connections 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.723+0000 7f7204e4e640 1 -- 172.21.15.19:0/2705490793 wait complete. 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.724+0000 7f7204e4e640 1 Processor -- start 2024-03-04T08:52:57.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.724+0000 7f7204e4e640 1 -- start start 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f720006cab0 0x7f72000b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72000ce880 0x7f72001528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000cc3f0 con 0x7f720015def0 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000cc760 con 0x7f720006cab0 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720015e2d0 con 0x7f72000ce880 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52898/0 (socket says 172.21.15.19:52898) 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 -- 172.21.15.19:0/3801538616 learned_addr learned my addr 172.21.15.19:0/3801538616 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:57.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71f7fff640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72000ce880 0x7f72001528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fe59c640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f720006cab0 0x7f72000b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 -- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72000ce880 msgr2=0x7f72001528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72000ce880 0x7f72001528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 -- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f720006cab0 msgr2=0x7f72000b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f720006cab0 0x7f72000b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 -- 172.21.15.19:0/3801538616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000c6d70 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71fed9d640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c7d0 tx=0x7f71f800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8018070 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f800a640 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72000c7050 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800aa70 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.725+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72000c7610 con 0x7f720015def0 2024-03-04T08:52:57.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.726+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720009fcf0 con 0x7f720015def0 2024-03-04T08:52:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.727+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71f801b070 con 0x7f720015def0 2024-03-04T08:52:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.727+0000 7f71f6ffd640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 0x7f71e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.727+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f71f8089850 con 0x7f720015def0 2024-03-04T08:52:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.727+0000 7f71fe59c640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 0x7f71e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:57.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.728+0000 7f71fe59c640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 0x7f71e006d9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009970 tx=0x7f71f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.732+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f71f8058670 con 0x7f720015def0 2024-03-04T08:52:57.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:57.950+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f720006f2e0 con 0x7f720015def0 2024-03-04T08:52:58.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.602+0000 7f71f6ffd640 1 -- 172.21.15.19:0/3801538616 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71f8057f70 con 0x7f720015def0 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 msgr2=0x7f71e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 0x7f71e006d9c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009970 tx=0x7f71f0008040 comp rx=0 tx=0).stop 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 msgr2=0x7f72000c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c7d0 tx=0x7f71f800cc90 comp rx=0 tx=0).stop 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 shutdown_connections 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f720015def0 0x7f72000c7df0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72000ce880 0x7f72001528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f71e006b500 0x7f71e006d9c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 --2- 172.21.15.19:0/3801538616 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f720006cab0 0x7f72000b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 >> 172.21.15.19:0/3801538616 conn(0x7f72000b3690 msgr2=0x7f720006fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 shutdown_connections 2024-03-04T08:52:58.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.604+0000 7f7204e4e640 1 -- 172.21.15.19:0/3801538616 wait complete. 2024-03-04T08:52:58.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T08:52:58.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.773+0000 7f6d25c34640 1 Processor -- start 2024-03-04T08:52:58.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.773+0000 7f6d25c34640 1 -- start start 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d20161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f6d200d2720 0x7f6d200cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d2006be00 0x7f6d2006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d200d00c0 con 0x7f6d2006be00 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d201623b0 con 0x7f6d200d2720 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d25c34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200cf790 con 0x7f6d20161a90 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d1ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d2006be00 0x7f6d2006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d1ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d2006be00 0x7f6d2006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52908/0 (socket says 172.21.15.19:52908) 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.774+0000 7f6d1ffff640 1 -- 172.21.15.19:0/2694838062 learned_addr learned my addr 172.21.15.19:0/2694838062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1effd640 1 --2- 172.21.15.19:0/2694838062 >> v2:172.21.15.204:3300/0 conn(0x7f6d200d2720 0x7f6d200cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 -- 172.21.15.19:0/2694838062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 msgr2=0x7f6d20161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 --2- 172.21.15.19:0/2694838062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d20161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 -- 172.21.15.19:0/2694838062 >> v2:172.21.15.204:3300/0 conn(0x7f6d200d2720 msgr2=0x7f6d200cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:58.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 --2- 172.21.15.19:0/2694838062 >> v2:172.21.15.204:3300/0 conn(0x7f6d200d2720 0x7f6d200cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 -- 172.21.15.19:0/2694838062 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200cfa70 con 0x7f6d2006be00 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.775+0000 7f6d1ffff640 1 --2- 172.21.15.19:0/2694838062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d2006c290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6d20071ff0 tx=0x7f6d1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3810996ab34ed6bd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d1e7fc640 1 -- 172.21.15.19:0/2694838062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1802ca70 con 0x7f6d2006be00 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d1e7fc640 1 -- 172.21.15.19:0/2694838062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1802cc10 con 0x7f6d2006be00 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d1e7fc640 1 -- 172.21.15.19:0/2694838062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180343f0 con 0x7f6d2006be00 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 -- 172.21.15.19:0/2694838062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 msgr2=0x7f6d2006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 --2- 172.21.15.19:0/2694838062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d2006c290 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6d20071ff0 tx=0x7f6d1802bed0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 -- 172.21.15.19:0/2694838062 shutdown_connections 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 --2- 172.21.15.19:0/2694838062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d2006c290 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 --2- 172.21.15.19:0/2694838062 >> v2:172.21.15.204:3300/0 conn(0x7f6d200d2720 0x7f6d200cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 --2- 172.21.15.19:0/2694838062 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d20161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 -- 172.21.15.19:0/2694838062 >> 172.21.15.19:0/2694838062 conn(0x7f6d200d1b20 msgr2=0x7f6d200d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 -- 172.21.15.19:0/2694838062 shutdown_connections 2024-03-04T08:52:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.776+0000 7f6d25c34640 1 -- 172.21.15.19:0/2694838062 wait complete. 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.777+0000 7f6d25c34640 1 Processor -- start 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 -- start start 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200d2720 0x7f6d201e8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d2015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200cdd10 con 0x7f6d2006be00 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20161790 con 0x7f6d200d2720 2024-03-04T08:52:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d25c34640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200cd9b0 con 0x7f6d20161a90 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52916/0 (socket says 172.21.15.19:52916) 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.778+0000 7f6d1f7fe640 1 -- 172.21.15.19:0/1791286895 learned_addr learned my addr 172.21.15.19:0/1791286895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1ffff640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d2015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1effd640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200d2720 0x7f6d201e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 -- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 msgr2=0x7f6d2015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d2015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 -- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200d2720 msgr2=0x7f6d201e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200d2720 0x7f6d201e8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 -- 172.21.15.19:0/1791286895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d201e8f10 con 0x7f6d2006be00 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d1f7fe640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000b410 tx=0x7f6d1000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10015020 con 0x7f6d2006be00 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d10011850 con 0x7f6d2006be00 2024-03-04T08:52:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d201e74e0 con 0x7f6d2006be00 2024-03-04T08:52:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011c40 con 0x7f6d2006be00 2024-03-04T08:52:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.779+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d201e7aa0 con 0x7f6d2006be00 2024-03-04T08:52:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.780+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2004f330 con 0x7f6d2006be00 2024-03-04T08:52:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.780+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d10018020 con 0x7f6d2006be00 2024-03-04T08:52:58.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.781+0000 7f6d07fff640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 0x7f6d0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:58.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.781+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6d1008a200 con 0x7f6d2006be00 2024-03-04T08:52:58.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.781+0000 7f6d1effd640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 0x7f6d0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:58.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.782+0000 7f6d1effd640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 0x7f6d0c06d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6d200b7740 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:58.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.785+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6d1001f020 con 0x7f6d2006be00 2024-03-04T08:52:58.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:58.966+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d200b7aa0 con 0x7f6d2006be00 2024-03-04T08:52:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.606+0000 7f6d07fff640 1 -- 172.21.15.19:0/1791286895 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6d100172c0 con 0x7f6d2006be00 2024-03-04T08:52:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-03-04T08:52:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 msgr2=0x7f6d0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 0x7f6d0c06d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6d200b7740 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-03-04T08:52:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 msgr2=0x7f6d201604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000b410 tx=0x7f6d1000b8d0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 shutdown_connections 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f6d20161a90 0x7f6d2015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f6d0c06b4d0 0x7f6d0c06d990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6d200d2720 0x7f6d201e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 --2- 172.21.15.19:0/1791286895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2006be00 0x7f6d201604a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.611+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 >> 172.21.15.19:0/1791286895 conn(0x7f6d200d1b20 msgr2=0x7f6d2006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:59.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.612+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 shutdown_connections 2024-03-04T08:52:59.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.612+0000 7f6d25c34640 1 -- 172.21.15.19:0/1791286895 wait complete. 2024-03-04T08:52:59.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T08:52:59.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.737+0000 7f75fd57a640 1 Processor -- start 2024-03-04T08:52:59.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.737+0000 7f75fd57a640 1 -- start start 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 0x7f75f80d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 0x7f75f80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75f80d2820 0x7f75f80d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80d2100 con 0x7f75f80d2820 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f815e380 con 0x7f75f815dfa0 2024-03-04T08:52:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75fd57a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80d1e30 con 0x7f75f80d4630 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75f77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75f80d2820 0x7f75f80d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75f77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75f80d2820 0x7f75f80d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52926/0 (socket says 172.21.15.19:52926) 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.738+0000 7f75f77fe640 1 -- 172.21.15.19:0/2650185132 learned_addr learned my addr 172.21.15.19:0/2650185132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f6ffd640 1 --2- 172.21.15.19:0/2650185132 >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 0x7f75f80d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f67fc640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 0x7f75f80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 -- 172.21.15.19:0/2650185132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 msgr2=0x7f75f80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 0x7f75f80d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 -- 172.21.15.19:0/2650185132 >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 msgr2=0x7f75f80d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 --2- 172.21.15.19:0/2650185132 >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 0x7f75f80d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 -- 172.21.15.19:0/2650185132 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80cf470 con 0x7f75f80d2820 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f67fc640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 0x7f75f80d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:59.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f6ffd640 1 --2- 172.21.15.19:0/2650185132 >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 0x7f75f80d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.739+0000 7f75f77fe640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d2820 0x7f75f80d05f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f75f808d560 tx=0x7f75e802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5409b4c7448622 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75f5ffb640 1 -- 172.21.15.19:0/2650185132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e802c9e0 con 0x7f75f80d2820 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75f5ffb640 1 -- 172.21.15.19:0/2650185132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e802cb80 con 0x7f75f80d2820 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75f5ffb640 1 -- 172.21.15.19:0/2650185132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80343f0 con 0x7f75f80d2820 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 -- 172.21.15.19:0/2650185132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d2820 msgr2=0x7f75f80d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d2820 0x7f75f80d05f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f75f808d560 tx=0x7f75e802be40 comp rx=0 tx=0).stop 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 -- 172.21.15.19:0/2650185132 shutdown_connections 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d2820 0x7f75f80d05f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 --2- 172.21.15.19:0/2650185132 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f80d4630 0x7f75f80d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 --2- 172.21.15.19:0/2650185132 >> v2:172.21.15.204:3300/0 conn(0x7f75f815dfa0 0x7f75f80d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 -- 172.21.15.19:0/2650185132 >> 172.21.15.19:0/2650185132 conn(0x7f75f809d000 msgr2=0x7f75f80d3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:52:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 -- 172.21.15.19:0/2650185132 shutdown_connections 2024-03-04T08:52:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.740+0000 7f75fd57a640 1 -- 172.21.15.19:0/2650185132 wait complete. 2024-03-04T08:52:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 Processor -- start 2024-03-04T08:52:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 -- start start 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75f80d2820 0x7f75f81f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f815dfa0 0x7f75f80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80d0b30 con 0x7f75f80d4630 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80cfa30 con 0x7f75f80d2820 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75fd57a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80d0cb0 con 0x7f75f815dfa0 2024-03-04T08:52:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.742+0000 7f75f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52932/0 (socket says 172.21.15.19:52932) 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 -- 172.21.15.19:0/1735474554 learned_addr learned my addr 172.21.15.19:0/1735474554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f6ffd640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75f80d2820 0x7f75f81f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f77fe640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f815dfa0 0x7f75f80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 -- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f815dfa0 msgr2=0x7f75f80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f815dfa0 0x7f75f80ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 -- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75f80d2820 msgr2=0x7f75f81f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75f80d2820 0x7f75f81f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 -- 172.21.15.19:0/1735474554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b8130 con 0x7f75f80d4630 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75f67fc640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c7f0 tx=0x7f75e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0015070 con 0x7f75f80d4630 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0007a30 con 0x7f75f80d4630 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f81f4a40 con 0x7f75f80d4630 2024-03-04T08:52:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0007e00 con 0x7f75f80d4630 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.743+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80b7b70 con 0x7f75f80d4630 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.744+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f804f330 con 0x7f75f80d4630 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.745+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75e0018070 con 0x7f75f80d4630 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.745+0000 7f75ef7fe640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 0x7f75d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.745+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f75e0089e80 con 0x7f75f80d4630 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.745+0000 7f75f6ffd640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 0x7f75d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:52:59.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.746+0000 7f75f6ffd640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 0x7f75d806d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75f000aac0 tx=0x7f75f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:52:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.749+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f75e00588a0 con 0x7f75f80d4630 2024-03-04T08:52:59.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:52:59.930+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75f80c6f90 con 0x7f75f80d4630 2024-03-04T08:53:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.608+0000 7f75ef7fe640 1 -- 172.21.15.19:0/1735474554 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f75e005c940 con 0x7f75f80d4630 2024-03-04T08:53:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-03-04T08:53:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.612+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 msgr2=0x7f75d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.612+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 0x7f75d806d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75f000aac0 tx=0x7f75f0008040 comp rx=0 tx=0).stop 2024-03-04T08:53:00.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.612+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 msgr2=0x7f75f80b9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.612+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c7f0 tx=0x7f75e000ccb0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 shutdown_connections 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f75f815dfa0 0x7f75f80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75f80d4630 0x7f75f80b9270 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f75d806b4d0 0x7f75d806d990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 --2- 172.21.15.19:0/1735474554 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75f80d2820 0x7f75f81f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 >> 172.21.15.19:0/1735474554 conn(0x7f75f809d000 msgr2=0x7f75f80cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.614+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 shutdown_connections 2024-03-04T08:53:00.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.615+0000 7f75fd57a640 1 -- 172.21.15.19:0/1735474554 wait complete. 2024-03-04T08:53:00.628 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-04T08:53:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.740+0000 7f8bb059a640 1 Processor -- start 2024-03-04T08:53:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.740+0000 7f8bb059a640 1 -- start start 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bb059a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8ba80d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bb059a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba81618b0 con 0x7f8ba81614d0 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bb059a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba80cf400 con 0x7f8ba80b0e30 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bb059a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d4cc0 con 0x7f8ba80d4860 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bae336640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8ba81614d0 0x7f8ba80d1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44762/0 (socket says 172.21.15.19:44762) 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.741+0000 7f8bae336640 1 -- 172.21.15.19:0/3264784528 learned_addr learned my addr 172.21.15.19:0/3264784528 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441737187 0 0) 0x7f8ba81618b0 con 0x7f8ba81614d0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b90003520 con 0x7f8ba81614d0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8ba80d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274273670 0 0) 0x7f8b90003520 con 0x7f8ba81614d0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 msgr2=0x7f8ba80d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8ba80d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 >> v1:172.21.15.204:6789/0 conn(0x7f8ba80b0e30 legacy=0x7f8ba80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80cf6a0 con 0x7f8ba81614d0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f8b980019f0 con 0x7f8ba81614d0 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 >> v1:172.21.15.19:6789/0 conn(0x7f8ba81614d0 legacy=0x7f8ba80d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8b900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8b90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b90004d40 0x7f8b900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d4cc0 con 0x7f8b90003f60 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9000baa0 con 0x7f8b90004d40 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9000bca0 con 0x7f8ba80d4860 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8b90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8bae336640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8b900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8baeb37640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b90004d40 0x7f8b900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 -- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 msgr2=0x7f8b900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80d4860 0x7f8b900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 -- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b90004d40 msgr2=0x7f8b900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b90004d40 0x7f8b900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8badb35640 1 -- 172.21.15.19:0/3264784528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90003520 con 0x7f8b90003f60 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.742+0000 7f8baeb37640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8b90004d40 0x7f8b900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.743+0000 7f8badb35640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8b90004800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009ac0 tx=0x7f8b90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c9650462eb1b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.743+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c039070 con 0x7f8b90003f60 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.743+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c02c6b0 con 0x7f8b90003f60 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.743+0000 7f8bad334640 1 -- 172.21.15.19:0/3264784528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c009690 con 0x7f8b90003f60 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 -- 172.21.15.19:0/3264784528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 msgr2=0x7f8b90004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3264784528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8b90004800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009ac0 tx=0x7f8b90005830 comp rx=0 tx=0).stop 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8baeb37640 1 -- 172.21.15.19:0/3264784528 reap_dead start 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 -- 172.21.15.19:0/3264784528 shutdown_connections 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 -- 172.21.15.19:0/3264784528 >> 172.21.15.19:0/3264784528 conn(0x7f8ba80d3d40 msgr2=0x7f8ba80d4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 -- 172.21.15.19:0/3264784528 shutdown_connections 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.744+0000 7f8bb059a640 1 -- 172.21.15.19:0/3264784528 wait complete. 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.745+0000 7f8bb059a640 1 Processor -- start 2024-03-04T08:53:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.745+0000 7f8bb059a640 1 -- start start 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 0x7f8ba80b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80b7d40 0x7f8ba80b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80b0910 con 0x7f8b90003f60 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80cfc60 con 0x7f8ba80b6930 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bb059a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80d2020 con 0x7f8ba80b7d40 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52956/0 (socket says 172.21.15.19:52956) 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 -- 172.21.15.19:0/3957210309 learned_addr learned my addr 172.21.15.19:0/3957210309 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8badb35640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 0x7f8ba80b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8baeb37640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80b7d40 0x7f8ba80b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 -- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80b7d40 msgr2=0x7f8ba80b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80b7d40 0x7f8ba80b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 -- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 msgr2=0x7f8ba80b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 0x7f8ba80b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 -- 172.21.15.19:0/3957210309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80b74a0 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8badb35640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 0x7f8ba80b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.746+0000 7f8bae336640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8b980079d0 tx=0x7f8b9800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98017020 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b980133f0 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b980137e0 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba80b7780 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba81f4e00 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.747+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba808d480 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.748+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b9801a020 con 0x7f8b90003f60 2024-03-04T08:53:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.748+0000 7f8ba6ffd640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:00.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.748+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b9808ad10 con 0x7f8b90003f60 2024-03-04T08:53:00.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.749+0000 7f8badb35640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:00.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.749+0000 7f8badb35640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 0x7f8b9406d990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c036000 tx=0x7f8b9c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:00.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.753+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8ba808d480 con 0x7f8b90003f60 2024-03-04T08:53:00.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.933+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8ba81f4fd0 con 0x7f8b90003f60 2024-03-04T08:53:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.939+0000 7f8ba6ffd640 1 -- 172.21.15.19:0/3957210309 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b98021020 con 0x7f8b90003f60 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 msgr2=0x7f8b9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 0x7f8b9406d990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c036000 tx=0x7f8b9c030000 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 msgr2=0x7f8ba815c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8b980079d0 tx=0x7f8b9800a730 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 shutdown_connections 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f8ba80b7d40 0x7f8ba80b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f8ba80b6930 0x7f8ba80b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 --2- 172.21.15.19:0/3957210309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b90003f60 0x7f8ba815c260 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 >> 172.21.15.19:0/3957210309 conn(0x7f8ba80d3d40 msgr2=0x7f8ba80b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 shutdown_connections 2024-03-04T08:53:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:00.941+0000 7f8bb059a640 1 -- 172.21.15.19:0/3957210309 wait complete. 2024-03-04T08:53:00.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-03-04T08:53:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.054+0000 7f3351d3a640 1 Processor -- start 2024-03-04T08:53:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.054+0000 7f3351d3a640 1 -- start start 2024-03-04T08:53:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f3351d3a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f334c0b4130 0x7f334c0ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f3351d3a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 0x7f334c06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f3351d3a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334c06ed00 con 0x7f334c15bfc0 2024-03-04T08:53:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f3351d3a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334c0cfe80 con 0x7f334c0b4130 2024-03-04T08:53:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f3351d3a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334c0cf670 con 0x7f334c0cd190 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f334c0b4130 0x7f334c0ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f334c15bfc0 0x7f334c0cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44770/0 (socket says 172.21.15.19:44770) 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334b7fe640 1 -- 172.21.15.19:0/1196362144 learned_addr learned my addr 172.21.15.19:0/1196362144 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334affd640 1 -- 172.21.15.19:0/1196362144 >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 msgr2=0x7f334c06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334bfff640 1 --2- 172.21.15.19:0/1196362144 >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 0x7f334c06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334a7fc640 1 -- 172.21.15.19:0/1196362144 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587820440 0 0) 0x7f334c06ed00 con 0x7f334c15bfc0 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334affd640 1 --2- 172.21.15.19:0/1196362144 >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 0x7f334c06f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334affd640 1 -- 172.21.15.19:0/1196362144 >> v1:172.21.15.19:6789/0 conn(0x7f334c15bfc0 legacy=0x7f334c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334affd640 1 -- 172.21.15.19:0/1196362144 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0cf8c0 con 0x7f334c0b4130 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.055+0000 7f334bfff640 1 --2- 172.21.15.19:0/1196362144 >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 0x7f334c06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.056+0000 7f334affd640 1 --2- 172.21.15.19:0/1196362144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0b4130 0x7f334c0ccc50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f334c0c52c0 tx=0x7f334002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cd01ce0d304a0d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.056+0000 7f334a7fc640 1 -- 172.21.15.19:0/1196362144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340035020 con 0x7f334c0b4130 2024-03-04T08:53:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.056+0000 7f334a7fc640 1 -- 172.21.15.19:0/1196362144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340031830 con 0x7f334c0b4130 2024-03-04T08:53:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.056+0000 7f334a7fc640 1 -- 172.21.15.19:0/1196362144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340031c00 con 0x7f334c0b4130 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 -- 172.21.15.19:0/1196362144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0b4130 msgr2=0x7f334c0ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 --2- 172.21.15.19:0/1196362144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0b4130 0x7f334c0ccc50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f334c0c52c0 tx=0x7f334002b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 -- 172.21.15.19:0/1196362144 shutdown_connections 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 --2- 172.21.15.19:0/1196362144 >> v2:172.21.15.204:3300/0 conn(0x7f334c0cd190 0x7f334c06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 --2- 172.21.15.19:0/1196362144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0b4130 0x7f334c0ccc50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 -- 172.21.15.19:0/1196362144 >> 172.21.15.19:0/1196362144 conn(0x7f334c0b3610 msgr2=0x7f334c0b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 -- 172.21.15.19:0/1196362144 shutdown_connections 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.057+0000 7f3351d3a640 1 -- 172.21.15.19:0/1196362144 wait complete. 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.058+0000 7f3351d3a640 1 Processor -- start 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.058+0000 7f3351d3a640 1 -- start start 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 0x7f334c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f334c15bfc0 0x7f334c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c06fa00 con 0x7f334c0cd190 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c06efa0 con 0x7f334c0b4130 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f3351d3a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334c06fb80 con 0x7f334c15bfc0 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52978/0 (socket says 172.21.15.19:52978) 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 -- 172.21.15.19:0/979663902 learned_addr learned my addr 172.21.15.19:0/979663902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334b7fe640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 0x7f334c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 -- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f334c15bfc0 msgr2=0x7f334c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334bfff640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f334c15bfc0 0x7f334c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f334c15bfc0 0x7f334c0afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 -- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 msgr2=0x7f334c149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 0x7f334c149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 -- 172.21.15.19:0/979663902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0b5440 con 0x7f334c0cd190 2024-03-04T08:53:01.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334b7fe640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 0x7f334c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.059+0000 7f334affd640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3340009890 tx=0x7f33400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.060+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340041070 con 0x7f334c0cd190 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.060+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334003aa30 con 0x7f334c0cd190 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.060+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334c0b60d0 con 0x7f334c0cd190 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.060+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340035040 con 0x7f334c0cd190 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.060+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334c0b6690 con 0x7f334c0cd190 2024-03-04T08:53:01.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.061+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334c04f330 con 0x7f334c0cd190 2024-03-04T08:53:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.061+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3340038020 con 0x7f334c0cd190 2024-03-04T08:53:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.061+0000 7f3333fff640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 0x7f333806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.062+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f33400aba00 con 0x7f334c0cd190 2024-03-04T08:53:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.062+0000 7f334b7fe640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 0x7f333806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:01.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.062+0000 7f334b7fe640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 0x7f333806d990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f333c000f60 tx=0x7f333c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:01.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.066+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f334007ab80 con 0x7f334c0cd190 2024-03-04T08:53:01.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.315+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f334c0cde40 con 0x7f334c0cd190 2024-03-04T08:53:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.616+0000 7f3333fff640 1 -- 172.21.15.19:0/979663902 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v147) v1 ==== 134+0+0 (secure 0 0 0) 0x7f334007a480 con 0x7f334c0cd190 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 msgr2=0x7f333806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 0x7f333806d990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f333c000f60 tx=0x7f333c009040 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 msgr2=0x7f334c0b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3340009890 tx=0x7f33400046c0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 shutdown_connections 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f334c15bfc0 0x7f334c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334c0cd190 0x7f334c0b6e90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f333806b4d0 0x7f333806d990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 --2- 172.21.15.19:0/979663902 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f334c0b4130 0x7f334c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 >> 172.21.15.19:0/979663902 conn(0x7f334c0b3610 msgr2=0x7f334c0d1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 shutdown_connections 2024-03-04T08:53:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:01.618+0000 7f3351d3a640 1 -- 172.21.15.19:0/979663902 wait complete. 2024-03-04T08:53:01.627 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-03-04T08:53:01.627 INFO:tasks.cephfs_test_runner: 2024-03-04T08:53:01.627 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs/mount.py", line 776, in run_python 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: p.wait() 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner: 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-04T08:53:01.628 INFO:tasks.cephfs_test_runner:Ran 2 tests in 113.351s 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs/mount.py", line 776, in run_python 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: p.wait() 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-04T08:53:01.629 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-03-04T08:53:01.630 INFO:tasks.cephfs_test_runner: 2024-03-04T08:53:01.630 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:53:01.971 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ce70ed6ec2394a4cacd033b1b165859e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-04T08:53:01.972 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-04T08:53:01.981 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-04T08:53:02.021 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-04T08:53:02.022 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:53:02.022 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:53:02.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:53:02.043 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-04T08:53:02.043 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:53:02.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2325 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-04T08:53:02.100 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:53:02.100 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:53:02.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:53:02.120 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-03-04T08:53:02.120 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T08:53:02.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056353,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16580 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-04T08:53:02.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.178 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-04T08:53:02.195 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-04T08:53:02.196 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T08:53:02.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.196 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-04T08:53:02.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T08:53:02.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-04T08:53:02.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.442 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-03-04T08:53:02.461 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-04T08:53:02.461 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-04T08:53:02.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.461 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-04T08:53:02.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.534 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-04T08:53:02.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T08:53:02.604 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-03-04T08:53:02.708 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-04T08:53:02.720 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T08:53:02.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:53:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 Processor -- start 2024-03-04T08:53:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 -- start start 2024-03-04T08:53:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200d00c0 0x7f5c200d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c200cf850 0x7f5c200cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c200d09e0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2006ca90 con 0x7f5c200cf850 2024-03-04T08:53:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.835+0000 7f5c2593e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2006df30 con 0x7f5c200d00c0 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c17fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c200cf850 0x7f5c200cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c1f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5c200ce1b0 0x7f5c200ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44774/0 (socket says 172.21.15.19:44774) 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c1f7fe640 1 -- 172.21.15.19:0/4238412045 learned_addr learned my addr 172.21.15.19:0/4238412045 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c1effd640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200d00c0 0x7f5c200d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c17fff640 1 -- 172.21.15.19:0/4238412045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200d00c0 msgr2=0x7f5c200d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c17fff640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200d00c0 0x7f5c200d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c17fff640 1 -- 172.21.15.19:0/4238412045 >> v1:172.21.15.19:6789/0 conn(0x7f5c200ce1b0 legacy=0x7f5c200ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c17fff640 1 -- 172.21.15.19:0/4238412045 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2015e380 con 0x7f5c200cf850 2024-03-04T08:53:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.836+0000 7f5c1e7fc640 1 -- 172.21.15.19:0/4238412045 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051706266 0 0) 0x7f5c200d09e0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c17fff640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200cf850 0x7f5c200cd3c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097a0 tx=0x7f5c0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a110daac2ec7ec1f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c1e7fc640 1 -- 172.21.15.19:0/4238412045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08035020 con 0x7f5c200cf850 2024-03-04T08:53:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c1e7fc640 1 -- 172.21.15.19:0/4238412045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08031830 con 0x7f5c200cf850 2024-03-04T08:53:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c1e7fc640 1 -- 172.21.15.19:0/4238412045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031c00 con 0x7f5c200cf850 2024-03-04T08:53:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c2593e640 1 -- 172.21.15.19:0/4238412045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200cf850 msgr2=0x7f5c200cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.837+0000 7f5c2593e640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200cf850 0x7f5c200cd3c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097a0 tx=0x7f5c0802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 -- 172.21.15.19:0/4238412045 shutdown_connections 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200cf850 0x7f5c200cd3c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 --2- 172.21.15.19:0/4238412045 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200d00c0 0x7f5c200d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 -- 172.21.15.19:0/4238412045 >> 172.21.15.19:0/4238412045 conn(0x7f5c200b35a0 msgr2=0x7f5c200b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 -- 172.21.15.19:0/4238412045 shutdown_connections 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.838+0000 7f5c2593e640 1 -- 172.21.15.19:0/4238412045 wait complete. 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.839+0000 7f5c2593e640 1 Processor -- start 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.839+0000 7f5c2593e640 1 -- start start 2024-03-04T08:53:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200cf850 0x7f5c200c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c200d00c0 0x7f5c200cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2006c440 con 0x7f5c200ce1b0 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2006c160 con 0x7f5c200d00c0 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2006c720 con 0x7f5c200cf850 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52994/0 (socket says 172.21.15.19:52994) 2024-03-04T08:53:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 -- 172.21.15.19:0/3367893054 learned_addr learned my addr 172.21.15.19:0/3367893054 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c17fff640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200cf850 0x7f5c200c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1f7fe640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c200d00c0 0x7f5c200cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 -- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200cf850 msgr2=0x7f5c200c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200cf850 0x7f5c200c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 -- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c200d00c0 msgr2=0x7f5c200cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c200d00c0 0x7f5c200cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 -- 172.21.15.19:0/3367893054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200c84b0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1effd640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000d5f0 tx=0x7f5c1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100125f0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c10019070 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c200c6ed0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100129d0 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.840+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c200c7770 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.841+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2004f330 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.842+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c10012b70 con 0x7f5c200ce1b0 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.842+0000 7f5c1cff9640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 0x7f5c0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.842+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c1008a180 con 0x7f5c200ce1b0 2024-03-04T08:53:02.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.842+0000 7f5c17fff640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 0x7f5c0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:02.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.843+0000 7f5c17fff640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 0x7f5c0006d9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5c08036000 tx=0x7f5c0803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:02.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:02.846+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5c10058cb0 con 0x7f5c200ce1b0 2024-03-04T08:53:03.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.027+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c200b44e0 con 0x7f5c0006b500 2024-03-04T08:53:03.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.028+0000 7f5c1cff9640 1 -- 172.21.15.19:0/3367893054 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13403 (secure 0 0 0) 0x7f5c0804e470 con 0x7f5c0006b500 2024-03-04T08:53:03.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:03.024 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:53:03.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 msgr2=0x7f5c0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 0x7f5c0006d9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5c08036000 tx=0x7f5c0803d040 comp rx=0 tx=0).stop 2024-03-04T08:53:03.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 msgr2=0x7f5c20156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000d5f0 tx=0x7f5c1000dab0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 shutdown_connections 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f5c0006b500 0x7f5c0006d9c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5c200d00c0 0x7f5c200cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f5c200cf850 0x7f5c200c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 --2- 172.21.15.19:0/3367893054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c200ce1b0 0x7f5c20156fd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 >> 172.21.15.19:0/3367893054 conn(0x7f5c200b35a0 msgr2=0x7f5c2006fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 shutdown_connections 2024-03-04T08:53:03.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.030+0000 7f5c2593e640 1 -- 172.21.15.19:0/3367893054 wait complete. 2024-03-04T08:53:03.037 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-03-04T08:53:01.171619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230224,"kb_used_data":5760,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744496,"statfs":{"total":773094113280,"available":772858363904,"internally_reserved":0,"allocated":5898240,"data_stored":3141226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001654"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":222,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-04T08:52:32.856367+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:52:32.856367+0000","last_peered":"2024-03-04T08:52:32.856367+0000","last_clean":"2024-03-04T08:52:32.856367+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:52:32.856367+0000","last_undegraded":"2024-03-04T08:52:32.856367+0000","last_fullsized":"2024-03-04T08:52:32.856367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1175552,"data_stored":829299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":239459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":238807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":602112,"data_stored":252964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":598016,"data_stored":255105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1175552,"data_stored":829231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":245470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":602112,"data_stored":250891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:53:03.037 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:53:03.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.143+0000 7ff2d18b5640 1 Processor -- start 2024-03-04T08:53:03.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.143+0000 7ff2d18b5640 1 -- start start 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2d18b5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2d18b5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7ff2cc06cf20 0x7ff2cc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2d18b5640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc15e380 con 0x7ff2cc0d00c0 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2d18b5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc06ca90 con 0x7ff2cc0cf850 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2d18b5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc0cdc10 con 0x7ff2cc06cf20 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2caffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff2cc0d00c0 0x7ff2cc0d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44786/0 (socket says 172.21.15.19:44786) 2024-03-04T08:53:03.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2caffd640 1 -- 172.21.15.19:0/4289212916 learned_addr learned my addr 172.21.15.19:0/4289212916 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/4289212916 >> v2:172.21.15.19:3300/0 conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52998/0 (socket says 172.21.15.19:52998) 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2cb7fe640 1 --2- 172.21.15.19:0/4289212916 >> v2:172.21.15.204:3300/0 conn(0x7ff2cc06cf20 0x7ff2cc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 -- 172.21.15.19:0/4289212916 >> v2:172.21.15.204:3300/0 conn(0x7ff2cc06cf20 msgr2=0x7ff2cc06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/4289212916 >> v2:172.21.15.204:3300/0 conn(0x7ff2cc06cf20 0x7ff2cc06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 -- 172.21.15.19:0/4289212916 >> v1:172.21.15.19:6789/0 conn(0x7ff2cc0d00c0 legacy=0x7ff2cc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2c27fc640 1 -- 172.21.15.19:0/4289212916 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc06c160 con 0x7ff2cc0cf850 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.144+0000 7ff2ca7fc640 1 -- 172.21.15.19:0/4289212916 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591498084 0 0) 0x7ff2cc15e380 con 0x7ff2cc0d00c0 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/4289212916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc071f50 tx=0x7ff2b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9dc069e9108ebb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2ca7fc640 1 -- 172.21.15.19:0/4289212916 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4035020 con 0x7ff2cc0cf850 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2ca7fc640 1 -- 172.21.15.19:0/4289212916 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4031830 con 0x7ff2cc0cf850 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2ca7fc640 1 -- 172.21.15.19:0/4289212916 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031c00 con 0x7ff2cc0cf850 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2d18b5640 1 -- 172.21.15.19:0/4289212916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc0cf850 msgr2=0x7ff2cc0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.145+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/4289212916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc071f50 tx=0x7ff2b402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 -- 172.21.15.19:0/4289212916 shutdown_connections 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/4289212916 >> v2:172.21.15.204:3300/0 conn(0x7ff2cc06cf20 0x7ff2cc06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/4289212916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc0cf850 0x7ff2cc0cd3c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 -- 172.21.15.19:0/4289212916 >> 172.21.15.19:0/4289212916 conn(0x7ff2cc0b35a0 msgr2=0x7ff2cc0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 -- 172.21.15.19:0/4289212916 shutdown_connections 2024-03-04T08:53:03.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.146+0000 7ff2d18b5640 1 -- 172.21.15.19:0/4289212916 wait complete. 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.147+0000 7ff2d18b5640 1 Processor -- start 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.147+0000 7ff2d18b5640 1 -- start start 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2cc0cf850 0x7ff2cc0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2cc0d00c0 0x7ff2cc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0cd900 con 0x7ff2cc06cf20 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc06c720 con 0x7ff2cc0d00c0 2024-03-04T08:53:03.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b1030 con 0x7ff2cc0cf850 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53000/0 (socket says 172.21.15.19:53000) 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 -- 172.21.15.19:0/2341749376 learned_addr learned my addr 172.21.15.19:0/2341749376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2cb7fe640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2cc0d00c0 0x7ff2cc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2cc0cf850 0x7ff2cc0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 -- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2cc0cf850 msgr2=0x7ff2cc0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2cc0cf850 0x7ff2cc0b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 -- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2cc0d00c0 msgr2=0x7ff2cc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2cc0d00c0 0x7ff2cc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 -- 172.21.15.19:0/2341749376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0b4e40 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2caffd640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c430 tx=0x7ff2bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0074e0 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0047e0 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc004bd0 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc0b5120 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.148+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc0b56e0 con 0x7ff2cc06cf20 2024-03-04T08:53:03.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.149+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc04f330 con 0x7ff2cc06cf20 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.150+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2bc011070 con 0x7ff2cc06cf20 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.150+0000 7ff2c8ff9640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 0x7ff2ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.150+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2bc089a30 con 0x7ff2cc06cf20 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.150+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 0x7ff2ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.151+0000 7ff2c27fc640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 0x7ff2ac06d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4036000 tx=0x7ff2b403e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.154+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff2bc058560 con 0x7ff2cc06cf20 2024-03-04T08:53:03.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.334+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2cc0b3d00 con 0x7ff2ac06b4d0 2024-03-04T08:53:03.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.335+0000 7ff2c8ff9640 1 -- 172.21.15.19:0/2341749376 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13477 (secure 0 0 0) 0x7ff2b404f4c0 con 0x7ff2ac06b4d0 2024-03-04T08:53:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:03.332 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:53:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 msgr2=0x7ff2ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 0x7ff2ac06d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4036000 tx=0x7ff2b403e040 comp rx=0 tx=0).stop 2024-03-04T08:53:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 msgr2=0x7ff2cc154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c430 tx=0x7ff2bc00c8f0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 shutdown_connections 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7ff2ac06b4d0 0x7ff2ac06d990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7ff2cc0d00c0 0x7ff2cc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7ff2cc0cf850 0x7ff2cc0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 --2- 172.21.15.19:0/2341749376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2cc06cf20 0x7ff2cc154100 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 >> 172.21.15.19:0/2341749376 conn(0x7ff2cc0b35a0 msgr2=0x7ff2cc06d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 shutdown_connections 2024-03-04T08:53:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.337+0000 7ff2d18b5640 1 -- 172.21.15.19:0/2341749376 wait complete. 2024-03-04T08:53:03.344 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-03-04T08:53:03.172097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":230416,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744304,"statfs":{"total":773094113280,"available":772858167296,"internally_reserved":0,"allocated":6074368,"data_stored":3210268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17096,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001575"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-04T08:53:01.784896+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:53:01.784896+0000","last_peered":"2024-03-04T08:53:01.784896+0000","last_clean":"2024-03-04T08:53:01.784896+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:53:01.784896+0000","last_undegraded":"2024-03-04T08:53:01.784896+0000","last_fullsized":"2024-03-04T08:53:01.784896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1196032,"data_stored":841259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":245470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":602112,"data_stored":250891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:53:03.345 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T08:53:03.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:53:03.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.450+0000 7f5030555640 1 Processor -- start 2024-03-04T08:53:03.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.450+0000 7f5030555640 1 -- start start 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.451+0000 7f5030555640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f502815dfe0 0x7f50280cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.451+0000 7f5030555640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50280d29c0 0x7f50280b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.451+0000 7f5030555640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280b3430 con 0x7f50280cf830 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.451+0000 7f5030555640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b31e0 con 0x7f50280d29c0 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.451+0000 7f5030555640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280b3d60 con 0x7f502815dfe0 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50280d29c0 0x7f50280b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502e2f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f502815dfe0 0x7f50280cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502daf0640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f50280cf830 0x7f50280d22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51768/0 (socket says 172.21.15.19:51768) 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502daf0640 1 -- 172.21.15.19:0/342532 learned_addr learned my addr 172.21.15.19:0/342532 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f50280d29c0 0x7f50280b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:48248/0 (socket says 172.21.15.19:48248) 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 -- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f502815dfe0 msgr2=0x7f50280cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 --2- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f502815dfe0 0x7f50280cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 -- 172.21.15.19:0/342532 >> v1:172.21.15.204:6789/0 conn(0x7f50280cf830 legacy=0x7f50280d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.452+0000 7f502eaf2640 1 -- 172.21.15.19:0/342532 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280b3710 con 0x7f50280d29c0 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f502eaf2640 1 --2- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b41f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f502002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11fc894f6d8038a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f502d2ef640 1 -- 172.21.15.19:0/342532 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020039070 con 0x7f50280d29c0 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f502d2ef640 1 -- 172.21.15.19:0/342532 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502002cc50 con 0x7f50280d29c0 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f502d2ef640 1 -- 172.21.15.19:0/342532 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020034440 con 0x7f50280d29c0 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f5030555640 1 -- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 msgr2=0x7f50280b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.453+0000 7f5030555640 1 --2- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b41f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f502002bea0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 -- 172.21.15.19:0/342532 shutdown_connections 2024-03-04T08:53:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 --2- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b41f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 --2- 172.21.15.19:0/342532 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f502815dfe0 0x7f50280cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 -- 172.21.15.19:0/342532 >> 172.21.15.19:0/342532 conn(0x7f50280d3cd0 msgr2=0x7f50280d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 -- 172.21.15.19:0/342532 shutdown_connections 2024-03-04T08:53:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.454+0000 7f5030555640 1 -- 172.21.15.19:0/342532 wait complete. 2024-03-04T08:53:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 Processor -- start 2024-03-04T08:53:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 -- start start 2024-03-04T08:53:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 0x7f502814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280d1df0 con 0x7f502815dfe0 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280d1c70 con 0x7f50280d29c0 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.455+0000 7f5030555640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502815e3c0 con 0x7f50280cf830 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502daf0640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502e2f1640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 0x7f502814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53006/0 (socket says 172.21.15.19:53006) 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 -- 172.21.15.19:0/3105624050 learned_addr learned my addr 172.21.15.19:0/3105624050 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 -- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 msgr2=0x7f502814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 0x7f502814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 -- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 msgr2=0x7f50280b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 -- 172.21.15.19:0/3105624050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502814d3a0 con 0x7f502815dfe0 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502daf0640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502e2f1640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 0x7f502814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f502eaf2640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f5020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020039050 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020045070 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502003e610 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280b7460 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.456+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280b7a20 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.457+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502804f330 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.458+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f502003e7b0 con 0x7f502815dfe0 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.458+0000 7f501effd640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 0x7f500c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.458+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50200ac920 con 0x7f502815dfe0 2024-03-04T08:53:03.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.458+0000 7f502e2f1640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 0x7f500c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.459+0000 7f502e2f1640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 0x7f500c06d9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5024009e90 tx=0x7f5024009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.463+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f502007b450 con 0x7f502815dfe0 2024-03-04T08:53:03.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.640+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50280ce7a0 con 0x7f500c06b500 2024-03-04T08:53:03.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.641+0000 7f501effd640 1 -- 172.21.15.19:0/3105624050 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13477 (secure 0 0 0) 0x7f50280ce7a0 con 0x7f500c06b500 2024-03-04T08:53:03.637 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:03.637 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:53:03.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 msgr2=0x7f500c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 0x7f500c06d9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5024009e90 tx=0x7f5024009190 comp rx=0 tx=0).stop 2024-03-04T08:53:03.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 msgr2=0x7f50280ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f5020004a40 comp rx=0 tx=0).stop 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 shutdown_connections 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f502815dfe0 0x7f50280ccd80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f500c06b500 0x7f500c06d9c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f50280d29c0 0x7f50280b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 --2- 172.21.15.19:0/3105624050 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f50280cf830 0x7f502814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.642+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 >> 172.21.15.19:0/3105624050 conn(0x7f50280d3cd0 msgr2=0x7f502806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.643+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 shutdown_connections 2024-03-04T08:53:03.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.643+0000 7f5030555640 1 -- 172.21.15.19:0/3105624050 wait complete. 2024-03-04T08:53:03.649 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-03-04T08:53:03.172097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":230416,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744304,"statfs":{"total":773094113280,"available":772858167296,"internally_reserved":0,"allocated":6074368,"data_stored":3210268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17096,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001575"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-04T08:53:01.784896+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:53:01.784896+0000","last_peered":"2024-03-04T08:53:01.784896+0000","last_clean":"2024-03-04T08:53:01.784896+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:53:01.784896+0000","last_undegraded":"2024-03-04T08:53:01.784896+0000","last_fullsized":"2024-03-04T08:53:01.784896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1196032,"data_stored":841259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":245470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":602112,"data_stored":250891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:53:03.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T08:53:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.755+0000 7f84f7c8d640 1 Processor -- start 2024-03-04T08:53:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.755+0000 7f84f7c8d640 1 -- start start 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f7c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 0x7f84f00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f7c8d640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84f006cf20 0x7f84f006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f7c8d640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f015e380 con 0x7f84f00d00c0 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f7c8d640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f006ca90 con 0x7f84f006cf20 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f7c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00cdc10 con 0x7f84f00cf850 2024-03-04T08:53:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f622a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84f006cf20 0x7f84f006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f5228640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 0x7f84f00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f622a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f84f006cf20 0x7f84f006d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:48262/0 (socket says 172.21.15.19:48262) 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f622a640 1 -- 172.21.15.19:0/1311935250 learned_addr learned my addr 172.21.15.19:0/1311935250 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f5a29640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f84f00d00c0 0x7f84f00d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51778/0 (socket says 172.21.15.19:51778) 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f622a640 1 -- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 msgr2=0x7f84f00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.756+0000 7f84f622a640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 0x7f84f00cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f622a640 1 -- 172.21.15.19:0/1311935250 >> v1:172.21.15.204:6789/0 conn(0x7f84f00d00c0 legacy=0x7f84f00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f622a640 1 -- 172.21.15.19:0/1311935250 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f006c160 con 0x7f84f006cf20 2024-03-04T08:53:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f4a27640 1 -- 172.21.15.19:0/1311935250 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062034838 0 0) 0x7f84f015e380 con 0x7f84f00d00c0 2024-03-04T08:53:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f5228640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 0x7f84f00cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:53:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f622a640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f006cf20 0x7f84f006d3b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009e50 tx=0x7f84e802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700a0cce87771a5c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.757+0000 7f84f4a27640 1 -- 172.21.15.19:0/1311935250 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802cb00 con 0x7f84f006cf20 2024-03-04T08:53:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f4a27640 1 -- 172.21.15.19:0/1311935250 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e802cca0 con 0x7f84f006cf20 2024-03-04T08:53:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f4a27640 1 -- 172.21.15.19:0/1311935250 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8034610 con 0x7f84f006cf20 2024-03-04T08:53:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 -- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f006cf20 msgr2=0x7f84f006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f006cf20 0x7f84f006d3b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009e50 tx=0x7f84e802bf60 comp rx=0 tx=0).stop 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 -- 172.21.15.19:0/1311935250 shutdown_connections 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f006cf20 0x7f84f006d3b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/1311935250 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f00cf850 0x7f84f00cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 -- 172.21.15.19:0/1311935250 >> 172.21.15.19:0/1311935250 conn(0x7f84f00b35a0 msgr2=0x7f84f00b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 -- 172.21.15.19:0/1311935250 shutdown_connections 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.758+0000 7f84f7c8d640 1 -- 172.21.15.19:0/1311935250 wait complete. 2024-03-04T08:53:03.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.759+0000 7f84f7c8d640 1 Processor -- start 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.759+0000 7f84f7c8d640 1 -- start start 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f006cf20 0x7f84f01542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f00cf850 0x7f84f01577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00cd900 con 0x7f84f00d00c0 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f006c720 con 0x7f84f00cf850 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f7c8d640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00b1030 con 0x7f84f006cf20 2024-03-04T08:53:03.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53008/0 (socket says 172.21.15.19:53008) 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 -- 172.21.15.19:0/3740142426 learned_addr learned my addr 172.21.15.19:0/3740142426 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f5228640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f00cf850 0x7f84f01577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f5a29640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f006cf20 0x7f84f01542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 -- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f006cf20 msgr2=0x7f84f01542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f006cf20 0x7f84f01542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 -- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f00cf850 msgr2=0x7f84f01577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f00cf850 0x7f84f01577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.760+0000 7f84f622a640 1 -- 172.21.15.19:0/3740142426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0157cf0 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84f622a640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f84e8036040 tx=0x7f84e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8043020 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e802ce50 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f00b4a10 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8009510 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.761+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f00b4fd0 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.762+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f00cc1f0 con 0x7f84f00d00c0 2024-03-04T08:53:03.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.762+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84e8046020 con 0x7f84f00d00c0 2024-03-04T08:53:03.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.763+0000 7f84e67fc640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 0x7f84d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:03.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.763+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84e80ac740 con 0x7f84f00d00c0 2024-03-04T08:53:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.763+0000 7f84f5a29640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 0x7f84d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.763+0000 7f84f5a29640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 0x7f84d406d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f84ec000f60 tx=0x7f84ec007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.767+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f84f00cc1f0 con 0x7f84f00d00c0 2024-03-04T08:53:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.951+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84f004f330 con 0x7f84f00d00c0 2024-03-04T08:53:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.952+0000 7f84e67fc640 1 -- 172.21.15.19:0/3740142426 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13006 (secure 0 0 0) 0x7f84e8081090 con 0x7f84f00d00c0 2024-03-04T08:53:03.948 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:03.948 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":52,"fsid":"385c227e-6109-4019-8b7b-25dec95ce12d","created":"2024-03-04T08:50:20.843724+0000","modified":"2024-03-04T08:53:00.607365+0000","last_up_change":"2024-03-04T08:50:31.191638+0000","last_in_change":"2024-03-04T08:50:23.026557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T08:50:29.208714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8e90047-e5b7-4a7f-b7d2-ed007ee685ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6825","nonce":3268910335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6827","nonce":3268910335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6831","nonce":3268910335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3268910335},{"type":"v1","addr":"172.21.15.19:6829","nonce":3268910335}]},"public_addr":"172.21.15.19:6825/3268910335","cluster_addr":"172.21.15.19:6827/3268910335","heartbeat_back_addr":"172.21.15.19:6831/3268910335","heartbeat_front_addr":"172.21.15.19:6829/3268910335","state":["exists","up"]},{"osd":1,"uuid":"f2f71ed6-dc7f-45e9-845e-bf6537dc8fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6801","nonce":909506056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6803","nonce":909506056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6807","nonce":909506056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":909506056},{"type":"v1","addr":"172.21.15.19:6805","nonce":909506056}]},"public_addr":"172.21.15.19:6801/909506056","cluster_addr":"172.21.15.19:6803/909506056","heartbeat_back_addr":"172.21.15.19:6807/909506056","heartbeat_front_addr":"172.21.15.19:6805/909506056","state":["exists","up"]},{"osd":2,"uuid":"1589294e-bb68-4e20-9909-62aae9312f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6809","nonce":2828546557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6811","nonce":2828546557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6818","nonce":2828546557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":2828546557},{"type":"v1","addr":"172.21.15.19:6814","nonce":2828546557}]},"public_addr":"172.21.15.19:6809/2828546557","cluster_addr":"172.21.15.19:6811/2828546557","heartbeat_back_addr":"172.21.15.19:6818/2828546557","heartbeat_front_addr":"172.21.15.19:6814/2828546557","state":["exists","up"]},{"osd":3,"uuid":"20a952bf-0f60-459d-b04d-1a509093e413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6815","nonce":154157976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6819","nonce":154157976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6823","nonce":154157976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":154157976},{"type":"v1","addr":"172.21.15.19:6821","nonce":154157976}]},"public_addr":"172.21.15.19:6815/154157976","cluster_addr":"172.21.15.19:6819/154157976","heartbeat_back_addr":"172.21.15.19:6823/154157976","heartbeat_front_addr":"172.21.15.19:6821/154157976","state":["exists","up"]},{"osd":4,"uuid":"975b0a21-9fbb-4788-8495-f1200e3ffdb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6809","nonce":3951183250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6811","nonce":3951183250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6815","nonce":3951183250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3951183250},{"type":"v1","addr":"172.21.15.204:6813","nonce":3951183250}]},"public_addr":"172.21.15.204:6809/3951183250","cluster_addr":"172.21.15.204:6811/3951183250","heartbeat_back_addr":"172.21.15.204:6815/3951183250","heartbeat_front_addr":"172.21.15.204:6813/3951183250","state":["exists","up"]},{"osd":5,"uuid":"bf747fb4-fb6f-4027-ba5c-a1614134d157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6801","nonce":1186499881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6803","nonce":1186499881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6807","nonce":1186499881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1186499881},{"type":"v1","addr":"172.21.15.204:6805","nonce":1186499881}]},"public_addr":"172.21.15.204:6801/1186499881","cluster_addr":"172.21.15.204:6803/1186499881","heartbeat_back_addr":"172.21.15.204:6807/1186499881","heartbeat_front_addr":"172.21.15.204:6805/1186499881","state":["exists","up"]},{"osd":6,"uuid":"53a0da71-cca3-48e8-a70b-30887b44f6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6825","nonce":2219646256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6827","nonce":2219646256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6831","nonce":2219646256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2219646256},{"type":"v1","addr":"172.21.15.204:6829","nonce":2219646256}]},"public_addr":"172.21.15.204:6825/2219646256","cluster_addr":"172.21.15.204:6827/2219646256","heartbeat_back_addr":"172.21.15.204:6831/2219646256","heartbeat_front_addr":"172.21.15.204:6829/2219646256","state":["exists","up"]},{"osd":7,"uuid":"a601bf0a-74ff-40f8-b2dd-4da01dbd53cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6817","nonce":2477088309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6819","nonce":2477088309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6823","nonce":2477088309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":2477088309},{"type":"v1","addr":"172.21.15.204:6821","nonce":2477088309}]},"public_addr":"172.21.15.204:6817/2477088309","cluster_addr":"172.21.15.204:6819/2477088309","heartbeat_back_addr":"172.21.15.204:6823/2477088309","heartbeat_front_addr":"172.21.15.204:6821/2477088309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.184015+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.059048+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.209164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.143128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.076409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.162448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.248995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T08:50:28.203753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6833/245913424":"2024-03-05T08:52:57.599512+0000","172.21.15.19:6832/245913424":"2024-03-05T08:52:57.599512+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T08:53:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 msgr2=0x7f84d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 0x7f84d406d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f84ec000f60 tx=0x7f84ec007c00 comp rx=0 tx=0).stop 2024-03-04T08:53:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 msgr2=0x7f84f00c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f84e8036040 tx=0x7f84e8004a40 comp rx=0 tx=0).stop 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 shutdown_connections 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84f00d00c0 0x7f84f00c7150 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f84d406b4d0 0x7f84d406d990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f84f00cf850 0x7f84f01577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 --2- 172.21.15.19:0/3740142426 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f84f006cf20 0x7f84f01542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 >> 172.21.15.19:0/3740142426 conn(0x7f84f00b35a0 msgr2=0x7f84f00d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 shutdown_connections 2024-03-04T08:53:03.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:03.954+0000 7f84f7c8d640 1 -- 172.21.15.19:0/3740142426 wait complete. 2024-03-04T08:53:04.962 INFO:tasks.ceph:Scrubbing osd.0 2024-03-04T08:53:04.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:05.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.083+0000 7f22815f7640 1 Processor -- start 2024-03-04T08:53:05.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.083+0000 7f22815f7640 1 -- start start 2024-03-04T08:53:05.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f22815f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c1602b0 0x7f227c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f22815f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227c0701e0 0x7f227c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f22815f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c06f420 con 0x7f227c15bdd0 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f22815f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c15da40 con 0x7f227c0701e0 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f22815f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c160740 con 0x7f227c1602b0 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f227b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227c0701e0 0x7f227c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f227b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227c0701e0 0x7f227c070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53016/0 (socket says 172.21.15.19:53016) 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f227b7fe640 1 -- 172.21.15.19:0/3292278469 learned_addr learned my addr 172.21.15.19:0/3292278469 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.084+0000 7f227a7fc640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c1602b0 0x7f227c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.085+0000 7f227b7fe640 1 -- 172.21.15.19:0/3292278469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c1602b0 msgr2=0x7f227c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.085+0000 7f227b7fe640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c1602b0 0x7f227c0d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.085+0000 7f227b7fe640 1 -- 172.21.15.19:0/3292278469 >> v1:172.21.15.19:6789/0 conn(0x7f227c15bdd0 legacy=0x7f227c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.085+0000 7f2279ffb640 1 -- 172.21.15.19:0/3292278469 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715128446 0 0) 0x7f227c06f420 con 0x7f227c15bdd0 2024-03-04T08:53:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.085+0000 7f227b7fe640 1 -- 172.21.15.19:0/3292278469 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c06f700 con 0x7f227c0701e0 2024-03-04T08:53:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f227b7fe640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c070630 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2274009870 tx=0x7f227402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ae1184a54999a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f2279ffb640 1 -- 172.21.15.19:0/3292278469 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274034070 con 0x7f227c0701e0 2024-03-04T08:53:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f2279ffb640 1 -- 172.21.15.19:0/3292278469 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274030840 con 0x7f227c0701e0 2024-03-04T08:53:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f2279ffb640 1 -- 172.21.15.19:0/3292278469 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274030c10 con 0x7f227c0701e0 2024-03-04T08:53:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 -- 172.21.15.19:0/3292278469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 msgr2=0x7f227c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c070630 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2274009870 tx=0x7f227402b980 comp rx=0 tx=0).stop 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 -- 172.21.15.19:0/3292278469 shutdown_connections 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c070630 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 --2- 172.21.15.19:0/3292278469 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c1602b0 0x7f227c0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 -- 172.21.15.19:0/3292278469 >> 172.21.15.19:0/3292278469 conn(0x7f227c09a9f0 msgr2=0x7f227c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 -- 172.21.15.19:0/3292278469 shutdown_connections 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.086+0000 7f22815f7640 1 -- 172.21.15.19:0/3292278469 wait complete. 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 Processor -- start 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 -- start start 2024-03-04T08:53:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c15bdd0 0x7f227c0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c1602b0 0x7f227c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c06fcc0 con 0x7f227c0701e0 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0d0670 con 0x7f227c1602b0 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f22815f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c070b70 con 0x7f227c15bdd0 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.088+0000 7f227affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53022/0 (socket says 172.21.15.19:53022) 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 -- 172.21.15.19:0/3554432319 learned_addr learned my addr 172.21.15.19:0/3554432319 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227a7fc640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c15bdd0 0x7f227c0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227b7fe640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c1602b0 0x7f227c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 -- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c15bdd0 msgr2=0x7f227c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f227c15bdd0 0x7f227c0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 -- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c1602b0 msgr2=0x7f227c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f227c1602b0 0x7f227c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0afc80 con 0x7f227c0701e0 2024-03-04T08:53:05.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f227affd640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c152db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c890 tx=0x7f226c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c017070 con 0x7f227c0701e0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c003dc0 con 0x7f227c0701e0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c0aff60 con 0x7f227c0701e0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0052b0 con 0x7f227c0701e0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.089+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c0b0520 con 0x7f227c0701e0 2024-03-04T08:53:05.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.090+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f227c04f330 con 0x7f227c0701e0 2024-03-04T08:53:05.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f226c01a070 con 0x7f227c0701e0 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f225c06b4d0 0x7f225c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f226c089670 con 0x7f227c0701e0 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f225c071390 0x7f225c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f225c073e60 con 0x7f225c071390 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f226c090050 con 0x7f227c0701e0 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.091+0000 7f227a7fc640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f225c06b4d0 0x7f225c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.092+0000 7f227b7fe640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f225c071390 0x7f225c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.092+0000 7f227b7fe640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f225c071390 0x7f225c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.092+0000 7f227a7fc640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f225c06b4d0 0x7f225c06d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f227c0c5130 tx=0x7f2264009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.093+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== osd.0 v2:172.21.15.19:6824/3268910335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f225c073e60 con 0x7f225c071390 2024-03-04T08:53:05.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 --> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f227c0cc130 con 0x7f225c071390 2024-03-04T08:53:05.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22737fe640 1 -- 172.21.15.19:0/3554432319 <== osd.0 v2:172.21.15.19:6824/3268910335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f227c0cc130 con 0x7f225c071390 2024-03-04T08:53:05.102 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:05.103 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:05.103 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f225c071390 msgr2=0x7f225c0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:6824/3268910335,v1:172.21.15.19:6825/3268910335] conn(0x7f225c071390 0x7f225c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f225c06b4d0 msgr2=0x7f225c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f225c06b4d0 0x7f225c06d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f227c0c5130 tx=0x7f2264009190 comp rx=0 tx=0).stop 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 msgr2=0x7f227c152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 --2- 172.21.15.19:0/3554432319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227c0701e0 0x7f227c152db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c890 tx=0x7f226c00cd50 comp rx=0 tx=0).stop 2024-03-04T08:53:05.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f227b7fe640 1 -- 172.21.15.19:0/3554432319 reap_dead start 2024-03-04T08:53:05.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 shutdown_connections 2024-03-04T08:53:05.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 >> 172.21.15.19:0/3554432319 conn(0x7f227c09a9f0 msgr2=0x7f227c09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.106+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 shutdown_connections 2024-03-04T08:53:05.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.107+0000 7f22815f7640 1 -- 172.21.15.19:0/3554432319 wait complete. 2024-03-04T08:53:05.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-04T08:53:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.221+0000 7f428f33a640 1 Processor -- start 2024-03-04T08:53:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.221+0000 7f428f33a640 1 -- start start 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428f33a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428f33a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 0x7f42880d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428f33a640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880b2d80 con 0x7f42880d1fe0 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428f33a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880d2470 con 0x7f428815bed0 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428f33a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880ae9c0 con 0x7f42880d04e0 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428d0d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428c8d5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 0x7f42880d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428d0d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.19:48274/0 (socket says 172.21.15.19:48274) 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428d8d7640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7f42880d1fe0 0x7f428815fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:51792/0 (socket says 172.21.15.19:51792) 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428d0d6640 1 -- 172.21.15.19:0/3307148358 learned_addr learned my addr 172.21.15.19:0/3307148358 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428c8d5640 1 -- 172.21.15.19:0/3307148358 >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 msgr2=0x7f42880b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428c8d5640 1 --2- 172.21.15.19:0/3307148358 >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428c8d5640 1 -- 172.21.15.19:0/3307148358 >> v1:172.21.15.204:6789/0 conn(0x7f42880d1fe0 legacy=0x7f428815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f427ffff640 1 -- 172.21.15.19:0/3307148358 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900606833 0 0) 0x7f42880b2d80 con 0x7f42880d1fe0 2024-03-04T08:53:05.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428c8d5640 1 -- 172.21.15.19:0/3307148358 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880aeca0 con 0x7f42880d04e0 2024-03-04T08:53:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.222+0000 7f428d0d6640 1 --2- 172.21.15.19:0/3307148358 >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.223+0000 7f428c8d5640 1 --2- 172.21.15.19:0/3307148358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 0x7f42880d1aa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73254ff360f200e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.223+0000 7f427ffff640 1 -- 172.21.15.19:0/3307148358 <== mon.2 v2:172.21.15.204:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780315a0 con 0x7f42880d04e0 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.223+0000 7f427ffff640 1 -- 172.21.15.19:0/3307148358 <== mon.2 v2:172.21.15.204:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278037070 con 0x7f42880d04e0 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.223+0000 7f427ffff640 1 -- 172.21.15.19:0/3307148358 <== mon.2 v2:172.21.15.204:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278031960 con 0x7f42880d04e0 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 -- 172.21.15.19:0/3307148358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 msgr2=0x7f42880d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 --2- 172.21.15.19:0/3307148358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 0x7f42880d1aa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802b840 comp rx=0 tx=0).stop 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 -- 172.21.15.19:0/3307148358 shutdown_connections 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 --2- 172.21.15.19:0/3307148358 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f42880d04e0 0x7f42880d1aa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 --2- 172.21.15.19:0/3307148358 >> v2:172.21.15.204:3300/0 conn(0x7f428815bed0 0x7f42880b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 -- 172.21.15.19:0/3307148358 >> 172.21.15.19:0/3307148358 conn(0x7f428809a9f0 msgr2=0x7f428809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 -- 172.21.15.19:0/3307148358 shutdown_connections 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.224+0000 7f428f33a640 1 -- 172.21.15.19:0/3307148358 wait complete. 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.225+0000 7f428f33a640 1 Processor -- start 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.225+0000 7f428f33a640 1 -- start start 2024-03-04T08:53:05.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 0x7f428815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428815bed0 0x7f428815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428815c2b0 con 0x7f42880d04e0 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880af260 con 0x7f42880d1fe0 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428f33a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428806c2d0 con 0x7f428815bed0 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53038/0 (socket says 172.21.15.19:53038) 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 -- 172.21.15.19:0/1129793786 learned_addr learned my addr 172.21.15.19:0/1129793786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d8d7640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428815bed0 0x7f428815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428c8d5640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 0x7f428815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 -- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428815bed0 msgr2=0x7f428815fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428815bed0 0x7f428815fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 -- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 msgr2=0x7f428815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 0x7f428815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428d0d6640 1 -- 172.21.15.19:0/1129793786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428806c5b0 con 0x7f42880d04e0 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.226+0000 7f428c8d5640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 0x7f428815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:05.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f428d0d6640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f428400e9b0 tx=0x7f428400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284017070 con 0x7f42880d04e0 2024-03-04T08:53:05.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400c9a0 con 0x7f42880d04e0 2024-03-04T08:53:05.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400cd50 con 0x7f42880d04e0 2024-03-04T08:53:05.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428806c890 con 0x7f42880d04e0 2024-03-04T08:53:05.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.227+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42880cc330 con 0x7f42880d04e0 2024-03-04T08:53:05.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.228+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428806c040 con 0x7f42880d04e0 2024-03-04T08:53:05.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.228+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f428401a070 con 0x7f42880d04e0 2024-03-04T08:53:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.229+0000 7f427dffb640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 0x7f426c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.229+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f428408a100 con 0x7f42880d04e0 2024-03-04T08:53:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.229+0000 7f428c8d5640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 0x7f426c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.229+0000 7f428c8d5640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 0x7f426c06d9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4278036000 tx=0x7f4278008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.233+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4284058ba0 con 0x7f42880d04e0 2024-03-04T08:53:05.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.416+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f428804f330 con 0x7f426c06b500 2024-03-04T08:53:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.417+0000 7f427dffb640 1 -- 172.21.15.19:0/1129793786 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f428804f330 con 0x7f426c06b500 2024-03-04T08:53:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-03-04T08:53:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 msgr2=0x7f426c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 0x7f426c06d9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4278036000 tx=0x7f4278008030 comp rx=0 tx=0).stop 2024-03-04T08:53:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 msgr2=0x7f428814f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f428400e9b0 tx=0x7f428400ee70 comp rx=0 tx=0).stop 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 shutdown_connections 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f428815bed0 0x7f428815fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f426c06b500 0x7f426c06d9c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f42880d1fe0 0x7f428815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 --2- 172.21.15.19:0/1129793786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42880d04e0 0x7f428814f8e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 >> 172.21.15.19:0/1129793786 conn(0x7f428809a9f0 msgr2=0x7f428806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 shutdown_connections 2024-03-04T08:53:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.419+0000 7f428f33a640 1 -- 172.21.15.19:0/1129793786 wait complete. 2024-03-04T08:53:05.425 INFO:tasks.ceph:Scrubbing osd.1 2024-03-04T08:53:05.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:05.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.535+0000 7fcadaec9640 1 Processor -- start 2024-03-04T08:53:05.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.535+0000 7fcadaec9640 1 -- start start 2024-03-04T08:53:05.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcadaec9640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fcad4161440 0x7fcad40b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcadaec9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcad40d0d20 0x7fcad40b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcadaec9640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40cf520 con 0x7fcad4161820 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcadaec9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40cf2d0 con 0x7fcad40d0d20 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcadaec9640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40b6b00 con 0x7fcad4161440 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcad9466640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcad40d0d20 0x7fcad40b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcad9466640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcad40d0d20 0x7fcad40b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53046/0 (socket says 172.21.15.19:53046) 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcad9466640 1 -- 172.21.15.19:0/651481736 learned_addr learned my addr 172.21.15.19:0/651481736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.536+0000 7fcad8c65640 1 --2- 172.21.15.19:0/651481736 >> v2:172.21.15.204:3300/0 conn(0x7fcad4161440 0x7fcad40b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.537+0000 7fcad9466640 1 -- 172.21.15.19:0/651481736 >> v2:172.21.15.204:3300/0 conn(0x7fcad4161440 msgr2=0x7fcad40b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.537+0000 7fcad9466640 1 --2- 172.21.15.19:0/651481736 >> v2:172.21.15.204:3300/0 conn(0x7fcad4161440 0x7fcad40b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.537+0000 7fcad9466640 1 -- 172.21.15.19:0/651481736 >> v1:172.21.15.204:6789/0 conn(0x7fcad4161820 legacy=0x7fcad40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.537+0000 7fcad9466640 1 -- 172.21.15.19:0/651481736 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40cf800 con 0x7fcad40d0d20 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.537+0000 7fcad9466640 1 --2- 172.21.15.19:0/651481736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad40b6f90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcad406e070 tx=0x7fcac402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58a7599f43727a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcad37fe640 1 -- 172.21.15.19:0/651481736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4035020 con 0x7fcad40d0d20 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcad37fe640 1 -- 172.21.15.19:0/651481736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4031870 con 0x7fcad40d0d20 2024-03-04T08:53:05.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcad37fe640 1 -- 172.21.15.19:0/651481736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031c40 con 0x7fcad40d0d20 2024-03-04T08:53:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 -- 172.21.15.19:0/651481736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 msgr2=0x7fcad40b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 --2- 172.21.15.19:0/651481736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad40b6f90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcad406e070 tx=0x7fcac402b910 comp rx=0 tx=0).stop 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 -- 172.21.15.19:0/651481736 shutdown_connections 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 --2- 172.21.15.19:0/651481736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad40b6f90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 --2- 172.21.15.19:0/651481736 >> v2:172.21.15.204:3300/0 conn(0x7fcad4161440 0x7fcad40b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 -- 172.21.15.19:0/651481736 >> 172.21.15.19:0/651481736 conn(0x7fcad40d3cb0 msgr2=0x7fcad40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 -- 172.21.15.19:0/651481736 shutdown_connections 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.538+0000 7fcadaec9640 1 -- 172.21.15.19:0/651481736 wait complete. 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.539+0000 7fcadaec9640 1 Processor -- start 2024-03-04T08:53:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.539+0000 7fcadaec9640 1 -- start start 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad4157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad4161440 0x7fcad40cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad4161820 0x7fcad414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40d1300 con 0x7fcad40d0d20 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b5120 con 0x7fcad4161440 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcadaec9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40d1480 con 0x7fcad4161820 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad4157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad4157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53058/0 (socket says 172.21.15.19:53058) 2024-03-04T08:53:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 -- 172.21.15.19:0/598834960 learned_addr learned my addr 172.21.15.19:0/598834960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad3fff640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad4161440 0x7fcad40cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad9466640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad4161820 0x7fcad414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 -- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad4161820 msgr2=0x7fcad414cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fcad4161820 0x7fcad414cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 -- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad4161440 msgr2=0x7fcad40cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.540+0000 7fcad8c65640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcad4161440 0x7fcad40cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcad8c65640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4157c50 con 0x7fcad40d0d20 2024-03-04T08:53:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcad8c65640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad4157090 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00efc0 tx=0x7fcacc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc018020 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc014480 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad40cc880 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc014850 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.541+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad40cce40 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.542+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcad4157a00 con 0x7fcad40d0d20 2024-03-04T08:53:05.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.542+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcacc005d10 con 0x7fcad40d0d20 2024-03-04T08:53:05.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad17fa640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcac006b500 0x7fcac006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcacc08b070 con 0x7fcad40d0d20 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad17fa640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7fcac00713c0 0x7fcac00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcacc019ec0 con 0x7fcac00713c0 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcacc08b500 con 0x7fcad40d0d20 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad3fff640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcac006b500 0x7fcac006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad9466640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7fcac00713c0 0x7fcac00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad9466640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7fcac00713c0 0x7fcac00737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.543+0000 7fcad3fff640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcac006b500 0x7fcac006d9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcad40d36a0 tx=0x7fcac8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.544+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== osd.1 v2:172.21.15.19:6800/909506056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcacc019ec0 con 0x7fcac00713c0 2024-03-04T08:53:05.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.557+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 --> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcad404f330 con 0x7fcac00713c0 2024-03-04T08:53:05.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.557+0000 7fcad17fa640 1 -- 172.21.15.19:0/598834960 <== osd.1 v2:172.21.15.19:6800/909506056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcad404f330 con 0x7fcac00713c0 2024-03-04T08:53:05.554 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:05.554 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:05.554 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7fcac00713c0 msgr2=0x7fcac00737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:6800/909506056,v1:172.21.15.19:6801/909506056] conn(0x7fcac00713c0 0x7fcac00737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcac006b500 msgr2=0x7fcac006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fcac006b500 0x7fcac006d9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcad40d36a0 tx=0x7fcac8009040 comp rx=0 tx=0).stop 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 msgr2=0x7fcad4157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 --2- 172.21.15.19:0/598834960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcad40d0d20 0x7fcad4157090 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00efc0 tx=0x7fcacc00c490 comp rx=0 tx=0).stop 2024-03-04T08:53:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcad9466640 1 -- 172.21.15.19:0/598834960 reap_dead start 2024-03-04T08:53:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 shutdown_connections 2024-03-04T08:53:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 >> 172.21.15.19:0/598834960 conn(0x7fcad40d3cb0 msgr2=0x7fcad40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 shutdown_connections 2024-03-04T08:53:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.558+0000 7fcadaec9640 1 -- 172.21.15.19:0/598834960 wait complete. 2024-03-04T08:53:05.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-04T08:53:05.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.671+0000 7fc3d39f7640 1 Processor -- start 2024-03-04T08:53:05.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.671+0000 7fc3d39f7640 1 -- start start 2024-03-04T08:53:05.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d39f7640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc3cc158880 0x7fc3cc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d39f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d39f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc06d030 con 0x7fc3cc15b380 2024-03-04T08:53:05.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d39f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc06d310 con 0x7fc3cc06cb90 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d39f7640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc06d5f0 con 0x7fc3cc158880 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53066/0 (socket says 172.21.15.19:53066) 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 -- 172.21.15.19:0/264725741 learned_addr learned my addr 172.21.15.19:0/264725741 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d0f92640 1 --1- 172.21.15.19:0/264725741 >> v1:172.21.15.19:6789/0 conn(0x7fc3cc15b380 0x7fc3cc0708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44792/0 (socket says 172.21.15.19:44792) 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1793640 1 --2- 172.21.15.19:0/264725741 >> v2:172.21.15.204:3300/0 conn(0x7fc3cc158880 0x7fc3cc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 -- 172.21.15.19:0/264725741 >> v2:172.21.15.204:3300/0 conn(0x7fc3cc158880 msgr2=0x7fc3cc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 --2- 172.21.15.19:0/264725741 >> v2:172.21.15.204:3300/0 conn(0x7fc3cc158880 0x7fc3cc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 -- 172.21.15.19:0/264725741 >> v1:172.21.15.19:6789/0 conn(0x7fc3cc15b380 legacy=0x7fc3cc0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3d1f94640 1 -- 172.21.15.19:0/264725741 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc06d8d0 con 0x7fc3cc06cb90 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.672+0000 7fc3c3fff640 1 -- 172.21.15.19:0/264725741 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964198432 0 0) 0x7fc3cc06d030 con 0x7fc3cc15b380 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3d1f94640 1 --2- 172.21.15.19:0/264725741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0cd510 tx=0x7fc3c402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8610ddbfe25b6cea server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3c3fff640 1 -- 172.21.15.19:0/264725741 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c402cb20 con 0x7fc3cc06cb90 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3c3fff640 1 -- 172.21.15.19:0/264725741 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c402ccc0 con 0x7fc3cc06cb90 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3c3fff640 1 -- 172.21.15.19:0/264725741 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4034610 con 0x7fc3cc06cb90 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3d39f7640 1 -- 172.21.15.19:0/264725741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 msgr2=0x7fc3cc0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.673+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/264725741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0cd510 tx=0x7fc3c402bf80 comp rx=0 tx=0).stop 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 -- 172.21.15.19:0/264725741 shutdown_connections 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/264725741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc0cd7c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/264725741 >> v2:172.21.15.204:3300/0 conn(0x7fc3cc158880 0x7fc3cc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 -- 172.21.15.19:0/264725741 >> 172.21.15.19:0/264725741 conn(0x7fc3cc0b1c80 msgr2=0x7fc3cc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 -- 172.21.15.19:0/264725741 shutdown_connections 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.674+0000 7fc3d39f7640 1 -- 172.21.15.19:0/264725741 wait complete. 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.675+0000 7fc3d39f7640 1 Processor -- start 2024-03-04T08:53:05.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.675+0000 7fc3d39f7640 1 -- start start 2024-03-04T08:53:05.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3cc158880 0x7fc3cc0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3cc15b380 0x7fc3cc0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc071160 con 0x7fc3cc06cb90 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc070fe0 con 0x7fc3cc15b380 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0cdd00 con 0x7fc3cc158880 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53070/0 (socket says 172.21.15.19:53070) 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 -- 172.21.15.19:0/2717792388 learned_addr learned my addr 172.21.15.19:0/2717792388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d0f92640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3cc158880 0x7fc3cc0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1f94640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3cc15b380 0x7fc3cc0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 -- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3cc158880 msgr2=0x7fc3cc0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3cc158880 0x7fc3cc0adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 -- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3cc15b380 msgr2=0x7fc3cc0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3cc15b380 0x7fc3cc0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 -- 172.21.15.19:0/2717792388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0aa280 con 0x7fc3cc06cb90 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d1793640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800e9e0 tx=0x7fc3c800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8017070 con 0x7fc3cc06cb90 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800c9d0 con 0x7fc3cc06cb90 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800cdc0 con 0x7fc3cc06cb90 2024-03-04T08:53:05.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.676+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc0aa560 con 0x7fc3cc06cb90 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.677+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc0aab20 con 0x7fc3cc06cb90 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.678+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc04f330 con 0x7fc3cc06cb90 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.678+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3c801a070 con 0x7fc3cc06cb90 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.678+0000 7fc3c1ffb640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 0x7fc3b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.679+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc3c808a200 con 0x7fc3cc06cb90 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.679+0000 7fc3d0f92640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 0x7fc3b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.679+0000 7fc3d0f92640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 0x7fc3b006d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc15d7e0 tx=0x7fc3bc007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.683+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc3c8058d40 con 0x7fc3cc06cb90 2024-03-04T08:53:05.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.864+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3cc0aae90 con 0x7fc3b006b4d0 2024-03-04T08:53:05.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.864+0000 7fc3c1ffb640 1 -- 172.21.15.19:0/2717792388 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3cc0aae90 con 0x7fc3b006b4d0 2024-03-04T08:53:05.861 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-03-04T08:53:05.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 msgr2=0x7fc3b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 0x7fc3b006d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc15d7e0 tx=0x7fc3bc007de0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 msgr2=0x7fc3cc142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800e9e0 tx=0x7fc3c800eea0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 shutdown_connections 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc3b006b4d0 0x7fc3b006d990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc3cc15b380 0x7fc3cc0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc3cc158880 0x7fc3cc0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 --2- 172.21.15.19:0/2717792388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3cc06cb90 0x7fc3cc142490 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 >> 172.21.15.19:0/2717792388 conn(0x7fc3cc0b1c80 msgr2=0x7fc3cc0708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 shutdown_connections 2024-03-04T08:53:05.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.866+0000 7fc3d39f7640 1 -- 172.21.15.19:0/2717792388 wait complete. 2024-03-04T08:53:05.873 INFO:tasks.ceph:Scrubbing osd.2 2024-03-04T08:53:05.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:05.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.982+0000 7f85ed95e640 1 Processor -- start 2024-03-04T08:53:05.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.982+0000 7f85ed95e640 1 -- start start 2024-03-04T08:53:05.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85e815a490 0x7f85e806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f85e80b3fd0 0x7f85e80b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b2e90 0x7f85e80708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e806e4d0 con 0x7f85e815a490 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80b4490 con 0x7f85e80b3fd0 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85ed95e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cf4a0 con 0x7f85e80b2e90 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85e815a490 0x7f85e806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85e815a490 0x7f85e806df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53084/0 (socket says 172.21.15.19:53084) 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 -- 172.21.15.19:0/1312073905 learned_addr learned my addr 172.21.15.19:0/1312073905 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e67fc640 1 --2- 172.21.15.19:0/1312073905 >> v2:172.21.15.204:3300/0 conn(0x7f85e80b3fd0 0x7f85e80b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e77fe640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b2e90 0x7f85e80708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 -- 172.21.15.19:0/1312073905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b2e90 msgr2=0x7f85e80708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b2e90 0x7f85e80708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 -- 172.21.15.19:0/1312073905 >> v2:172.21.15.204:3300/0 conn(0x7f85e80b3fd0 msgr2=0x7f85e80b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/1312073905 >> v2:172.21.15.204:3300/0 conn(0x7f85e80b3fd0 0x7f85e80b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.983+0000 7f85e6ffd640 1 -- 172.21.15.19:0/1312073905 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80b4750 con 0x7f85e815a490 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.984+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e806df90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070670 tx=0x7f85e002cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cd6bbc338513b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.984+0000 7f85e5ffb640 1 -- 172.21.15.19:0/1312073905 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e003a070 con 0x7f85e815a490 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.984+0000 7f85e5ffb640 1 -- 172.21.15.19:0/1312073905 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e002dba0 con 0x7f85e815a490 2024-03-04T08:53:05.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.984+0000 7f85e5ffb640 1 -- 172.21.15.19:0/1312073905 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e000b040 con 0x7f85e815a490 2024-03-04T08:53:05.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 -- 172.21.15.19:0/1312073905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 msgr2=0x7f85e806df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e806df90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070670 tx=0x7f85e002cdf0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 -- 172.21.15.19:0/1312073905 shutdown_connections 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b2e90 0x7f85e80708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 --2- 172.21.15.19:0/1312073905 >> v2:172.21.15.204:3300/0 conn(0x7f85e80b3fd0 0x7f85e80b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 --2- 172.21.15.19:0/1312073905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e806df90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 -- 172.21.15.19:0/1312073905 >> 172.21.15.19:0/1312073905 conn(0x7f85e80b1650 msgr2=0x7f85e80b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 -- 172.21.15.19:0/1312073905 shutdown_connections 2024-03-04T08:53:05.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.985+0000 7f85ed95e640 1 -- 172.21.15.19:0/1312073905 wait complete. 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.986+0000 7f85ed95e640 1 Processor -- start 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.986+0000 7f85ed95e640 1 -- start start 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e80b2e90 0x7f85e81f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b3fd0 0x7f85e8146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e8154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cf260 con 0x7f85e815a490 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cf0e0 con 0x7f85e80b2e90 2024-03-04T08:53:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80b3300 con 0x7f85e80b3fd0 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e8154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e8154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53090/0 (socket says 172.21.15.19:53090) 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 -- 172.21.15.19:0/2475502996 learned_addr learned my addr 172.21.15.19:0/2475502996 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e80b2e90 0x7f85e81f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e67fc640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b3fd0 0x7f85e8146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 -- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b3fd0 msgr2=0x7f85e8146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f85e80b3fd0 0x7f85e8146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 -- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e80b2e90 msgr2=0x7f85e81f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f85e80b2e90 0x7f85e81f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8150140 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85e77fe640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e8154b70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f85d8007e70 tx=0x7f85d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8014620 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8019070 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e81503e0 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.987+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8014a20 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.988+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e81509a0 con 0x7f85e815a490 2024-03-04T08:53:05.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.988+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85e8150d80 con 0x7f85e815a490 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.989+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85d8014bc0 con 0x7f85e815a490 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.989+0000 7f85cffff640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d406b500 0x7f85d406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.989+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85d808a780 con 0x7f85e815a490 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85cffff640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7f85d40713c0 0x7f85d40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85d800ee90 con 0x7f85d40713c0 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d8091050 con 0x7f85e815a490 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d406b500 0x7f85d406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85e67fc640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7f85d40713c0 0x7f85d40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:05.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85e67fc640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7f85d40713c0 0x7f85d40737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.990+0000 7f85e6ffd640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d406b500 0x7f85d406d9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f85e0037000 tx=0x7f85e0031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:05.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:05.991+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== osd.2 v2:172.21.15.19:6808/2828546557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f85d800ee90 con 0x7f85d40713c0 2024-03-04T08:53:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 --> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f85e80b2c50 con 0x7f85d40713c0 2024-03-04T08:53:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85cffff640 1 -- 172.21.15.19:0/2475502996 <== osd.2 v2:172.21.15.19:6808/2828546557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f85e80b2c50 con 0x7f85d40713c0 2024-03-04T08:53:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:06.001 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7f85d40713c0 msgr2=0x7f85d40737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:6808/2828546557,v1:172.21.15.19:6809/2828546557] conn(0x7f85d40713c0 0x7f85d40737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d406b500 msgr2=0x7f85d406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f85d406b500 0x7f85d406d9c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f85e0037000 tx=0x7f85e0031000 comp rx=0 tx=0).stop 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 msgr2=0x7f85e8154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 --2- 172.21.15.19:0/2475502996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85e815a490 0x7f85e8154b70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f85d8007e70 tx=0x7f85d800e4b0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85e77fe640 1 -- 172.21.15.19:0/2475502996 reap_dead start 2024-03-04T08:53:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 shutdown_connections 2024-03-04T08:53:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.004+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 >> 172.21.15.19:0/2475502996 conn(0x7f85e80b1650 msgr2=0x7f85e806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.005+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 shutdown_connections 2024-03-04T08:53:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.005+0000 7f85ed95e640 1 -- 172.21.15.19:0/2475502996 wait complete. 2024-03-04T08:53:06.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-04T08:53:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.117+0000 7f0113ac9640 1 Processor -- start 2024-03-04T08:53:06.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.117+0000 7f0113ac9640 1 -- start start 2024-03-04T08:53:06.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0113ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 0x7f010c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0113ac9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f010c0b2910 0x7f010c0d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0113ac9640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c15e3f0 con 0x7f010c15e010 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0113ac9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c0b1f40 con 0x7f010c0b2910 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0113ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0b1c10 con 0x7f010c0b3240 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0112066640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f010c0b2910 0x7f010c0d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0111865640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f010c15e010 0x7f010c0cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44806/0 (socket says 172.21.15.19:44806) 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0111865640 1 -- 172.21.15.19:0/658774778 learned_addr learned my addr 172.21.15.19:0/658774778 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0111064640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 0x7f010c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0112066640 1 -- 172.21.15.19:0/658774778 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 msgr2=0x7f010c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0112066640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 0x7f010c0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0112066640 1 -- 172.21.15.19:0/658774778 >> v1:172.21.15.19:6789/0 conn(0x7f010c15e010 legacy=0x7f010c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0110863640 1 -- 172.21.15.19:0/658774778 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627411541 0 0) 0x7f010c15e3f0 con 0x7f010c15e010 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0112066640 1 -- 172.21.15.19:0/658774778 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c06d1b0 con 0x7f010c0b2910 2024-03-04T08:53:06.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.118+0000 7f0111064640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 0x7f010c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:06.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.119+0000 7f0112066640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b2910 0x7f010c0d1ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0108009dc0 tx=0x7f010802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c0175f337d5d9e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.119+0000 7f0110863640 1 -- 172.21.15.19:0/658774778 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108039070 con 0x7f010c0b2910 2024-03-04T08:53:06.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.119+0000 7f0110863640 1 -- 172.21.15.19:0/658774778 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010802cbb0 con 0x7f010c0b2910 2024-03-04T08:53:06.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.119+0000 7f0110863640 1 -- 172.21.15.19:0/658774778 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108034440 con 0x7f010c0b2910 2024-03-04T08:53:06.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 -- 172.21.15.19:0/658774778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b2910 msgr2=0x7f010c0d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b2910 0x7f010c0d1ad0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0108009dc0 tx=0x7f010802be00 comp rx=0 tx=0).stop 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 -- 172.21.15.19:0/658774778 shutdown_connections 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b2910 0x7f010c0d1ad0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 --2- 172.21.15.19:0/658774778 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c0b3240 0x7f010c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 -- 172.21.15.19:0/658774778 >> 172.21.15.19:0/658774778 conn(0x7f010c09a9f0 msgr2=0x7f010c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 -- 172.21.15.19:0/658774778 shutdown_connections 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.120+0000 7f0113ac9640 1 -- 172.21.15.19:0/658774778 wait complete. 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.121+0000 7f0113ac9640 1 Processor -- start 2024-03-04T08:53:06.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.121+0000 7f0113ac9640 1 -- start start 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 0x7f010c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c14df90 0x7f010c06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0d2010 con 0x7f010c15e010 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c06ced0 con 0x7f010c15eff0 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0113ac9640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0d2190 con 0x7f010c14df90 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53102/0 (socket says 172.21.15.19:53102) 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 -- 172.21.15.19:0/1766314775 learned_addr learned my addr 172.21.15.19:0/1766314775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111064640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 0x7f010c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0112066640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c14df90 0x7f010c06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 -- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c14df90 msgr2=0x7f010c06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c14df90 0x7f010c06fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 -- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 msgr2=0x7f010c14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 0x7f010c14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111865640 1 -- 172.21.15.19:0/1766314775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c1f44e0 con 0x7f010c15e010 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.122+0000 7f0111064640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 0x7f010c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f0111865640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f010400c460 tx=0x7f010400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040074e0 con 0x7f010c15e010 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040047e0 con 0x7f010c15e010 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104004bd0 con 0x7f010c15e010 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c14e4f0 con 0x7f010c15e010 2024-03-04T08:53:06.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.123+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c15e7f0 con 0x7f010c15e010 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.124+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c06df50 con 0x7f010c15e010 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.124+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0104011070 con 0x7f010c15e010 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.125+0000 7f01027fc640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 0x7f00f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.125+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0104089a90 con 0x7f010c15e010 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.125+0000 7f0111064640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 0x7f00f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.125+0000 7f0111064640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 0x7f00f006d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f010c0b0af0 tx=0x7f00fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.129+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f010c06df50 con 0x7f010c15e010 2024-03-04T08:53:06.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.309+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f010c04f330 con 0x7f00f006b4d0 2024-03-04T08:53:06.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.310+0000 7f01027fc640 1 -- 172.21.15.19:0/1766314775 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f010c04f330 con 0x7f00f006b4d0 2024-03-04T08:53:06.306 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-03-04T08:53:06.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 msgr2=0x7f00f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 0x7f00f006d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f010c0b0af0 tx=0x7f00fc008040 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 msgr2=0x7f010c1f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f010400c460 tx=0x7f010400c920 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 shutdown_connections 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f010c14df90 0x7f010c06fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f00f006b4d0 0x7f00f006d990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f010c15eff0 0x7f010c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 --2- 172.21.15.19:0/1766314775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15e010 0x7f010c1f3fa0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 >> 172.21.15.19:0/1766314775 conn(0x7f010c09a9f0 msgr2=0x7f010c0b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 shutdown_connections 2024-03-04T08:53:06.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.312+0000 7f0113ac9640 1 -- 172.21.15.19:0/1766314775 wait complete. 2024-03-04T08:53:06.319 INFO:tasks.ceph:Scrubbing osd.3 2024-03-04T08:53:06.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.428+0000 7f1ecab81640 1 Processor -- start 2024-03-04T08:53:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.428+0000 7f1ecab81640 1 -- start start 2024-03-04T08:53:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ecab81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ec415be30 0x7f1ec415c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ecab81640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 0x7f1ec40b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ecab81640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec40d0f90 con 0x7f1ec40b5ca0 2024-03-04T08:53:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ecab81640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec406bb60 con 0x7f1ec415be30 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ecab81640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec406be40 con 0x7f1ec40d07a0 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec891d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ec415be30 0x7f1ec415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec3fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ec40b5ca0 0x7f1ec40d0090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44822/0 (socket says 172.21.15.19:44822) 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec3fff640 1 -- 172.21.15.19:0/3929241549 learned_addr learned my addr 172.21.15.19:0/3929241549 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec911e640 1 --2- 172.21.15.19:0/3929241549 >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 0x7f1ec40b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec891d640 1 -- 172.21.15.19:0/3929241549 >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 msgr2=0x7f1ec40b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec891d640 1 --2- 172.21.15.19:0/3929241549 >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 0x7f1ec40b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec891d640 1 -- 172.21.15.19:0/3929241549 >> v1:172.21.15.19:6789/0 conn(0x7f1ec40b5ca0 legacy=0x7f1ec40d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec891d640 1 -- 172.21.15.19:0/3929241549 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40b0990 con 0x7f1ec415be30 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec37fe640 1 -- 172.21.15.19:0/3929241549 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844235417 0 0) 0x7f1ec40d0f90 con 0x7f1ec40b5ca0 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.429+0000 7f1ec911e640 1 --2- 172.21.15.19:0/3929241549 >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 0x7f1ec40b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.430+0000 7f1ec891d640 1 --2- 172.21.15.19:0/3929241549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec415be30 0x7f1ec415c210 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40b3120 tx=0x7f1eb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1361c2cb20f08536 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.430+0000 7f1ec37fe640 1 -- 172.21.15.19:0/3929241549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4035020 con 0x7f1ec415be30 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.430+0000 7f1ec37fe640 1 -- 172.21.15.19:0/3929241549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4031830 con 0x7f1ec415be30 2024-03-04T08:53:06.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.430+0000 7f1ec37fe640 1 -- 172.21.15.19:0/3929241549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031c00 con 0x7f1ec415be30 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 -- 172.21.15.19:0/3929241549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec415be30 msgr2=0x7f1ec415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 --2- 172.21.15.19:0/3929241549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec415be30 0x7f1ec415c210 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40b3120 tx=0x7f1eb402b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 -- 172.21.15.19:0/3929241549 shutdown_connections 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 --2- 172.21.15.19:0/3929241549 >> v2:172.21.15.204:3300/0 conn(0x7f1ec40d07a0 0x7f1ec40b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 --2- 172.21.15.19:0/3929241549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec415be30 0x7f1ec415c210 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 -- 172.21.15.19:0/3929241549 >> 172.21.15.19:0/3929241549 conn(0x7f1ec40b4ed0 msgr2=0x7f1ec40b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 -- 172.21.15.19:0/3929241549 shutdown_connections 2024-03-04T08:53:06.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.431+0000 7f1ecab81640 1 -- 172.21.15.19:0/3929241549 wait complete. 2024-03-04T08:53:06.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.432+0000 7f1ecab81640 1 Processor -- start 2024-03-04T08:53:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.432+0000 7f1ecab81640 1 -- start start 2024-03-04T08:53:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec40b5ca0 0x7f1ec41f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 0x7f1ec414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec415be30 0x7f1ec415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec4066d00 con 0x7f1ec40d07a0 2024-03-04T08:53:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec406c120 con 0x7f1ec415be30 2024-03-04T08:53:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ecab81640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec4066e80 con 0x7f1ec40b5ca0 2024-03-04T08:53:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 0x7f1ec414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 0x7f1ec414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53122/0 (socket says 172.21.15.19:53122) 2024-03-04T08:53:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 -- 172.21.15.19:0/4153242229 learned_addr learned my addr 172.21.15.19:0/4153242229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec891d640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec40b5ca0 0x7f1ec41f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec911e640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec415be30 0x7f1ec415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 -- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec40b5ca0 msgr2=0x7f1ec41f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1ec40b5ca0 0x7f1ec41f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 -- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec415be30 msgr2=0x7f1ec415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec415be30 0x7f1ec415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec3fff640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec414e510 con 0x7f1ec40d07a0 2024-03-04T08:53:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.433+0000 7f1ec911e640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1ec415be30 0x7f1ec415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ec3fff640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 0x7f1ec414ec40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c430 tx=0x7f1eb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80074e0 con 0x7f1ec40d07a0 2024-03-04T08:53:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb80047e0 con 0x7f1ec40d07a0 2024-03-04T08:53:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8004bd0 con 0x7f1ec40d07a0 2024-03-04T08:53:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec4151a20 con 0x7f1ec40d07a0 2024-03-04T08:53:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.434+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec4151fe0 con 0x7f1ec40d07a0 2024-03-04T08:53:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.435+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ec404f330 con 0x7f1ec40d07a0 2024-03-04T08:53:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.435+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1eb8011070 con 0x7f1ec40d07a0 2024-03-04T08:53:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec17fa640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1eb006b4d0 0x7f1eb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1eb8089a20 con 0x7f1ec40d07a0 2024-03-04T08:53:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec17fa640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f1eb0071390 0x7f1eb00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1eb801ce80 con 0x7f1eb0071390 2024-03-04T08:53:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1eb808e2c0 con 0x7f1ec40d07a0 2024-03-04T08:53:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec891d640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1eb006b4d0 0x7f1eb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec911e640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f1eb0071390 0x7f1eb00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec911e640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f1eb0071390 0x7f1eb00737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.436+0000 7f1ec891d640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1eb006b4d0 0x7f1eb006d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4036000 tx=0x7f1eb4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.437+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== osd.3 v2:172.21.15.19:6813/154157976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1eb801ce80 con 0x7f1eb0071390 2024-03-04T08:53:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 --> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ec40d0f90 con 0x7f1eb0071390 2024-03-04T08:53:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ec17fa640 1 -- 172.21.15.19:0/4153242229 <== osd.3 v2:172.21.15.19:6813/154157976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1ec40d0f90 con 0x7f1eb0071390 2024-03-04T08:53:06.447 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:06.447 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:06.447 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f1eb0071390 msgr2=0x7f1eb00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ecab81640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:6813/154157976,v1:172.21.15.19:6815/154157976] conn(0x7f1eb0071390 0x7f1eb00737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1eb006b4d0 msgr2=0x7f1eb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.450+0000 7f1ecab81640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1eb006b4d0 0x7f1eb006d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4036000 tx=0x7f1eb4008030 comp rx=0 tx=0).stop 2024-03-04T08:53:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 msgr2=0x7f1ec414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 --2- 172.21.15.19:0/4153242229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec40d07a0 0x7f1ec414ec40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c430 tx=0x7f1eb800c8f0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ec911e640 1 -- 172.21.15.19:0/4153242229 reap_dead start 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 shutdown_connections 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 >> 172.21.15.19:0/4153242229 conn(0x7f1ec40b4ed0 msgr2=0x7f1ec40ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 shutdown_connections 2024-03-04T08:53:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.451+0000 7f1ecab81640 1 -- 172.21.15.19:0/4153242229 wait complete. 2024-03-04T08:53:06.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-04T08:53:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.563+0000 7f7b39513640 1 Processor -- start 2024-03-04T08:53:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.563+0000 7f7b39513640 1 -- start start 2024-03-04T08:53:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b39513640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f7b341586c0 0x7f7b3415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b39513640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b340b0240 0x7f7b3406afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b39513640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3415f520 con 0x7f7b3406b4f0 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b39513640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b34158aa0 con 0x7f7b340b0240 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b39513640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3406b960 con 0x7f7b341586c0 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b340b0240 0x7f7b3406afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b340b0240 0x7f7b3406afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53124/0 (socket says 172.21.15.19:53124) 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 -- 172.21.15.19:0/3619133170 learned_addr learned my addr 172.21.15.19:0/3619133170 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b32ffd640 1 --2- 172.21.15.19:0/3619133170 >> v2:172.21.15.204:3300/0 conn(0x7f7b341586c0 0x7f7b3415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 -- 172.21.15.19:0/3619133170 >> v2:172.21.15.204:3300/0 conn(0x7f7b341586c0 msgr2=0x7f7b3415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 --2- 172.21.15.19:0/3619133170 >> v2:172.21.15.204:3300/0 conn(0x7f7b341586c0 0x7f7b3415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 -- 172.21.15.19:0/3619133170 >> v1:172.21.15.204:6789/0 conn(0x7f7b3406b4f0 legacy=0x7f7b340cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.564+0000 7f7b327fc640 1 -- 172.21.15.19:0/3619133170 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340ce510 con 0x7f7b340b0240 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.565+0000 7f7b327fc640 1 --2- 172.21.15.19:0/3619133170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b3406afb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7b34073730 tx=0x7f7b1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e46c77d58c9420 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.565+0000 7f7b31ffb640 1 -- 172.21.15.19:0/3619133170 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c034070 con 0x7f7b340b0240 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.565+0000 7f7b31ffb640 1 -- 172.21.15.19:0/3619133170 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c030860 con 0x7f7b340b0240 2024-03-04T08:53:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.565+0000 7f7b31ffb640 1 -- 172.21.15.19:0/3619133170 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c030c30 con 0x7f7b340b0240 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 -- 172.21.15.19:0/3619133170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 msgr2=0x7f7b3406afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 --2- 172.21.15.19:0/3619133170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b3406afb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7b34073730 tx=0x7f7b1c02b9a0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 -- 172.21.15.19:0/3619133170 shutdown_connections 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 --2- 172.21.15.19:0/3619133170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b3406afb0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 --2- 172.21.15.19:0/3619133170 >> v2:172.21.15.204:3300/0 conn(0x7f7b341586c0 0x7f7b3415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 -- 172.21.15.19:0/3619133170 >> 172.21.15.19:0/3619133170 conn(0x7f7b340d09d0 msgr2=0x7f7b340d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 -- 172.21.15.19:0/3619133170 shutdown_connections 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.566+0000 7f7b39513640 1 -- 172.21.15.19:0/3619133170 wait complete. 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.567+0000 7f7b39513640 1 Processor -- start 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.567+0000 7f7b39513640 1 -- start start 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b3406b4f0 0x7f7b34144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b341586c0 0x7f7b341e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341622b0 con 0x7f7b340b0240 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34161fd0 con 0x7f7b3406b4f0 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b39513640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b34162590 con 0x7f7b341586c0 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53128/0 (socket says 172.21.15.19:53128) 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 -- 172.21.15.19:0/1493241395 learned_addr learned my addr 172.21.15.19:0/1493241395 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b32ffd640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b3406b4f0 0x7f7b34144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b337fe640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b341586c0 0x7f7b341e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 -- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b341586c0 msgr2=0x7f7b341e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b341586c0 0x7f7b341e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 -- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b3406b4f0 msgr2=0x7f7b34144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b3406b4f0 0x7f7b34144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.568+0000 7f7b327fc640 1 -- 172.21.15.19:0/1493241395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340adc40 con 0x7f7b340b0240 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b327fc640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c02b9e0 tx=0x7f7b1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c048070 con 0x7f7b340b0240 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c030660 con 0x7f7b340b0240 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b340adf20 con 0x7f7b340b0240 2024-03-04T08:53:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c034040 con 0x7f7b340b0240 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.569+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340ae4e0 con 0x7f7b340b0240 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.570+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b340b10f0 con 0x7f7b340b0240 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.570+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b1c037070 con 0x7f7b340b0240 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.571+0000 7f7b2b7fe640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 0x7f7b1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.571+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b1c0abb70 con 0x7f7b340b0240 2024-03-04T08:53:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.571+0000 7f7b32ffd640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 0x7f7b1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.571+0000 7f7b32ffd640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 0x7f7b1406d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7b34072e80 tx=0x7f7b2c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.575+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7b340b10f0 con 0x7f7b340b0240 2024-03-04T08:53:06.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.756+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b3404f330 con 0x7f7b1406b4d0 2024-03-04T08:53:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.757+0000 7f7b2b7fe640 1 -- 172.21.15.19:0/1493241395 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b3404f330 con 0x7f7b1406b4d0 2024-03-04T08:53:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-03-04T08:53:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 msgr2=0x7f7b1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 0x7f7b1406d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7b34072e80 tx=0x7f7b2c009190 comp rx=0 tx=0).stop 2024-03-04T08:53:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 msgr2=0x7f7b34156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c02b9e0 tx=0x7f7b1c004730 comp rx=0 tx=0).stop 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 shutdown_connections 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f7b341586c0 0x7f7b341e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b340b0240 0x7f7b34156980 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f7b1406b4d0 0x7f7b1406d990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 --2- 172.21.15.19:0/1493241395 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7b3406b4f0 0x7f7b34144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 >> 172.21.15.19:0/1493241395 conn(0x7f7b340d09d0 msgr2=0x7f7b340b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 shutdown_connections 2024-03-04T08:53:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.759+0000 7f7b39513640 1 -- 172.21.15.19:0/1493241395 wait complete. 2024-03-04T08:53:06.766 INFO:tasks.ceph:Scrubbing osd.4 2024-03-04T08:53:06.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:06.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.876+0000 7f72c545c640 1 Processor -- start 2024-03-04T08:53:06.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.876+0000 7f72c545c640 1 -- start start 2024-03-04T08:53:06.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72c545c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c00ce8c0 0x7f72c00cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72c545c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00ced50 con 0x7f72c015c5a0 2024-03-04T08:53:06.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72c545c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00cf030 con 0x7f72c015c980 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72c545c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0072a20 con 0x7f72c00ce8c0 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72beffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f72c015c5a0 0x7f72c006c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44838/0 (socket says 172.21.15.19:44838) 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72beffd640 1 -- 172.21.15.19:0/1248405751 learned_addr learned my addr 172.21.15.19:0/1248405751 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358652032 0 0) 0x7f72c00ced50 con 0x7f72c015c5a0 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003520 con 0x7f72c015c5a0 2024-03-04T08:53:06.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72b7fff640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c00ce8c0 0x7f72c00cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828425035 0 0) 0x7f72ac003520 con 0x7f72c015c5a0 2024-03-04T08:53:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c00ce8c0 msgr2=0x7f72c00cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72c00ce8c0 0x7f72c00cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 >> v1:172.21.15.204:6789/0 conn(0x7f72c015c980 legacy=0x7f72c0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0070b00 con 0x7f72c015c5a0 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7f72b0001670 con 0x7f72c015c5a0 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 >> v1:172.21.15.19:6789/0 conn(0x7f72c015c5a0 legacy=0x7f72c006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72ac0039e0 0x7f72ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72ac004800 0x7f72ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0051c0 0x7f72ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0072a20 con 0x7f72ac0039e0 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00bf00 con 0x7f72ac004800 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00c0d0 con 0x7f72ac0051c0 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.877+0000 7f72beffd640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72ac0039e0 0x7f72ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72b7fff640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72ac004800 0x7f72ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72bf7fe640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0051c0 0x7f72ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 -- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0051c0 msgr2=0x7f72ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0051c0 0x7f72ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 -- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72ac004800 msgr2=0x7f72ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72ac004800 0x7f72ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 -- 172.21.15.19:0/1248405751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac003520 con 0x7f72ac0039e0 2024-03-04T08:53:06.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72b7fff640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72ac004800 0x7f72ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.878+0000 7f72beffd640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72ac0039e0 0x7f72ac003e00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c210 tx=0x7f72ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ea9094b5cc29a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0007d30 con 0x7f72ac0039e0 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0030070 con 0x7f72ac0039e0 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72be7fc640 1 -- 172.21.15.19:0/1248405751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b002cd60 con 0x7f72ac0039e0 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 -- 172.21.15.19:0/1248405751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72ac0039e0 msgr2=0x7f72ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 --2- 172.21.15.19:0/1248405751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72ac0039e0 0x7f72ac003e00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c210 tx=0x7f72ac005830 comp rx=0 tx=0).stop 2024-03-04T08:53:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72bf7fe640 1 -- 172.21.15.19:0/1248405751 reap_dead start 2024-03-04T08:53:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 -- 172.21.15.19:0/1248405751 shutdown_connections 2024-03-04T08:53:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 -- 172.21.15.19:0/1248405751 >> 172.21.15.19:0/1248405751 conn(0x7f72c00b1650 msgr2=0x7f72c00b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 -- 172.21.15.19:0/1248405751 shutdown_connections 2024-03-04T08:53:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.879+0000 7f72c545c640 1 -- 172.21.15.19:0/1248405751 wait complete. 2024-03-04T08:53:06.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.880+0000 7f72c545c640 1 Processor -- start 2024-03-04T08:53:06.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.880+0000 7f72c545c640 1 -- start start 2024-03-04T08:53:06.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0039e0 0x7f72c01f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 0x7f72c013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c013c4d0 0x7f72c015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00708b0 con 0x7f72c0131c40 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c015d0c0 con 0x7f72c013c4d0 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72c545c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0070e70 con 0x7f72ac0039e0 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 0x7f72c013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 0x7f72c013bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53150/0 (socket says 172.21.15.19:53150) 2024-03-04T08:53:06.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72b7fff640 1 -- 172.21.15.19:0/292085510 learned_addr learned my addr 172.21.15.19:0/292085510 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72beffd640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0039e0 0x7f72c01f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.881+0000 7f72bf7fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c013c4d0 0x7f72c015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 -- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0039e0 msgr2=0x7f72c01f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f72ac0039e0 0x7f72c01f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 -- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c013c4d0 msgr2=0x7f72c015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c013c4d0 0x7f72c015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c01f1460 con 0x7f72c0131c40 2024-03-04T08:53:06.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72bf7fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f72c013c4d0 0x7f72c015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:06.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b7fff640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 0x7f72c013bf90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a80116d0 tx=0x7f72a8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800f9c0 con 0x7f72c0131c40 2024-03-04T08:53:06.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a800fb60 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c01f16d0 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8015460 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.882+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c01f1f70 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.883+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72c004f330 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.883+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72a8015600 con 0x7f72c0131c40 2024-03-04T08:53:06.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72b77fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f72a006b500 0x7f72a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72a808abd0 con 0x7f72c0131c40 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72b77fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7f72a00713c0 0x7f72a00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72a0073e90 con 0x7f72a00713c0 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72a808af80 con 0x7f72c0131c40 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72beffd640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f72a006b500 0x7f72a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.884+0000 7f72bf7fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7f72a00713c0 0x7f72a00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:06.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.885+0000 7f72beffd640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f72a006b500 0x7f72a006d9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72b0034000 tx=0x7f72b0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.885+0000 7f72bf7fe640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7f72a00713c0 0x7f72a00737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:06.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.886+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== osd.4 v2:172.21.15.204:6808/3951183250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f72a0073e90 con 0x7f72a00713c0 2024-03-04T08:53:06.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.899+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 --> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f72c00b1d10 con 0x7f72a00713c0 2024-03-04T08:53:06.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72b77fe640 1 -- 172.21.15.19:0/292085510 <== osd.4 v2:172.21.15.204:6808/3951183250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f72c00b1d10 con 0x7f72a00713c0 2024-03-04T08:53:06.898 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:06.898 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:06.898 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7f72a00713c0 msgr2=0x7f72a00737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6808/3951183250,v1:172.21.15.204:6809/3951183250] conn(0x7f72a00713c0 0x7f72a00737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f72a006b500 msgr2=0x7f72a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f72a006b500 0x7f72a006d9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72b0034000 tx=0x7f72b0009030 comp rx=0 tx=0).stop 2024-03-04T08:53:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 msgr2=0x7f72c013bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 --2- 172.21.15.19:0/292085510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0131c40 0x7f72c013bf90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a80116d0 tx=0x7f72a8011b90 comp rx=0 tx=0).stop 2024-03-04T08:53:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72bf7fe640 1 -- 172.21.15.19:0/292085510 reap_dead start 2024-03-04T08:53:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 shutdown_connections 2024-03-04T08:53:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 >> 172.21.15.19:0/292085510 conn(0x7f72c00b1650 msgr2=0x7f72c0071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 shutdown_connections 2024-03-04T08:53:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:06.900+0000 7f72c545c640 1 -- 172.21.15.19:0/292085510 wait complete. 2024-03-04T08:53:06.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-04T08:53:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.012+0000 7fc8a6c39640 1 Processor -- start 2024-03-04T08:53:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.012+0000 7fc8a6c39640 1 -- start start 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a6c39640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 0x7fc8a00d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a6c39640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8a0161cf0 0x7fc8a0162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a6c39640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00d22c0 con 0x7fc8a00b4460 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a6c39640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a0161b00 con 0x7fc8a0161cf0 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a6c39640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00cecc0 con 0x7fc8a0162970 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a51d6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8a0161cf0 0x7fc8a0162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a49d5640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc8a00b4460 0x7fc8a00b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44848/0 (socket says 172.21.15.19:44848) 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a49d5640 1 -- 172.21.15.19:0/3202315424 learned_addr learned my addr 172.21.15.19:0/3202315424 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.013+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3202315424 >> v2:172.21.15.19:3300/0 conn(0x7fc8a0161cf0 0x7fc8a0162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53160/0 (socket says 172.21.15.19:53160) 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc89ffff640 1 --2- 172.21.15.19:0/3202315424 >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 0x7fc8a00d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3202315424 >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 msgr2=0x7fc8a00d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3202315424 >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 0x7fc8a00d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3202315424 >> v1:172.21.15.19:6789/0 conn(0x7fc8a00b4460 legacy=0x7fc8a00b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3202315424 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00d25a0 con 0x7fc8a0161cf0 2024-03-04T08:53:07.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc89f7fe640 1 -- 172.21.15.19:0/3202315424 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027131536 0 0) 0x7fc8a00d22c0 con 0x7fc8a00b4460 2024-03-04T08:53:07.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc89ffff640 1 --2- 172.21.15.19:0/3202315424 >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 0x7fc8a00d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:07.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.014+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3202315424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0161cf0 0x7fc8a0162180 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00d17e0 tx=0x7fc88802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75285f7186bddd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc89f7fe640 1 -- 172.21.15.19:0/3202315424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888035020 con 0x7fc8a0161cf0 2024-03-04T08:53:07.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc89f7fe640 1 -- 172.21.15.19:0/3202315424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888031830 con 0x7fc8a0161cf0 2024-03-04T08:53:07.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc89f7fe640 1 -- 172.21.15.19:0/3202315424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888031c00 con 0x7fc8a0161cf0 2024-03-04T08:53:07.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3202315424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0161cf0 msgr2=0x7fc8a0162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3202315424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0161cf0 0x7fc8a0162180 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00d17e0 tx=0x7fc88802b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3202315424 shutdown_connections 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3202315424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0161cf0 0x7fc8a0162180 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3202315424 >> v2:172.21.15.204:3300/0 conn(0x7fc8a0162970 0x7fc8a00d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3202315424 >> 172.21.15.19:0/3202315424 conn(0x7fc8a00d3ce0 msgr2=0x7fc8a00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3202315424 shutdown_connections 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.015+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3202315424 wait complete. 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.016+0000 7fc8a6c39640 1 Processor -- start 2024-03-04T08:53:07.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.016+0000 7fc8a6c39640 1 -- start start 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8a00b4460 0x7fc8a015d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 0x7fc8a0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00ce950 con 0x7fc8a0162970 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00d2b60 con 0x7fc8a00b4460 2024-03-04T08:53:07.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a6c39640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b4840 con 0x7fc8a0161cf0 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a51d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a51d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53164/0 (socket says 172.21.15.19:53164) 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3090630485 learned_addr learned my addr 172.21.15.19:0/3090630485 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc8a49d5640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8a00b4460 0x7fc8a015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.017+0000 7fc89ffff640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 0x7fc8a0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 msgr2=0x7fc8a0153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 0x7fc8a0153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8a00b4460 msgr2=0x7fc8a015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8a00b4460 0x7fc8a015d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 -- 172.21.15.19:0/3090630485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00ca2c0 con 0x7fc8a0162970 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc89ffff640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 0x7fc8a0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a51d6640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc88802bee0 tx=0x7fc8880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888041070 con 0x7fc8a0162970 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88803a970 con 0x7fc8a0162970 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888035040 con 0x7fc8a0162970 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00b69a0 con 0x7fc8a0162970 2024-03-04T08:53:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.018+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00b6f60 con 0x7fc8a0162970 2024-03-04T08:53:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.019+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a00b7160 con 0x7fc8a0162970 2024-03-04T08:53:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.019+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc888038020 con 0x7fc8a0162970 2024-03-04T08:53:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.020+0000 7fc89d7fa640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.020+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8880ab8e0 con 0x7fc8a0162970 2024-03-04T08:53:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.020+0000 7fc8a49d5640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.021+0000 7fc8a49d5640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 0x7fc88006d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc8980012e0 tx=0x7fc898001630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.024+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc88807a410 con 0x7fc8a0162970 2024-03-04T08:53:07.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.204+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a004f330 con 0x7fc88006b4d0 2024-03-04T08:53:07.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.205+0000 7fc89d7fa640 1 -- 172.21.15.19:0/3090630485 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc8a004f330 con 0x7fc88006b4d0 2024-03-04T08:53:07.201 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-03-04T08:53:07.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 msgr2=0x7fc88006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 0x7fc88006d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc8980012e0 tx=0x7fc898001630 comp rx=0 tx=0).stop 2024-03-04T08:53:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 msgr2=0x7fc8a00b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc88802bee0 tx=0x7fc8880046c0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 shutdown_connections 2024-03-04T08:53:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8a0162970 0x7fc8a00b7480 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fc8a0161cf0 0x7fc8a0153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fc88006b4d0 0x7fc88006d990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 --2- 172.21.15.19:0/3090630485 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fc8a00b4460 0x7fc8a015d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 >> 172.21.15.19:0/3090630485 conn(0x7fc8a00d3ce0 msgr2=0x7fc8a0160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 shutdown_connections 2024-03-04T08:53:07.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.207+0000 7fc8a6c39640 1 -- 172.21.15.19:0/3090630485 wait complete. 2024-03-04T08:53:07.214 INFO:tasks.ceph:Scrubbing osd.5 2024-03-04T08:53:07.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:07.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.323+0000 7f1a58d3e640 1 Processor -- start 2024-03-04T08:53:07.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.323+0000 7f1a58d3e640 1 -- start start 2024-03-04T08:53:07.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a58d3e640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f1a5415bdd0 0x7f1a541602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a58d3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a540d0130 0x7f1a5415d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a58d3e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5406f420 con 0x7f1a540701e0 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a58d3e640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5406f700 con 0x7f1a5415bdd0 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a58d3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5406f9e0 con 0x7f1a540d0130 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a52d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1a540701e0 0x7f1a54070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44856/0 (socket says 172.21.15.19:44856) 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a52d9d640 1 -- 172.21.15.19:0/3572011843 learned_addr learned my addr 172.21.15.19:0/3572011843 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a5259c640 1 --2- 172.21.15.19:0/3572011843 >> v2:172.21.15.204:3300/0 conn(0x7f1a5415bdd0 0x7f1a541602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.324+0000 7f1a51d9b640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a540d0130 0x7f1a5415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5159a640 1 -- 172.21.15.19:0/3572011843 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478595091 0 0) 0x7f1a5406f420 con 0x7f1a540701e0 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5159a640 1 -- 172.21.15.19:0/3572011843 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a40003520 con 0x7f1a540701e0 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5259c640 1 -- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a540d0130 msgr2=0x7f1a5415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5259c640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a540d0130 0x7f1a5415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5259c640 1 -- 172.21.15.19:0/3572011843 >> v1:172.21.15.19:6789/0 conn(0x7f1a540701e0 legacy=0x7f1a54070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.325+0000 7f1a5259c640 1 -- 172.21.15.19:0/3572011843 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5406fcc0 con 0x7f1a5415bdd0 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a5259c640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a5415bdd0 0x7f1a541602b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0097a0 tx=0x7f1a4c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7717082136c241 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a5159a640 1 -- 172.21.15.19:0/3572011843 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c035020 con 0x7f1a5415bdd0 2024-03-04T08:53:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a5159a640 1 -- 172.21.15.19:0/3572011843 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c031830 con 0x7f1a5415bdd0 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a5159a640 1 -- 172.21.15.19:0/3572011843 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c031c00 con 0x7f1a5415bdd0 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 -- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a5415bdd0 msgr2=0x7f1a541602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a5415bdd0 0x7f1a541602b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0097a0 tx=0x7f1a4c02b8d0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 -- 172.21.15.19:0/3572011843 shutdown_connections 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a540d0130 0x7f1a5415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/3572011843 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a5415bdd0 0x7f1a541602b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.326+0000 7f1a58d3e640 1 -- 172.21.15.19:0/3572011843 >> 172.21.15.19:0/3572011843 conn(0x7f1a5409a9f0 msgr2=0x7f1a5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.327+0000 7f1a58d3e640 1 -- 172.21.15.19:0/3572011843 shutdown_connections 2024-03-04T08:53:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.327+0000 7f1a58d3e640 1 -- 172.21.15.19:0/3572011843 wait complete. 2024-03-04T08:53:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 Processor -- start 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 -- start start 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 0x7f1a541580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a540d0130 0x7f1a540ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a5415bdd0 0x7f1a540b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415d9f0 con 0x7f1a540701e0 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415d870 con 0x7f1a540d0130 2024-03-04T08:53:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.328+0000 7f1a58d3e640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540d08d0 con 0x7f1a5415bdd0 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 0x7f1a541580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 0x7f1a541580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53180/0 (socket says 172.21.15.19:53180) 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 -- 172.21.15.19:0/483725399 learned_addr learned my addr 172.21.15.19:0/483725399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a51d9b640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a540d0130 0x7f1a540ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a52d9d640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a5415bdd0 0x7f1a540b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 -- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a5415bdd0 msgr2=0x7f1a540b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f1a5415bdd0 0x7f1a540b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 -- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a540d0130 msgr2=0x7f1a540ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a540d0130 0x7f1a540ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540cd7e0 con 0x7f1a540701e0 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a51d9b640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1a540d0130 0x7f1a540ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a5259c640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 0x7f1a541580e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034040 tx=0x7f1a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c040070 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c03a910 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a540cdac0 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c035040 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.329+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540ce080 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.330+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a5404f330 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a4c038020 con 0x7f1a540701e0 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a3406b500 0x7f1a3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a4c0ab6e0 con 0x7f1a540701e0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f1a340713c0 0x7f1a340737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4c045e70 con 0x7f1a340713c0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a4c0b2050 con 0x7f1a540701e0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a51d9b640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a3406b500 0x7f1a3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.331+0000 7f1a52d9d640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f1a340713c0 0x7f1a340737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.332+0000 7f1a51d9b640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a3406b500 0x7f1a3406d9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b26d0 tx=0x7f1a3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.332+0000 7f1a52d9d640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f1a340713c0 0x7f1a340737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.333+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== osd.5 v2:172.21.15.204:6800/1186499881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1a4c045e70 con 0x7f1a340713c0 2024-03-04T08:53:07.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.346+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 --> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a540b7ad0 con 0x7f1a340713c0 2024-03-04T08:53:07.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.346+0000 7f1a4affd640 1 -- 172.21.15.19:0/483725399 <== osd.5 v2:172.21.15.204:6800/1186499881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1a540b7ad0 con 0x7f1a340713c0 2024-03-04T08:53:07.343 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:07.343 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:07.343 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:07.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f1a340713c0 msgr2=0x7f1a340737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6800/1186499881,v1:172.21.15.204:6801/1186499881] conn(0x7f1a340713c0 0x7f1a340737e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a3406b500 msgr2=0x7f1a3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f1a3406b500 0x7f1a3406d9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b26d0 tx=0x7f1a3c008040 comp rx=0 tx=0).stop 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 msgr2=0x7f1a541580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 --2- 172.21.15.19:0/483725399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a540701e0 0x7f1a541580e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034040 tx=0x7f1a4c0046c0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a52d9d640 1 -- 172.21.15.19:0/483725399 reap_dead start 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 shutdown_connections 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 >> 172.21.15.19:0/483725399 conn(0x7f1a5409a9f0 msgr2=0x7f1a540d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 shutdown_connections 2024-03-04T08:53:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.347+0000 7f1a58d3e640 1 -- 172.21.15.19:0/483725399 wait complete. 2024-03-04T08:53:07.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-04T08:53:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.460+0000 7fa0eb439640 1 Processor -- start 2024-03-04T08:53:07.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.460+0000 7fa0eb439640 1 -- start start 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0eb439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e4158880 0x7fa0e406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0eb439640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa0e406cb90 0x7fa0e40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0eb439640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e406d030 con 0x7fa0e415b380 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0eb439640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e406d310 con 0x7fa0e406cb90 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0eb439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e406d5f0 con 0x7fa0e4158880 2024-03-04T08:53:07.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e99d6640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fa0e406cb90 0x7fa0e40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e91d5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e4158880 0x7fa0e406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e89d4640 1 --1- >> v1:172.21.15.204:6789/0 conn(0x7fa0e415b380 0x7fa0e40708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.204:6789/0 says I am v1:172.21.15.19:46332/0 (socket says 172.21.15.19:46332) 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e89d4640 1 -- 172.21.15.19:0/293384625 learned_addr learned my addr 172.21.15.19:0/293384625 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e99d6640 1 -- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e4158880 msgr2=0x7fa0e406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e99d6640 1 --2- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e4158880 0x7fa0e406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e99d6640 1 -- 172.21.15.19:0/293384625 >> v1:172.21.15.204:6789/0 conn(0x7fa0e415b380 legacy=0x7fa0e40708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0dbfff640 1 -- 172.21.15.19:0/293384625 <== mon.1 v1:172.21.15.204:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284318110 0 0) 0x7fa0e406d030 con 0x7fa0e415b380 2024-03-04T08:53:07.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.461+0000 7fa0e99d6640 1 -- 172.21.15.19:0/293384625 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e406d8d0 con 0x7fa0e406cb90 2024-03-04T08:53:07.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.462+0000 7fa0e99d6640 1 --2- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e406cb90 0x7fa0e40cd7c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009d90 tx=0x7fa0dc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=474fa8f6607e08da server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.462+0000 7fa0dbfff640 1 -- 172.21.15.19:0/293384625 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc039070 con 0x7fa0e406cb90 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.462+0000 7fa0dbfff640 1 -- 172.21.15.19:0/293384625 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc02cc50 con 0x7fa0e406cb90 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0dbfff640 1 -- 172.21.15.19:0/293384625 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc034440 con 0x7fa0e406cb90 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 -- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e406cb90 msgr2=0x7fa0e40cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 --2- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e406cb90 0x7fa0e40cd7c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009d90 tx=0x7fa0dc02bea0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 -- 172.21.15.19:0/293384625 shutdown_connections 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 --2- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e406cb90 0x7fa0e40cd7c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 --2- 172.21.15.19:0/293384625 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e4158880 0x7fa0e406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 -- 172.21.15.19:0/293384625 >> 172.21.15.19:0/293384625 conn(0x7fa0e40b1c80 msgr2=0x7fa0e40cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 -- 172.21.15.19:0/293384625 shutdown_connections 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.463+0000 7fa0eb439640 1 -- 172.21.15.19:0/293384625 wait complete. 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.464+0000 7fa0eb439640 1 Processor -- start 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.464+0000 7fa0eb439640 1 -- start start 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e4158880 0x7fa0e40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e415b380 0x7fa0e40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4071160 con 0x7fa0e406cb90 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4070fe0 con 0x7fa0e4158880 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0eb439640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40cdd00 con 0x7fa0e415b380 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0e91d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0e91d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52080/0 (socket says 172.21.15.19:52080) 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0e91d5640 1 -- 172.21.15.19:0/3316017085 learned_addr learned my addr 172.21.15.19:0/3316017085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0e99d6640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e415b380 0x7fa0e40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.465+0000 7fa0e89d4640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e4158880 0x7fa0e40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 -- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e415b380 msgr2=0x7fa0e40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e415b380 0x7fa0e40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 -- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e4158880 msgr2=0x7fa0e40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e4158880 0x7fa0e40b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 -- 172.21.15.19:0/3316017085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40aa970 con 0x7fa0e406cb90 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0e91d5640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000e9e0 tx=0x7fa0e000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0017070 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000c9d0 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e40aac50 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000cdc0 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.466+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e40ab730 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.467+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e404f330 con 0x7fa0e406cb90 2024-03-04T08:53:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.468+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0e001a070 con 0x7fa0e406cb90 2024-03-04T08:53:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.468+0000 7fa0d9ffb640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 0x7fa0c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.468+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa0e008a170 con 0x7fa0e406cb90 2024-03-04T08:53:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.468+0000 7fa0e89d4640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 0x7fa0c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.469+0000 7fa0e89d4640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 0x7fa0c806d9c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40af510 tx=0x7fa0d4007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.472+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa0e0058d30 con 0x7fa0e406cb90 2024-03-04T08:53:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.657+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0e40ad350 con 0x7fa0c806b500 2024-03-04T08:53:07.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.657+0000 7fa0d9ffb640 1 -- 172.21.15.19:0/3316017085 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0e40ad350 con 0x7fa0c806b500 2024-03-04T08:53:07.654 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-03-04T08:53:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 msgr2=0x7fa0c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 0x7fa0c806d9c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40af510 tx=0x7fa0d4007de0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 msgr2=0x7fa0e413c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000e9e0 tx=0x7fa0e000eea0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 shutdown_connections 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fa0e415b380 0x7fa0e40b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fa0c806b500 0x7fa0c806d9c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa0e4158880 0x7fa0e40b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 --2- 172.21.15.19:0/3316017085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0e406cb90 0x7fa0e413c870 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 >> 172.21.15.19:0/3316017085 conn(0x7fa0e40b1c80 msgr2=0x7fa0e40708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 shutdown_connections 2024-03-04T08:53:07.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.660+0000 7fa0eb439640 1 -- 172.21.15.19:0/3316017085 wait complete. 2024-03-04T08:53:07.667 INFO:tasks.ceph:Scrubbing osd.6 2024-03-04T08:53:07.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.776+0000 7efc4c519640 1 Processor -- start 2024-03-04T08:53:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.776+0000 7efc4c519640 1 -- start start 2024-03-04T08:53:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc4c519640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7efc44161440 0x7efc440b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc4c519640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440cf520 con 0x7efc44161820 2024-03-04T08:53:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc4c519640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440cf800 con 0x7efc440d0d20 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc4c519640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440cf2d0 con 0x7efc44161440 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc49ab4640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc44161820 0x7efc440d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32884/0 (socket says 172.21.15.19:32884) 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc49ab4640 1 -- 172.21.15.19:0/3791409085 learned_addr learned my addr 172.21.15.19:0/3791409085 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889639905 0 0) 0x7efc440cf520 con 0x7efc44161820 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc30003520 con 0x7efc44161820 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/3791409085 >> v2:172.21.15.204:3300/0 conn(0x7efc44161440 0x7efc440b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788455214 0 0) 0x7efc30003520 con 0x7efc44161820 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 >> v2:172.21.15.204:3300/0 conn(0x7efc44161440 msgr2=0x7efc440b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 --2- 172.21.15.19:0/3791409085 >> v2:172.21.15.204:3300/0 conn(0x7efc44161440 0x7efc440b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 >> v1:172.21.15.204:6789/0 conn(0x7efc440d0d20 legacy=0x7efc440b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440cfae0 con 0x7efc44161820 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.777+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3027360228 0 0) 0x7efc34001690 con 0x7efc44161820 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/3791409085 >> v2:172.21.15.204:3300/0 conn(0x7efc44161440 0x7efc440b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 >> v1:172.21.15.19:6789/0 conn(0x7efc44161820 legacy=0x7efc440d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc300039b0 0x7efc30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc30004800 0x7efc30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 0x7efc3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440cf2d0 con 0x7efc300052e0 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3000c1b0 con 0x7efc30004800 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3000c3b0 con 0x7efc300039b0 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 0x7efc3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc49ab4640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc30004800 0x7efc30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc300039b0 0x7efc30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 -- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc300039b0 msgr2=0x7efc30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc300039b0 0x7efc30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 -- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc30004800 msgr2=0x7efc30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc30004800 0x7efc30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.778+0000 7efc4aab6640 1 -- 172.21.15.19:0/3791409085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30003520 con 0x7efc300052e0 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4aab6640 1 -- 172.21.15.19:0/3791409085 reap_dead start 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4aab6640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 0x7efc3000b9c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efc40001e20 tx=0x7efc30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4196b42d13c465e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40001a70 con 0x7efc300052e0 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40003b70 con 0x7efc300052e0 2024-03-04T08:53:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc492b3640 1 -- 172.21.15.19:0/3791409085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400050d0 con 0x7efc300052e0 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4c519640 1 -- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 msgr2=0x7efc3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4c519640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 0x7efc3000b9c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efc40001e20 tx=0x7efc30005830 comp rx=0 tx=0).stop 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4c519640 1 -- 172.21.15.19:0/3791409085 shutdown_connections 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4c519640 1 --2- 172.21.15.19:0/3791409085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300052e0 0x7efc3000b9c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.779+0000 7efc4c519640 1 -- 172.21.15.19:0/3791409085 >> 172.21.15.19:0/3791409085 conn(0x7efc440d3cb0 msgr2=0x7efc440d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.780+0000 7efc4c519640 1 -- 172.21.15.19:0/3791409085 shutdown_connections 2024-03-04T08:53:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.780+0000 7efc4c519640 1 -- 172.21.15.19:0/3791409085 wait complete. 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 Processor -- start 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 -- start start 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc300052e0 0x7efc441f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc440c8660 0x7efc440c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 0x7efc44157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440b6b00 con 0x7efc44156f00 2024-03-04T08:53:07.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440d1510 con 0x7efc300052e0 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4c519640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440d0610 con 0x7efc440c8660 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.781+0000 7efc4aab6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 0x7efc44157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 0x7efc44157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52086/0 (socket says 172.21.15.19:52086) 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 -- 172.21.15.19:0/2576461856 learned_addr learned my addr 172.21.15.19:0/2576461856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc300052e0 0x7efc441f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc49ab4640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc440c8660 0x7efc440c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 -- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc440c8660 msgr2=0x7efc440c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7efc440c8660 0x7efc440c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 -- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc300052e0 msgr2=0x7efc441f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efc300052e0 0x7efc441f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc441f76f0 con 0x7efc44156f00 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4aab6640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 0x7efc44157380 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc40001f10 tx=0x7efc400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40039450 con 0x7efc44156f00 2024-03-04T08:53:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400395f0 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc44159600 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400399a0 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.782+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440c94b0 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.783+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc4404f330 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.783+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc40039b40 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc3affd640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc2806b4d0 0x7efc2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc400aba60 con 0x7efc44156f00 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc3affd640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7efc28071390 0x7efc280737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc4002ce90 con 0x7efc28071390 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc400b02a0 con 0x7efc44156f00 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc2806b4d0 0x7efc2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.784+0000 7efc49ab4640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7efc28071390 0x7efc280737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.785+0000 7efc4a2b5640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc2806b4d0 0x7efc2806d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fa0 tx=0x7efc3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.785+0000 7efc49ab4640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7efc28071390 0x7efc280737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.786+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== osd.6 v2:172.21.15.204:6824/2219646256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc4002ce90 con 0x7efc28071390 2024-03-04T08:53:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.799+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 --> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc440b75f0 con 0x7efc28071390 2024-03-04T08:53:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.799+0000 7efc3affd640 1 -- 172.21.15.19:0/2576461856 <== osd.6 v2:172.21.15.204:6824/2219646256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc440b75f0 con 0x7efc28071390 2024-03-04T08:53:07.796 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:07.796 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7efc28071390 msgr2=0x7efc280737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6824/2219646256,v1:172.21.15.204:6825/2219646256] conn(0x7efc28071390 0x7efc280737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc2806b4d0 msgr2=0x7efc2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7efc2806b4d0 0x7efc2806d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fa0 tx=0x7efc3c008040 comp rx=0 tx=0).stop 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 msgr2=0x7efc44157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 --2- 172.21.15.19:0/2576461856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44156f00 0x7efc44157380 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc40001f10 tx=0x7efc400014a0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4aab6640 1 -- 172.21.15.19:0/2576461856 reap_dead start 2024-03-04T08:53:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 shutdown_connections 2024-03-04T08:53:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 >> 172.21.15.19:0/2576461856 conn(0x7efc440d3cb0 msgr2=0x7efc440d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 shutdown_connections 2024-03-04T08:53:07.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.800+0000 7efc4c519640 1 -- 172.21.15.19:0/2576461856 wait complete. 2024-03-04T08:53:07.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-04T08:53:07.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.912+0000 7faf808b5640 1 Processor -- start 2024-03-04T08:53:07.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.912+0000 7faf808b5640 1 -- start start 2024-03-04T08:53:07.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf7c15bed0 0x7faf7c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7faf7c0d04e0 0x7faf7c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c0d1fe0 0x7faf7c15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0d2470 con 0x7faf7c15bed0 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0b2d80 con 0x7faf7c0d04e0 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf808b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0ae9c0 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf7c15bed0 0x7faf7c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf7c15bed0 0x7faf7c0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52096/0 (socket says 172.21.15.19:52096) 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 -- 172.21.15.19:0/2569069086 learned_addr learned my addr 172.21.15.19:0/2569069086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf79d9b640 1 --2- 172.21.15.19:0/2569069086 >> v2:172.21.15.204:3300/0 conn(0x7faf7c0d04e0 0x7faf7c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7ad9d640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c0d1fe0 0x7faf7c15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 -- 172.21.15.19:0/2569069086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c0d1fe0 msgr2=0x7faf7c15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c0d1fe0 0x7faf7c15fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 -- 172.21.15.19:0/2569069086 >> v2:172.21.15.204:3300/0 conn(0x7faf7c0d04e0 msgr2=0x7faf7c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:07.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 --2- 172.21.15.19:0/2569069086 >> v2:172.21.15.204:3300/0 conn(0x7faf7c0d04e0 0x7faf7c0d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.913+0000 7faf7a59c640 1 -- 172.21.15.19:0/2569069086 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0aeca0 con 0x7faf7c15bed0 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.914+0000 7faf7a59c640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c15bed0 0x7faf7c0b2480 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faf7c06e9b0 tx=0x7faf7402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48acea11fdc43059 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.914+0000 7faf7959a640 1 -- 172.21.15.19:0/2569069086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74038070 con 0x7faf7c15bed0 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.914+0000 7faf7959a640 1 -- 172.21.15.19:0/2569069086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7402f050 con 0x7faf7c15bed0 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.914+0000 7faf7959a640 1 -- 172.21.15.19:0/2569069086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74031970 con 0x7faf7c15bed0 2024-03-04T08:53:07.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 -- 172.21.15.19:0/2569069086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c15bed0 msgr2=0x7faf7c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c15bed0 0x7faf7c0b2480 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faf7c06e9b0 tx=0x7faf7402b7f0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 -- 172.21.15.19:0/2569069086 shutdown_connections 2024-03-04T08:53:07.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c0d1fe0 0x7faf7c15fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 --2- 172.21.15.19:0/2569069086 >> v2:172.21.15.204:3300/0 conn(0x7faf7c0d04e0 0x7faf7c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 --2- 172.21.15.19:0/2569069086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c15bed0 0x7faf7c0b2480 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 -- 172.21.15.19:0/2569069086 >> 172.21.15.19:0/2569069086 conn(0x7faf7c09a9f0 msgr2=0x7faf7c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:07.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 -- 172.21.15.19:0/2569069086 shutdown_connections 2024-03-04T08:53:07.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.915+0000 7faf808b5640 1 -- 172.21.15.19:0/2569069086 wait complete. 2024-03-04T08:53:07.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.916+0000 7faf808b5640 1 Processor -- start 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.916+0000 7faf808b5640 1 -- start start 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf7c0d04e0 0x7faf7c06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c15bed0 0x7faf7c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c15c2b0 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0af260 con 0x7faf7c0d04e0 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf808b5640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c06d360 con 0x7faf7c15bed0 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52104/0 (socket says 172.21.15.19:52104) 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 -- 172.21.15.19:0/4154731452 learned_addr learned my addr 172.21.15.19:0/4154731452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf7ad9d640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c15bed0 0x7faf7c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 -- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c15bed0 msgr2=0x7faf7c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c15bed0 0x7faf7c06d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf7a59c640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf7c0d04e0 0x7faf7c06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 -- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf7c0d04e0 msgr2=0x7faf7c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf7c0d04e0 0x7faf7c06c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.917+0000 7faf79d9b640 1 -- 172.21.15.19:0/4154731452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c06c750 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf79d9b640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7faf7000d800 tx=0x7faf7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70018030 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf700096a0 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c06ca30 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70009870 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.918+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c06cff0 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.919+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c04f330 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.919+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf7001b070 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.920+0000 7faf6affd640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 0x7faf5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:07.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.920+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf7008a140 con 0x7faf7c0d1fe0 2024-03-04T08:53:07.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.920+0000 7faf7a59c640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 0x7faf5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:07.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.920+0000 7faf7a59c640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 0x7faf5c06d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf74035000 tx=0x7faf74008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:07.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:07.924+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faf700592c0 con 0x7faf7c0d1fe0 2024-03-04T08:53:08.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.106+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faf7c0b31c0 con 0x7faf5c06b4d0 2024-03-04T08:53:08.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.107+0000 7faf6affd640 1 -- 172.21.15.19:0/4154731452 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf7c0b31c0 con 0x7faf5c06b4d0 2024-03-04T08:53:08.103 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-03-04T08:53:08.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 msgr2=0x7faf5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 0x7faf5c06d990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf74035000 tx=0x7faf74008030 comp rx=0 tx=0).stop 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 msgr2=0x7faf7c153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7faf7000d800 tx=0x7faf7000dcc0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 shutdown_connections 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7faf7c15bed0 0x7faf7c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c0d1fe0 0x7faf7c153200 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7faf5c06b4d0 0x7faf5c06d990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 --2- 172.21.15.19:0/4154731452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faf7c0d04e0 0x7faf7c06c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 >> 172.21.15.19:0/4154731452 conn(0x7faf7c09a9f0 msgr2=0x7faf7c159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 shutdown_connections 2024-03-04T08:53:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.109+0000 7faf808b5640 1 -- 172.21.15.19:0/4154731452 wait complete. 2024-03-04T08:53:08.116 INFO:tasks.ceph:Scrubbing osd.7 2024-03-04T08:53:08.116 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-04T08:53:08.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.226+0000 7f9f45e42640 1 Processor -- start 2024-03-04T08:53:08.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.226+0000 7f9f45e42640 1 -- start start 2024-03-04T08:53:08.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f45e42640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 0x7f9f4006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f45e42640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f40070d10 0x7f9f4015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f45e42640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400711c0 con 0x7f9f400708b0 2024-03-04T08:53:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f45e42640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400cdc10 con 0x7f9f40070d10 2024-03-04T08:53:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f45e42640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4015afe0 con 0x7f9f4015ac00 2024-03-04T08:53:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f40070d10 0x7f9f4015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9f400708b0 0x7f9f4015e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32892/0 (socket says 172.21.15.19:32892) 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3effd640 1 -- 172.21.15.19:0/4188502211 learned_addr learned my addr 172.21.15.19:0/4188502211 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3f7fe640 1 --2- 172.21.15.19:0/4188502211 >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 0x7f9f4006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3ffff640 1 -- 172.21.15.19:0/4188502211 >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 msgr2=0x7f9f4006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/4188502211 >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 0x7f9f4006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3ffff640 1 -- 172.21.15.19:0/4188502211 >> v1:172.21.15.19:6789/0 conn(0x7f9f400708b0 legacy=0x7f9f4015e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3e7fc640 1 -- 172.21.15.19:0/4188502211 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611847811 0 0) 0x7f9f400711c0 con 0x7f9f400708b0 2024-03-04T08:53:08.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3ffff640 1 -- 172.21.15.19:0/4188502211 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400cd000 con 0x7f9f40070d10 2024-03-04T08:53:08.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.227+0000 7f9f3f7fe640 1 --2- 172.21.15.19:0/4188502211 >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 0x7f9f4006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:08.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.228+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/4188502211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015eeb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9f400730c0 tx=0x7f9f3802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b104cea821267754 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.228+0000 7f9f3e7fc640 1 -- 172.21.15.19:0/4188502211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38039070 con 0x7f9f40070d10 2024-03-04T08:53:08.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.228+0000 7f9f3e7fc640 1 -- 172.21.15.19:0/4188502211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3802cbf0 con 0x7f9f40070d10 2024-03-04T08:53:08.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.228+0000 7f9f3e7fc640 1 -- 172.21.15.19:0/4188502211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38034440 con 0x7f9f40070d10 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 -- 172.21.15.19:0/4188502211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 msgr2=0x7f9f4015eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 --2- 172.21.15.19:0/4188502211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015eeb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9f400730c0 tx=0x7f9f3802be40 comp rx=0 tx=0).stop 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 -- 172.21.15.19:0/4188502211 shutdown_connections 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 --2- 172.21.15.19:0/4188502211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015eeb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 --2- 172.21.15.19:0/4188502211 >> v2:172.21.15.204:3300/0 conn(0x7f9f4015ac00 0x7f9f4006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 -- 172.21.15.19:0/4188502211 >> 172.21.15.19:0/4188502211 conn(0x7f9f400b1650 msgr2=0x7f9f400b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 -- 172.21.15.19:0/4188502211 shutdown_connections 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.229+0000 7f9f45e42640 1 -- 172.21.15.19:0/4188502211 wait complete. 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.230+0000 7f9f45e42640 1 Processor -- start 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.230+0000 7f9f45e42640 1 -- start start 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f400708b0 0x7f9f4013b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f4015ac00 0x7f9f40154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cd8a0 con 0x7f9f40070d10 2024-03-04T08:53:08.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cd5c0 con 0x7f9f400708b0 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4006ce50 con 0x7f9f4015ac00 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52108/0 (socket says 172.21.15.19:52108) 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 -- 172.21.15.19:0/979308061 learned_addr learned my addr 172.21.15.19:0/979308061 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3f7fe640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f400708b0 0x7f9f4013b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f4015ac00 0x7f9f40154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 -- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f4015ac00 msgr2=0x7f9f40154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f4015ac00 0x7f9f40154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 -- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f400708b0 msgr2=0x7f9f4013b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9f400708b0 0x7f9f4013b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40150500 con 0x7f9f40070d10 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f9f4015ac00 0x7f9f40154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f3effd640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015d4a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c4b0 tx=0x7f9f3000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30018070 con 0x7f9f40070d10 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30007500 con 0x7f9f40070d10 2024-03-04T08:53:08.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f401507e0 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.231+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30004a20 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.232+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f40150da0 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.232+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f4004f330 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f3001b070 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9f2c06b4d0 0x7f9f2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f30089260 con 0x7f9f40070d10 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7f9f2c071390 0x7f9f2c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f2c073e60 con 0x7f9f2c071390 2024-03-04T08:53:08.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f3f7fe640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9f2c06b4d0 0x7f9f2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.233+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f30090050 con 0x7f9f40070d10 2024-03-04T08:53:08.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.234+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7f9f2c071390 0x7f9f2c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.234+0000 7f9f3f7fe640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9f2c06b4d0 0x7f9f2c06d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9f4006cca0 tx=0x7f9f34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.234+0000 7f9f3ffff640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7f9f2c071390 0x7f9f2c0737b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.235+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== osd.7 v2:172.21.15.204:6816/2477088309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9f2c073e60 con 0x7f9f2c071390 2024-03-04T08:53:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.248+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 --> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f400711c0 con 0x7f9f2c071390 2024-03-04T08:53:08.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f27fff640 1 -- 172.21.15.19:0/979308061 <== osd.7 v2:172.21.15.204:6816/2477088309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9f400711c0 con 0x7f9f2c071390 2024-03-04T08:53:08.245 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-04T08:53:08.245 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T08:53:08.245 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-04T08:53:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7f9f2c071390 msgr2=0x7f9f2c0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6816/2477088309,v1:172.21.15.204:6817/2477088309] conn(0x7f9f2c071390 0x7f9f2c0737b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9f2c06b4d0 msgr2=0x7f9f2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f9f2c06b4d0 0x7f9f2c06d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9f4006cca0 tx=0x7f9f34008040 comp rx=0 tx=0).stop 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 msgr2=0x7f9f4015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 --2- 172.21.15.19:0/979308061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f40070d10 0x7f9f4015d4a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c4b0 tx=0x7f9f3000c970 comp rx=0 tx=0).stop 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f3ffff640 1 -- 172.21.15.19:0/979308061 reap_dead start 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 shutdown_connections 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 >> 172.21.15.19:0/979308061 conn(0x7f9f400b1650 msgr2=0x7f9f40071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 shutdown_connections 2024-03-04T08:53:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.249+0000 7f9f45e42640 1 -- 172.21.15.19:0/979308061 wait complete. 2024-03-04T08:53:08.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-04T08:53:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.361+0000 7f6948feb640 1 Processor -- start 2024-03-04T08:53:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.361+0000 7f6948feb640 1 -- start start 2024-03-04T08:53:08.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6948feb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 0x7f69440b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6948feb640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69440b2910 0x7f69440d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6948feb640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694415e3f0 con 0x7f694415e010 2024-03-04T08:53:08.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6948feb640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440b1f40 con 0x7f69440b2910 2024-03-04T08:53:08.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6948feb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b1c10 con 0x7f69440b3240 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69440b2910 0x7f69440d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69440b2910 0x7f69440d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52112/0 (socket says 172.21.15.19:52112) 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 -- 172.21.15.19:0/2800339899 learned_addr learned my addr 172.21.15.19:0/2800339899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6941d9b640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 0x7f69440b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 -- 172.21.15.19:0/2800339899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 msgr2=0x7f69440b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 0x7f69440b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 -- 172.21.15.19:0/2800339899 >> v1:172.21.15.204:6789/0 conn(0x7f694415e010 legacy=0x7f69440cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6942d9d640 1 -- 172.21.15.19:0/2800339899 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694406d1b0 con 0x7f69440b2910 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.362+0000 7f6941d9b640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 0x7f69440b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.363+0000 7f6942d9d640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69440b2910 0x7f69440d1ad0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6934009e80 tx=0x7f693402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6221cc3faa2de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.363+0000 7f694159a640 1 -- 172.21.15.19:0/2800339899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693402c9c0 con 0x7f69440b2910 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.363+0000 7f694159a640 1 -- 172.21.15.19:0/2800339899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693402cb60 con 0x7f69440b2910 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.363+0000 7f694159a640 1 -- 172.21.15.19:0/2800339899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69340343f0 con 0x7f69440b2910 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 -- 172.21.15.19:0/2800339899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69440b2910 msgr2=0x7f69440d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69440b2910 0x7f69440d1ad0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6934009e80 tx=0x7f693402be20 comp rx=0 tx=0).stop 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 -- 172.21.15.19:0/2800339899 shutdown_connections 2024-03-04T08:53:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69440b2910 0x7f69440d1ad0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 --2- 172.21.15.19:0/2800339899 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f69440b3240 0x7f69440b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 -- 172.21.15.19:0/2800339899 >> 172.21.15.19:0/2800339899 conn(0x7f694409a9f0 msgr2=0x7f694409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 -- 172.21.15.19:0/2800339899 shutdown_connections 2024-03-04T08:53:08.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.364+0000 7f6948feb640 1 -- 172.21.15.19:0/2800339899 wait complete. 2024-03-04T08:53:08.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.365+0000 7f6948feb640 1 Processor -- start 2024-03-04T08:53:08.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.365+0000 7f6948feb640 1 -- start start 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694415e010 0x7f6944158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f694414f3e0 0x7f69440cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440d2010 con 0x7f694415e5c0 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694406ced0 con 0x7f694414f3e0 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6948feb640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440d2190 con 0x7f694415e010 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52118/0 (socket says 172.21.15.19:52118) 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 -- 172.21.15.19:0/2803372350 learned_addr learned my addr 172.21.15.19:0/2803372350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6942d9d640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f694414f3e0 0x7f69440cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f694259c640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694415e010 0x7f6944158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 -- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694415e010 msgr2=0x7f6944158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694415e010 0x7f6944158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 -- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f694414f3e0 msgr2=0x7f69440cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f694414f3e0 0x7f69440cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.366+0000 7f6941d9b640 1 -- 172.21.15.19:0/2803372350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69441f71f0 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f6941d9b640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c7f0 tx=0x7f692c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c015070 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c007a30 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c007e00 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69441f74d0 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.367+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69441f7a90 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.368+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694404f330 con 0x7f694415e5c0 2024-03-04T08:53:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.368+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f692c018070 con 0x7f694415e5c0 2024-03-04T08:53:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.369+0000 7f693affd640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 0x7f692406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.369+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f692c089dc0 con 0x7f694415e5c0 2024-03-04T08:53:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.369+0000 7f694259c640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 0x7f692406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.369+0000 7f694259c640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 0x7f692406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f69440d0af0 tx=0x7f693c009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.373+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f692c058980 con 0x7f694415e5c0 2024-03-04T08:53:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.552+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f69440d2980 con 0x7f692406b4d0 2024-03-04T08:53:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.552+0000 7f693affd640 1 -- 172.21.15.19:0/2803372350 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f69440d2980 con 0x7f692406b4d0 2024-03-04T08:53:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 msgr2=0x7f692406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 0x7f692406d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f69440d0af0 tx=0x7f693c009060 comp rx=0 tx=0).stop 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 msgr2=0x7f69441f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c7f0 tx=0x7f692c00cbf0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 shutdown_connections 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f692406b4d0 0x7f692406d990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f694414f3e0 0x7f69440cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f694415e5c0 0x7f69441f4590 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 --2- 172.21.15.19:0/2803372350 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f694415e010 0x7f6944158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 >> 172.21.15.19:0/2803372350 conn(0x7f694409a9f0 msgr2=0x7f69440ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 shutdown_connections 2024-03-04T08:53:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.554+0000 7f6948feb640 1 -- 172.21.15.19:0/2803372350 wait complete. 2024-03-04T08:53:08.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:53:08.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 Processor -- start 2024-03-04T08:53:08.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 -- start start 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed940d22b0 0x7fed940d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7fed940b41f0 0x7fed940b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed940b3430 con 0x7fed9415dfe0 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed940d2c50 con 0x7fed940d22b0 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed99d8a640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed940b31e0 con 0x7fed940b41f0 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed92ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed940d22b0 0x7fed940d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed92ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed940d22b0 0x7fed940d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52134/0 (socket says 172.21.15.19:52134) 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed92ffd640 1 -- 172.21.15.19:0/1285775289 learned_addr learned my addr 172.21.15.19:0/1285775289 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.667+0000 7fed937fe640 1 --1- 172.21.15.19:0/1285775289 >> v1:172.21.15.19:6789/0 conn(0x7fed9415dfe0 0x7fed940cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:32896/0 (socket says 172.21.15.19:32896) 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed93fff640 1 --2- 172.21.15.19:0/1285775289 >> v2:172.21.15.204:3300/0 conn(0x7fed940b41f0 0x7fed940b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed92ffd640 1 -- 172.21.15.19:0/1285775289 >> v2:172.21.15.204:3300/0 conn(0x7fed940b41f0 msgr2=0x7fed940b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed92ffd640 1 --2- 172.21.15.19:0/1285775289 >> v2:172.21.15.204:3300/0 conn(0x7fed940b41f0 0x7fed940b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed92ffd640 1 -- 172.21.15.19:0/1285775289 >> v1:172.21.15.19:6789/0 conn(0x7fed9415dfe0 legacy=0x7fed940cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed927fc640 1 -- 172.21.15.19:0/1285775289 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014885768 0 0) 0x7fed940b3430 con 0x7fed9415dfe0 2024-03-04T08:53:08.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.668+0000 7fed92ffd640 1 -- 172.21.15.19:0/1285775289 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed940b3710 con 0x7fed940d22b0 2024-03-04T08:53:08.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed92ffd640 1 --2- 172.21.15.19:0/1285775289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed940d22b0 0x7fed940d2710 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fed88009870 tx=0x7fed8802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75138fcada70b6d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed927fc640 1 -- 172.21.15.19:0/1285775289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88034070 con 0x7fed940d22b0 2024-03-04T08:53:08.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed927fc640 1 -- 172.21.15.19:0/1285775289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88030860 con 0x7fed940d22b0 2024-03-04T08:53:08.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed927fc640 1 -- 172.21.15.19:0/1285775289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88030c30 con 0x7fed940d22b0 2024-03-04T08:53:08.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 -- 172.21.15.19:0/1285775289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed940d22b0 msgr2=0x7fed940d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 --2- 172.21.15.19:0/1285775289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed940d22b0 0x7fed940d2710 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fed88009870 tx=0x7fed8802b9a0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 -- 172.21.15.19:0/1285775289 shutdown_connections 2024-03-04T08:53:08.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 --2- 172.21.15.19:0/1285775289 >> v2:172.21.15.204:3300/0 conn(0x7fed940b41f0 0x7fed940b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 --2- 172.21.15.19:0/1285775289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed940d22b0 0x7fed940d2710 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 -- 172.21.15.19:0/1285775289 >> 172.21.15.19:0/1285775289 conn(0x7fed940d3cd0 msgr2=0x7fed940d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 -- 172.21.15.19:0/1285775289 shutdown_connections 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.669+0000 7fed99d8a640 1 -- 172.21.15.19:0/1285775289 wait complete. 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.670+0000 7fed99d8a640 1 Processor -- start 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 -- start start 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 0x7fed9415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed940d22b0 0x7fed941530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940cfa00 con 0x7fed9415dfe0 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940b3d60 con 0x7fed940d22b0 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed99d8a640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed940d1c70 con 0x7fed940b41f0 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52146/0 (socket says 172.21.15.19:52146) 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.671+0000 7fed93fff640 1 -- 172.21.15.19:0/4255507356 learned_addr learned my addr 172.21.15.19:0/4255507356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed92ffd640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed940d22b0 0x7fed941530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed937fe640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 0x7fed9415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 -- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 msgr2=0x7fed9415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 0x7fed9415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 -- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed940d22b0 msgr2=0x7fed941530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed940d22b0 0x7fed941530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 -- 172.21.15.19:0/4255507356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9415e900 con 0x7fed9415dfe0 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed937fe640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 0x7fed9415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed93fff640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00efc0 tx=0x7fed8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c018020 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c014480 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9415eba0 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c014870 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.672+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9415f160 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.673+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9404f330 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.674+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed8c005d10 con 0x7fed9415dfe0 2024-03-04T08:53:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.674+0000 7fed7bfff640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 0x7fed8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.674+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fed8c08a9e0 con 0x7fed9415dfe0 2024-03-04T08:53:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.674+0000 7fed937fe640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 0x7fed8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.675+0000 7fed937fe640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 0x7fed8006d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed84000f60 tx=0x7fed84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.678+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed8c022070 con 0x7fed9415dfe0 2024-03-04T08:53:08.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.855+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed940b34f0 con 0x7fed8006b4d0 2024-03-04T08:53:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.856+0000 7fed7bfff640 1 -- 172.21.15.19:0/4255507356 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13405 (secure 0 0 0) 0x7fed940b34f0 con 0x7fed8006b4d0 2024-03-04T08:53:08.852 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:08.852 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:53:08.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 msgr2=0x7fed8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 0x7fed8006d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fed84000f60 tx=0x7fed84009040 comp rx=0 tx=0).stop 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 msgr2=0x7fed940b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00efc0 tx=0x7fed8c00c490 comp rx=0 tx=0).stop 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 shutdown_connections 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed9415dfe0 0x7fed940b8530 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fed8006b4d0 0x7fed8006d990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fed940d22b0 0x7fed941530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 --2- 172.21.15.19:0/4255507356 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fed940b41f0 0x7fed9415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 >> 172.21.15.19:0/4255507356 conn(0x7fed940d3cd0 msgr2=0x7fed9415ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 shutdown_connections 2024-03-04T08:53:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:08.858+0000 7fed99d8a640 1 -- 172.21.15.19:0/4255507356 wait complete. 2024-03-04T08:53:08.865 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-03-04T08:53:07.172785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":230484,"kb_used_data":5992,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744236,"statfs":{"total":773094113280,"available":772858097664,"internally_reserved":0,"allocated":6135808,"data_stored":3232384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17096,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-69,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001750"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-04T08:53:01.784896+0000","last_change":"2024-03-04T08:50:33.067179+0000","last_active":"2024-03-04T08:53:01.784896+0000","last_peered":"2024-03-04T08:53:01.784896+0000","last_clean":"2024-03-04T08:53:01.784896+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:53:01.784896+0000","last_undegraded":"2024-03-04T08:53:01.784896+0000","last_fullsized":"2024-03-04T08:53:01.784896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T08:50:30.141499+0000","last_clean_scrub_stamp":"2024-03-04T08:50:30.141499+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:01.120737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:53:08.869 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T08:50:30.141499+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=50, tm_sec=30, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=8, tm_min=53, tm_sec=3, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T08:53:08.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T08:53:14.870 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:14.874 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:28.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T08:53:28.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.991+0000 7fac2be1c640 1 Processor -- start 2024-03-04T08:53:28.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 -- start start 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac240d22b0 0x7fac240d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240b41f0 0x7fac240b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b3430 con 0x7fac2415dfe0 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac240d2c50 con 0x7fac240d22b0 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.992+0000 7fac2be1c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b31e0 con 0x7fac240b41f0 2024-03-04T08:53:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac240d22b0 0x7fac240d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac240d22b0 0x7fac240d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38962/0 (socket says 172.21.15.19:38962) 2024-03-04T08:53:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 -- 172.21.15.19:0/3573226081 learned_addr learned my addr 172.21.15.19:0/3573226081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac2a3b9640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240b41f0 0x7fac240b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 -- 172.21.15.19:0/3573226081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240b41f0 msgr2=0x7fac240b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240b41f0 0x7fac240b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 -- 172.21.15.19:0/3573226081 >> v1:172.21.15.204:6789/0 conn(0x7fac2415dfe0 legacy=0x7fac240cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.993+0000 7fac293b7640 1 -- 172.21.15.19:0/3573226081 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240b3710 con 0x7fac240d22b0 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac293b7640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac240d22b0 0x7fac240d2710 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fac18009870 tx=0x7fac1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3e7d332422f09b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac28bb6640 1 -- 172.21.15.19:0/3573226081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18035020 con 0x7fac240d22b0 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac28bb6640 1 -- 172.21.15.19:0/3573226081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac18031640 con 0x7fac240d22b0 2024-03-04T08:53:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac28bb6640 1 -- 172.21.15.19:0/3573226081 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1802d040 con 0x7fac240d22b0 2024-03-04T08:53:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 -- 172.21.15.19:0/3573226081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac240d22b0 msgr2=0x7fac240d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac240d22b0 0x7fac240d2710 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fac18009870 tx=0x7fac1802b8f0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 -- 172.21.15.19:0/3573226081 shutdown_connections 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240b41f0 0x7fac240b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 --2- 172.21.15.19:0/3573226081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac240d22b0 0x7fac240d2710 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.994+0000 7fac2be1c640 1 -- 172.21.15.19:0/3573226081 >> 172.21.15.19:0/3573226081 conn(0x7fac240d3cd0 msgr2=0x7fac240d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.995+0000 7fac2be1c640 1 -- 172.21.15.19:0/3573226081 shutdown_connections 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.995+0000 7fac2be1c640 1 -- 172.21.15.19:0/3573226081 wait complete. 2024-03-04T08:53:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 Processor -- start 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 -- start start 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac240b41f0 0x7fac2415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 0x7fac24147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240cfa00 con 0x7fac2415dfe0 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b3d60 con 0x7fac240b41f0 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.996+0000 7fac2be1c640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240d1c70 con 0x7fac240d22b0 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38976/0 (socket says 172.21.15.19:38976) 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 -- 172.21.15.19:0/4172313617 learned_addr learned my addr 172.21.15.19:0/4172313617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac29bb8640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac240b41f0 0x7fac2415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac293b7640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 0x7fac24147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 -- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 msgr2=0x7fac24147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 0x7fac24147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 -- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac240b41f0 msgr2=0x7fac2415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac240b41f0 0x7fac2415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 -- 172.21.15.19:0/4172313617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24148430 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac293b7640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 0x7fac24147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2a3b9640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fac14007e70 tx=0x7fac1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14014620 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14019070 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac240b9b90 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14014a20 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.997+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240b6c20 con 0x7fac2415dfe0 2024-03-04T08:53:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.998+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2404f330 con 0x7fac2415dfe0 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.999+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac14014bc0 con 0x7fac2415dfe0 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.999+0000 7fac227fc640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 0x7fac1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:28.999+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac1408a770 con 0x7fac2415dfe0 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.000+0000 7fac29bb8640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 0x7fac1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.000+0000 7fac29bb8640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 0x7fac1006d990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f60 tx=0x7fac1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.004+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fac140598f0 con 0x7fac2415dfe0 2024-03-04T08:53:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.182+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 --> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac240ce7a0 con 0x7fac1006b4d0 2024-03-04T08:53:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.184+0000 7fac227fc640 1 -- 172.21.15.19:0/4172313617 <== mgr.4106 v2:172.21.15.204:6832/588123878 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13359 (secure 0 0 0) 0x7fac240ce7a0 con 0x7fac1006b4d0 2024-03-04T08:53:29.179 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 msgr2=0x7fac1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 0x7fac1006d990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f60 tx=0x7fac1c009040 comp rx=0 tx=0).stop 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 msgr2=0x7fac2414a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fac14007e70 tx=0x7fac1400e4b0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 shutdown_connections 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac2415dfe0 0x7fac2414a110 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7fac240d22b0 0x7fac24147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7fac1006b4d0 0x7fac1006d990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 --2- 172.21.15.19:0/4172313617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fac240b41f0 0x7fac2415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 >> 172.21.15.19:0/4172313617 conn(0x7fac240d3cd0 msgr2=0x7fac240b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 shutdown_connections 2024-03-04T08:53:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.185+0000 7fac2be1c640 1 -- 172.21.15.19:0/4172313617 wait complete. 2024-03-04T08:53:29.192 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-03-04T08:53:29.177696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":230472,"kb_used_data":5992,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6135808,"data_stored":3232384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002584"},"pg_stats":[{"pgid":"1.0","version":"52'119","reported_seq":239,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-04T08:53:09.444825+0000","last_change":"2024-03-04T08:53:09.444890+0000","last_active":"2024-03-04T08:53:09.444825+0000","last_peered":"2024-03-04T08:53:09.444825+0000","last_clean":"2024-03-04T08:53:09.444825+0000","last_became_active":"2024-03-04T08:50:33.065930+0000","last_became_peered":"2024-03-04T08:50:33.065930+0000","last_unstale":"2024-03-04T08:53:09.444825+0000","last_undegraded":"2024-03-04T08:53:09.444825+0000","last_fullsized":"2024-03-04T08:53:09.444825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'119","last_scrub_stamp":"2024-03-04T08:53:09.444722+0000","last_deep_scrub":"52'119","last_deep_scrub_stamp":"2024-03-04T08:53:09.444722+0000","last_clean_scrub_stamp":"2024-03-04T08:53:09.444722+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:51.443931+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1212416,"data_stored":846824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":618496,"data_stored":256456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T08:53:29.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-04T08:53:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 Processor -- start 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 -- start start 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 --2- >> v2:172.21.15.204:3300/0 conn(0x7f0cfc0b55e0 0x7f0cfc169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc06b710 con 0x7f0cfc066d90 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc06b150 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0d01913640 1 -- --> v2:172.21.15.204:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b61c0 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0cfa7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0cfc066d90 0x7f0cfc0b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42038/0 (socket says 172.21.15.19:42038) 2024-03-04T08:53:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.299+0000 7f0cfa7fc640 1 -- 172.21.15.19:0/1943194401 learned_addr learned my addr 172.21.15.19:0/1943194401 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cfb7fe640 1 --2- 172.21.15.19:0/1943194401 >> v2:172.21.15.204:3300/0 conn(0x7f0cfc0b55e0 0x7f0cfc169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10904262 0 0) 0x7f0cfc06b710 con 0x7f0cfc066d90 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce8003520 con 0x7f0cfc066d90 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/1943194401 >> v1:172.21.15.204:6789/0 conn(0x7f0cfc0cf9a0 legacy=0x7f0cfc0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/1943194401 >> v1:172.21.15.19:6789/0 conn(0x7f0cfc066d90 legacy=0x7f0cfc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795612116 0 0) 0x7f0ce8003520 con 0x7f0cfc066d90 2024-03-04T08:53:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.300+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/1943194401 --> v2:172.21.15.204:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc06b430 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.301+0000 7f0cfb7fe640 1 --2- 172.21.15.19:0/1943194401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc169140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009d90 tx=0x7f0cf402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68b53df9831c4a45 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.301+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4039070 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.301+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf402c940 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.301+0000 7f0cf9ffb640 1 -- 172.21.15.19:0/1943194401 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4001670 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 -- 172.21.15.19:0/1943194401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 msgr2=0x7f0cfc169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 --2- 172.21.15.19:0/1943194401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc169140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009d90 tx=0x7f0cf402be10 comp rx=0 tx=0).stop 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 -- 172.21.15.19:0/1943194401 shutdown_connections 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 --2- 172.21.15.19:0/1943194401 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc169140 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 -- 172.21.15.19:0/1943194401 >> 172.21.15.19:0/1943194401 conn(0x7f0cfc0b1d70 msgr2=0x7f0cfc0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 -- 172.21.15.19:0/1943194401 shutdown_connections 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.302+0000 7f0d01913640 1 -- 172.21.15.19:0/1943194401 wait complete. 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.303+0000 7f0d01913640 1 Processor -- start 2024-03-04T08:53:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.303+0000 7f0d01913640 1 -- start start 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 0x7f0cfc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc1f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0cf050 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b0c50 con 0x7f0cfc0b55e0 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0cf1d0 con 0x7f0cfc066d90 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38992/0 (socket says 172.21.15.19:38992) 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/2027179366 learned_addr learned my addr 172.21.15.19:0/2027179366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfa7fc640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc1f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfaffd640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 0x7f0cfc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 msgr2=0x7f0cfc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 0x7f0cfc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 msgr2=0x7f0cfc1f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc1f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 -- 172.21.15.19:0/2027179366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc1f5150 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfa7fc640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc1f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfaffd640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 0x7f0cfc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cfb7fe640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4037040 tx=0x7f0cf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4044020 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4034d10 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4039040 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0c7dd0 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.304+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc0c80b0 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.305+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc09e3d0 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.306+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cf4047020 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.306+0000 7f0cf3fff640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 0x7f0cdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.307+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0cf40ac740 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.307+0000 7f0cfaffd640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 0x7f0cdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.307+0000 7f0cfaffd640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 0x7f0cdc06d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000f60 tx=0x7f0cec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.311+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0cf404e030 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.493+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0cfc068ff0 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.496+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0cfc1f5150 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.497+0000 7f0cf3fff640 1 -- 172.21.15.19:0/2027179366 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cf407b820 con 0x7f0cfc0cf9a0 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 msgr2=0x7f0cdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 0x7f0cdc06d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000f60 tx=0x7f0cec009040 comp rx=0 tx=0).stop 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 msgr2=0x7f0cfc157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4037040 tx=0x7f0cf4004a40 comp rx=0 tx=0).stop 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 shutdown_connections 2024-03-04T08:53:29.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cfc0cf9a0 0x7f0cfc157d70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f0cdc06b4d0 0x7f0cdc06d990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0cfc0b55e0 0x7f0cfc1f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 --2- 172.21.15.19:0/2027179366 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f0cfc066d90 0x7f0cfc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 >> 172.21.15.19:0/2027179366 conn(0x7f0cfc0b1d70 msgr2=0x7f0cfc0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 shutdown_connections 2024-03-04T08:53:29.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.498+0000 7f0d01913640 1 -- 172.21.15.19:0/2027179366 wait complete. 2024-03-04T08:53:29.505 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T08:53:29.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T08:53:29.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.611+0000 7f2127cdf640 1 Processor -- start 2024-03-04T08:53:29.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.611+0000 7f2127cdf640 1 -- start start 2024-03-04T08:53:29.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2127cdf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212013dc10 0x7f21200b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2127cdf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 0x7f21200b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2127cdf640 1 -- --> v1:172.21.15.204:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212015f580 con 0x7f212015bf30 2024-03-04T08:53:29.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2127cdf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200cf3f0 con 0x7f212013dc10 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2127cdf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212015b210 con 0x7f212015ef60 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212013dc10 0x7f21200b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f212013dc10 0x7f21200b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38994/0 (socket says 172.21.15.19:38994) 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 -- 172.21.15.19:0/3135926639 learned_addr learned my addr 172.21.15.19:0/3135926639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 -- 172.21.15.19:0/3135926639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 msgr2=0x7f21200b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f212627c640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 0x7f21200b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 0x7f21200b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 -- 172.21.15.19:0/3135926639 >> v1:172.21.15.204:6789/0 conn(0x7f212015bf30 legacy=0x7f212015e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f2125a7b640 1 -- 172.21.15.19:0/3135926639 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212015b450 con 0x7f212013dc10 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.612+0000 7f212627c640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 0x7f21200b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.613+0000 7f2125a7b640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212013dc10 0x7f21200b2950 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f211c009870 tx=0x7f211c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e640caa5b673933 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.613+0000 7f2124a79640 1 -- 172.21.15.19:0/3135926639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0317c0 con 0x7f212013dc10 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.613+0000 7f2124a79640 1 -- 172.21.15.19:0/3135926639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f211c037070 con 0x7f212013dc10 2024-03-04T08:53:29.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.613+0000 7f2124a79640 1 -- 172.21.15.19:0/3135926639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c031ba0 con 0x7f212013dc10 2024-03-04T08:53:29.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 -- 172.21.15.19:0/3135926639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212013dc10 msgr2=0x7f21200b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212013dc10 0x7f21200b2950 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f211c009870 tx=0x7f211c02b860 comp rx=0 tx=0).stop 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 -- 172.21.15.19:0/3135926639 shutdown_connections 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015ef60 0x7f21200b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 --2- 172.21.15.19:0/3135926639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212013dc10 0x7f21200b2950 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 -- 172.21.15.19:0/3135926639 >> 172.21.15.19:0/3135926639 conn(0x7f21200cf8a0 msgr2=0x7f21200cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 -- 172.21.15.19:0/3135926639 shutdown_connections 2024-03-04T08:53:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.614+0000 7f2127cdf640 1 -- 172.21.15.19:0/3135926639 wait complete. 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.615+0000 7f2127cdf640 1 Processor -- start 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.615+0000 7f2127cdf640 1 -- start start 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 0x7f2120154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 --2- >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015bf30 0x7f212013a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200cd7a0 con 0x7f212015ef60 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212013dff0 con 0x7f212013dc10 2024-03-04T08:53:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 -- --> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200cd920 con 0x7f212015bf30 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39006/0 (socket says 172.21.15.19:39006) 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 -- 172.21.15.19:0/851992829 learned_addr learned my addr 172.21.15.19:0/851992829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2125a7b640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 0x7f2120154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212527a640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015bf30 0x7f212013a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 -- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015bf30 msgr2=0x7f212013a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015bf30 0x7f212013a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 -- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 msgr2=0x7f2120154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 0x7f2120154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 -- 172.21.15.19:0/851992829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21201419b0 con 0x7f212015ef60 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2125a7b640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 0x7f2120154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f212627c640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f211800cd50 tx=0x7f211800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800f680 con 0x7f212015ef60 2024-03-04T08:53:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f211800f840 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212013e210 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800fc50 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.616+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212013e7d0 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.617+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212004f330 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.618+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21180213f0 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.618+0000 7f21167fc640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 0x7f210406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.618+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f211808ae20 con 0x7f212015ef60 2024-03-04T08:53:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.618+0000 7f2125a7b640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 0x7f210406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T08:53:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.619+0000 7f2125a7b640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 0x7f210406d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f211c036000 tx=0x7f211c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T08:53:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.622+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f21201419b0 con 0x7f212015ef60 2024-03-04T08:53:29.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.845+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f212006eb00 con 0x7f212015ef60 2024-03-04T08:53:29.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.846+0000 7f21167fc640 1 -- 172.21.15.19:0/851992829 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f2118014030 con 0x7f212015ef60 2024-03-04T08:53:29.843 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-04T08:53:29.844 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/3266876882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6835","nonce":3266876882},{"type":"v1","addr":"172.21.15.204:6837","nonce":3266876882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/46962108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":46962108},{"type":"v1","addr":"172.21.15.19:6835","nonce":46962108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6836/2752757038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":2752757038},{"type":"v1","addr":"172.21.15.204:6836","nonce":2752757038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":6429,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/777125935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":777125935},{"type":"v1","addr":"172.21.15.19:6833","nonce":777125935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2024-03-04T08:53:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 msgr2=0x7f210406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 0x7f210406d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f211c036000 tx=0x7f211c03d040 comp rx=0 tx=0).stop 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 msgr2=0x7f212013a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f211800cd50 tx=0x7f211800a650 comp rx=0 tx=0).stop 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 shutdown_connections 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f212015ef60 0x7f212013a6c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3301/0,v1:172.21.15.204:6790/0] conn(0x7f212015bf30 0x7f212013a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:6832/588123878,v1:172.21.15.204:6833/588123878] conn(0x7f210406b4d0 0x7f210406d990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 --2- 172.21.15.19:0/851992829 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f212013dc10 0x7f2120154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T08:53:29.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 >> 172.21.15.19:0/851992829 conn(0x7f21200cf8a0 msgr2=0x7f212013b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T08:53:29.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.847+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 shutdown_connections 2024-03-04T08:53:29.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-04T08:53:29.848+0000 7f2127cdf640 1 -- 172.21.15.19:0/851992829 wait complete. 2024-03-04T08:53:29.856 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-04T08:53:29.856 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-04T08:53:29.857 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-04T08:53:29.857 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:29.885 INFO:tasks.ceph.mds.a:Stopped 2024-03-04T08:53:29.886 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-04T08:53:29.886 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:29.937 INFO:tasks.ceph.mds.c:Stopped 2024-03-04T08:53:29.938 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-04T08:53:29.938 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:29.950 INFO:tasks.ceph.mds.b:Stopped 2024-03-04T08:53:29.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-04T08:53:29.951 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.013 INFO:tasks.ceph.mds.d:Stopped 2024-03-04T08:53:30.014 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-04T08:53:30.014 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-04T08:53:30.014 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.043 INFO:tasks.ceph.osd.0:Stopped 2024-03-04T08:53:30.044 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-04T08:53:30.044 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.118 INFO:tasks.ceph.osd.1:Stopped 2024-03-04T08:53:30.118 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-04T08:53:30.118 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.188 INFO:tasks.ceph.osd.2:Stopped 2024-03-04T08:53:30.188 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-04T08:53:30.188 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.264 INFO:tasks.ceph.osd.3:Stopped 2024-03-04T08:53:30.264 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-04T08:53:30.264 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.308 INFO:tasks.ceph.osd.4:Stopped 2024-03-04T08:53:30.308 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-04T08:53:30.308 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.386 INFO:tasks.ceph.osd.5:Stopped 2024-03-04T08:53:30.386 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-04T08:53:30.386 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.471 INFO:tasks.ceph.osd.6:Stopped 2024-03-04T08:53:30.471 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-04T08:53:30.471 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.554 INFO:tasks.ceph.osd.7:Stopped 2024-03-04T08:53:30.554 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-04T08:53:30.554 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-04T08:53:30.554 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.581 INFO:tasks.ceph.mgr.y:Stopped 2024-03-04T08:53:30.581 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-04T08:53:30.582 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.627 INFO:tasks.ceph.mgr.x:Stopped 2024-03-04T08:53:30.628 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-04T08:53:30.628 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-04T08:53:30.628 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.641 INFO:tasks.ceph.mon.a:Stopped 2024-03-04T08:53:30.641 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-04T08:53:30.641 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.683 INFO:tasks.ceph.mon.b:Stopped 2024-03-04T08:53:30.684 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-04T08:53:30.684 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T08:53:30.739 INFO:tasks.ceph.mon.c:Stopped 2024-03-04T08:53:30.740 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-04T08:53:30.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-04T08:53:30.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:53:30.779 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-04T08:53:31.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:53:31.009 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-04T08:53:31.108 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:53:31.109 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-04T08:53:31.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:53:31.168 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-04T08:53:31.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:53:31.226 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-04T08:53:31.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:53:31.386 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-04T08:53:31.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:53:31.457 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-04T08:53:31.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:53:31.524 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-04T08:53:31.582 INFO:tasks.ceph:Archiving mon data... 2024-03-04T08:53:31.941 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/data/mon.a.tgz 2024-03-04T08:53:31.942 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-03-04T08:53:31.959 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.Gjiz3BB6vS 2024-03-04T08:53:31.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Gjiz3BB6vS 2024-03-04T08:53:32.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.Gjiz3BB6vS 2024-03-04T08:53:32.222 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.Gjiz3BB6vS is 337KB 2024-03-04T08:53:32.321 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.Gjiz3BB6vS 2024-03-04T08:53:32.336 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/data/mon.b.tgz 2024-03-04T08:53:32.336 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-04T08:53:32.356 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.W35zyUE84U 2024-03-04T08:53:32.356 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.W35zyUE84U 2024-03-04T08:53:32.527 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.W35zyUE84U 2024-03-04T08:53:32.613 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.W35zyUE84U is 445KB 2024-03-04T08:53:32.712 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.W35zyUE84U 2024-03-04T08:53:32.726 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/data/mon.c.tgz 2024-03-04T08:53:32.727 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-03-04T08:53:32.781 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.Yo6mGmud8h 2024-03-04T08:53:32.781 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Yo6mGmud8h 2024-03-04T08:53:32.932 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.Yo6mGmud8h 2024-03-04T08:53:33.016 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.Yo6mGmud8h is 445KB 2024-03-04T08:53:33.114 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.Yo6mGmud8h 2024-03-04T08:53:33.129 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-04T08:53:33.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T08:53:33.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T08:53:33.218 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T08:53:33.251 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T08:53:33.252 INFO:tasks.ceph:Archiving crash dumps... 2024-03-04T08:53:33.254 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi019/crash 2024-03-04T08:53:33.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T08:53:33.288 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi204/crash 2024-03-04T08:53:33.289 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T08:53:33.317 INFO:tasks.ceph:Shutting down logrotate 2024-03-04T08:53:33.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:33.333 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:33.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:33.440 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-04T08:53:33.466 INFO:tasks.ceph:Compressing logs... 2024-03-04T08:53:33.466 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T08:53:33.482 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T08:53:33.560 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-04T08:53:33.560 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38257.log 2024-03-04T08:53:33.560 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44695.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38257.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.3.44695.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38537.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.3.44695.log.gz 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38417.log 2024-03-04T08:53:33.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.38537.log.gz -5 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr: --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38417.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38417.log.gz 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44242.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.1.44242.log: gzip 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38297.log 2024-03-04T08:53:33.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38457.log: 89.3% -- replaced with /var/log/ceph/ceph-client.1.44242.log.gz 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38297.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.38497.log 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38297.log.gz 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38337.log 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38497.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38497.log.gz 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-04T08:53:33.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38337.log: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T08:53:33.564 INFO:teuthology.orchestra.run.smithi204.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38337.log.gz 2024-03-04T08:53:33.564 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-04T08:53:33.564 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-04T08:53:33.564 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-04T08:53:33.564 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2024-03-04T08:53:33.566 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.c.log: 91.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-04T08:53:33.571 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.38377.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz 2024-03-04T08:53:33.603 INFO:teuthology.orchestra.run.smithi204.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-04T08:53:33.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60030.log 2024-03-04T08:53:33.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61505.log 2024-03-04T08:53:33.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52638.log 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61505.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60030.log.gzgzip 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61169.log 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61505.log.gz 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61547.log 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49638.log 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52638.log.gz 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61169.log.gz 2024-03-04T08:53:33.664 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61547.log.gz 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49638.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58141.log 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49638.log.gz 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60408.log 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58141.log.gz/var/log/ceph/ceph-client.admin.51767.log: 2024-03-04T08:53:33.665 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51725.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60408.log.gz 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%/var/log/ceph/ceph-client.admin.56117.log: -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-03-04T08:53:33.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57831.log 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49392.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57831.log.gzgzip 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58727.log 2024-03-04T08:53:33.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55552.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43376.log 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46793.log 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43376.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.51497.log 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58727.log.gz 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.2.46793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61127.log 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-03-04T08:53:33.668 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61127.log: 90.7% -- replaced with /var/log/ceph/ceph-client.2.46793.log.gz 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48756.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61127.log.gz 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2024-03-04T08:53:33.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%/var/log/ceph/ceph-client.admin.44963.log: -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54807.log 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57021.log 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54807.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56075.log 2024-03-04T08:53:33.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57021.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54807.log.gz 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59710.log 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57021.log.gz 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59710.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56075.log.gz 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59710.log.gz 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-03-04T08:53:33.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61085.log 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50892.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5%/var/log/ceph/ceph-client.admin.61085.log: -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61085.log.gz 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44293.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2024-03-04T08:53:33.672 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56584.log 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz/var/log/ceph/ceph-client.admin.56584.log: 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44630.log 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56584.log.gz 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2024-03-04T08:53:33.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45750.log 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50184.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44630.log.gz 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51157.log 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45750.log.gz 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44070.log 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51157.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-03-04T08:53:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3%/var/log/ceph/ceph-client.admin.44070.log: -- replaced with /var/log/ceph/ceph-client.admin.51157.log.gz 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56626.log 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44070.log.gz 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54089.log 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56626.log.gz 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-03-04T08:53:33.675 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48312.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54089.log.gz 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2024-03-04T08:53:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49124.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60791.log 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48671.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-03-04T08:53:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61743.log 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60791.log.gz 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53843.log 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52249.log 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61743.log.gz 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53843.log.gz 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56033.log 2024-03-04T08:53:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61211.log 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52249.log.gz 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56033.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56033.log.gz 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56979.log 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59988.log 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61211.log.gz 2024-03-04T08:53:33.679 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49470.log 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56979.log.gz 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43800.log 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54723.log 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59988.log.gz 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49470.log.gz 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47613.log 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43800.log.gz 2024-03-04T08:53:33.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54865.log 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57789.log 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54723.log.gz 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47403.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57789.log.gz 2024-03-04T08:53:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59794.log 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59121.log 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55822.log 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59794.log.gz 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46299.log 2024-03-04T08:53:33.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59121.log.gz 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.46299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54639.log 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55822.log.gz 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59199.log 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54639.log: 90.0% -- replaced with /var/log/ceph/ceph-client.0.46299.log.gz 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52906.log 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54639.log.gz 2024-03-04T08:53:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52906.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59199.log.gz 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57514.log 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52906.log.gz 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50058.log 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.57514.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55153.log 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58811.log 2024-03-04T08:53:33.684 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50058.log.gz 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55678.log 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55153.log.gz 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58811.log: /var/log/ceph/ceph-client.admin.55678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52596.log 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58811.log.gz 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45666.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.57514.log.gz 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55678.log.gz 2024-03-04T08:53:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60240.log 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gz 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43334.log 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52596.log.gz 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43334.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.60240.log.gz 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56670.log 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43334.log.gz 2024-03-04T08:53:33.686 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50394.log 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58769.log 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56670.log.gz 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50394.log: -- /var/log/ceph/ceph-client.admin.57747.log 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58769.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50394.log.gz -- 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.51062.log 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58769.log.gz 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55636.log 2024-03-04T08:53:33.687 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57747.log.gz 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55907.log 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51062.log.gz 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55636.log.gz 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50100.log 2024-03-04T08:53:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47739.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.45246.log -- replaced with /var/log/ceph/ceph-client.admin.55907.log.gz 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50100.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53885.log 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50100.log.gz 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45246.log.gz 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53533.log 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53885.log.gz 2024-03-04T08:53:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49932.log 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49932.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53533.log.gzgzip 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57689.log 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48270.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49932.log.gz 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57689.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T08:53:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57689.log.gz 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47235.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-03-04T08:53:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48396.log 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49890.log: /var/log/ceph/ceph-client.admin.52990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57063.log 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48396.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48396.log.gz -- 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.60198.log 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57063.log: /var/log/ceph/ceph-client.admin.44964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2024-03-04T08:53:33.692 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57063.log.gz 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60198.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59037.log 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60198.log.gz 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56849.log 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51287.log 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59037.log.gz 2024-03-04T08:53:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52335.log 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51287.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56849.log.gz 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61337.log 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51287.log.gz 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0%/var/log/ceph/ceph-client.admin.61337.log: -- replaced with /var/log/ceph/ceph-client.admin.52335.log.gz 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45456.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61337.log.gz 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52948.log 2024-03-04T08:53:33.694 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52948.log.gz 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50016.log 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49224.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43420.log 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2024-03-04T08:53:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50016.log.gz 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47907.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43420.log.gz 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52554.log 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51241.log 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52554.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2024-03-04T08:53:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58853.log 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52554.log.gz 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51241.log.gz 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45582.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58853.log.gz 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60156.log 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2024-03-04T08:53:33.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45540.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60156.log.gz 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61589.log 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52293.log 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-03-04T08:53:33.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61589.log.gz 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61295.log 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52293.log.gz 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58496.log 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45372.log 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61295.log.gz 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.58496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2024-03-04T08:53:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53575.log 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45372.log: /var/log/ceph/ceph-client.admin.45708.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45372.log.gz 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.58496.log.gz 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53575.log: /var/log/ceph/ceph-client.admin.52454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54390.log 2024-03-04T08:53:33.700 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53575.log.gz 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60366.log 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.54390.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43083.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60366.log.gz 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-03-04T08:53:33.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48170.log: /var/log/ceph/ceph-client.admin.44289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60282.log 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47361.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54390.log.gz 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz -- 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.51329.log 2024-03-04T08:53:33.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60282.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59836.log 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60282.log.gz 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50516.log 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57105.log 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50516.log: /var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58099.log 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50516.log.gz 2024-03-04T08:53:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57105.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57105.log.gz 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58099.log: /var/log/ceph/ceph-client.admin.55510.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58099.log.gz 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48714.log: /var/log/ceph/ceph-client.admin.53927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44028.log 2024-03-04T08:53:33.704 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49764.log 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55384.log 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44028.log: /var/log/ceph/ceph-client.admin.49764.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57255.log 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49764.log.gz 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2024-03-04T08:53:33.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55384.log: /var/log/ceph/ceph-client.admin.57255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60959.log 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55384.log.gz 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50436.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57255.log.gz 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50976.log 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56895.log 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44625.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60959.log.gz 2024-03-04T08:53:33.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50976.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz --verbose 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.0.52092.log 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50976.log.gz 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56765.log 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56895.log: /var/log/ceph/ceph-client.0.52092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37972.log 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56895.log.gz 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61785.log 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56765.log.gz 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2024-03-04T08:53:33.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61785.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37972.log.gz 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61785.log.gz 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50352.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-03-04T08:53:33.708 INFO:teuthology.orchestra.run.smithi019.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.52092.log.gz 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45204.log 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59631.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58057.log 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59752.log 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45204.log.gz 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51106.log 2024-03-04T08:53:33.709 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58057.log.gz 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53068.log 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59752.log: /var/log/ceph/ceph-client.admin.51106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59752.log.gz 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53068.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51106.log.gz 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55468.log 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57189.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53068.log.gz 2024-03-04T08:53:33.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54991.log 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55468.log.gz 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51833.log 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54991.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54991.log.gz 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51833.log.gz 2024-03-04T08:53:33.711 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51413.log: /var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57973.log 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52680.log 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38225.log: /var/log/ceph/ceph-client.admin.57973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48998.log 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-03-04T08:53:33.712 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57973.log.gz 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48517.log 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52680.log.gz 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48998.log.gz 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61703.log 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48517.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44112.log 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48517.log.gz 2024-03-04T08:53:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56457.log 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50808.log 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44112.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61703.log.gz 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60833.log 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44112.log.gz 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56457.log.gz 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51539.log 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50808.log.gz 2024-03-04T08:53:33.714 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60833.log.gz 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60875.log 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45894.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50142.log 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60875.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54949.log 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50142.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60875.log.gz /var/log/ceph/ceph-client.admin.50639.log 2024-03-04T08:53:33.715 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50142.log.gz 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50639.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.54949.log.gz 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56937.log 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2024-03-04T08:53:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43002.log 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60553.log 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43002.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56937.log.gz 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56159.log 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43002.log.gz 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56159.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60553.log.gz 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61253.log 2024-03-04T08:53:33.717 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9%/var/log/ceph/ceph-client.admin.49554.log: -- replaced with /var/log/ceph/ceph-client.admin.56159.log.gz 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56807.log 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61253.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56807.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61253.log.gz 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52822.log 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47277.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56807.log.gz 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61631.log 2024-03-04T08:53:33.718 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55300.log 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61631.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52822.log.gz 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61631.log.gz 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47067.log 2024-03-04T08:53:33.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55075.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55300.log.gz 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56201.log 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54131.log 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2024-03-04T08:53:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56201.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54131.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56201.log.gz 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44627.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54131.log.gz 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56499.log 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51581.log 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44294.log: /var/log/ceph/ceph-client.admin.56499.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-03-04T08:53:33.721 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56499.log.gz 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61379.log 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51581.log.gz 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58995.log 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.58995.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-03-04T08:53:33.722 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61379.log.gz 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51018.log 88.7% 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58995.log.gz 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50268.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60072.log 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60468.log 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60072.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51018.log.gz 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56714.log 2024-03-04T08:53:33.723 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60072.log.gz 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38344.log 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60468.log.gz 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59878.log 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56714.log.gz 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38344.log.gz 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59878.log: gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59878.log.gz 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.58015.log 2024-03-04T08:53:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55991.log 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58015.log: 93.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55991.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55991.log.gz 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gzgzip 2024-03-04T08:53:33.725 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50310.log: /var/log/ceph/ceph-client.admin.56376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45414.log 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50766.log 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60917.log 2024-03-04T08:53:33.726 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz/var/log/ceph/ceph-client.admin.45414.log: 2024-03-04T08:53:33.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58669.log 2024-03-04T08:53:33.727 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45414.log.gz/var/log/ceph/ceph-client.admin.60917.log: 2024-03-04T08:53:33.727 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50766.log.gz 2024-03-04T08:53:33.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2024-03-04T08:53:33.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60917.log.gz 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5%/var/log/ceph/ceph-client.admin.43590.log: -- replaced with /var/log/ceph/ceph-client.admin.58669.log.gz 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61043.log 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54681.log/var/log/ceph/ceph-client.admin.51683.log: 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60324.log 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz 2024-03-04T08:53:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61043.log.gz 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54681.log.gz 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61001.log 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43250.log: -- /var/log/ceph/ceph-client.admin.57873.log 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60324.log.gz 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58953.log 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57873.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61001.log.gz 2024-03-04T08:53:33.729 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60595.log 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57873.log.gz 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58953.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.60595.log: /var/log/ceph/ceph-client.0.59458.log 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60595.log.gz 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1%/var/log/ceph/ceph-client.0.59458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44624.log 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58953.log.gz 2024-03-04T08:53:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48924.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.44624.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44624.log.gz 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 90.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.59458.log.gz 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.58219.log 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48798.log: /var/log/ceph/ceph-client.admin.58219.log: gzip 88.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2024-03-04T08:53:33.731 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43758.log: gzip 89.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.58219.log.gz -- 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.55342.log 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48438.log 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48882.log: gzip/var/log/ceph/ceph-client.admin.55342.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56541.log 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%/var/log/ceph/ceph-client.admin.48438.log: -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55342.log.gz 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48438.log.gz 2024-03-04T08:53:33.732 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.43986.log 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44628.log 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56541.log.gz 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43986.log: /var/log/ceph/ceph-client.admin.44628.log: gzip 87.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.49308.log 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43125.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44628.log.gz 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-03-04T08:53:33.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55594.log 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49308.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43548.log: /var/log/ceph/ceph-client.admin.48128.log 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55594.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55594.log.gz 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.43506.log 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49512.log 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2024-03-04T08:53:33.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56296.log 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49512.log.gz 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53743.log 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz/var/log/ceph/ceph-client.admin.43674.log: 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56296.log.gz 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T08:53:33.735 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54011.log 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53743.log.gz 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31912.log 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8%/var/log/ceph/ceph.tmp-client.admin.31912.log: -- replaced with /var/log/ceph/ceph-client.admin.54011.log.gz 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31912.log.gz 85.4% 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T08:53:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.43926.log: -5 --verbose -- /var/log/ceph/ceph-client.0.53327.log 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.53327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47529.log 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59079.log 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47529.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47529.log.gz 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.53327.log.gz 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-04T08:53:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48212.log 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59079.log.gz/var/log/ceph/ceph-client.admin.50226.log: 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8%/var/log/ceph/ceph-client.admin.43632.log: -- replaced with /var/log/ceph/ceph-client.admin.48212.log.gz 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53801.log 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2024-03-04T08:53:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53801.log.gz 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48044.log 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7%/var/log/ceph/ceph-client.admin.51641.log: -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2024-03-04T08:53:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48044.log: /var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48840.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48044.log.gz 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57915.log 2024-03-04T08:53:33.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61421.log 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47571.log 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57915.log.gz/var/log/ceph/ceph-client.admin.61421.log: 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61421.log.gz 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47571.log: -- /var/log/ceph/ceph-client.admin.47697.log 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47319.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2024-03-04T08:53:33.741 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47571.log.gz 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55949.log 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47445.log: /var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55949.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.42906.log 2024-03-04T08:53:33.742 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55949.log.gz 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50724.log 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2%/var/log/ceph/ceph-client.admin.42906.log: -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55426.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61463.log 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50724.log.gz 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52722.log 2024-03-04T08:53:33.743 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55426.log.gz/var/log/ceph/ceph-client.admin.61463.log: 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55033.log 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61463.log.gz 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60511.log 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52722.log: /var/log/ceph/ceph-client.admin.55033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60511.log: 88.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52722.log.gz 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55033.log.gz 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60511.log.gz 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55865.log 2024-03-04T08:53:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49680.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55865.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60114.log 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55865.log.gz 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54765.log 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.60114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60114.log.gz 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-03-04T08:53:33.745 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54765.log.gz 2024-03-04T08:53:33.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49040.log 2024-03-04T08:53:33.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-03-04T08:53:33.746 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-03-04T08:53:33.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49040.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49040.log.gz 2024-03-04T08:53:33.747 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-04T08:53:33.747 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-04T08:53:33.748 INFO:teuthology.orchestra.run.smithi204.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-04T08:53:33.748 INFO:teuthology.orchestra.run.smithi204.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-04T08:53:33.748 INFO:teuthology.orchestra.run.smithi204.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m0.210s 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m1.047s 2024-03-04T08:53:33.749 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m0.059s 2024-03-04T08:53:33.750 INFO:teuthology.orchestra.run.smithi019.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-04T08:53:33.762 INFO:teuthology.orchestra.run.smithi019.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-04T08:53:33.788 INFO:teuthology.orchestra.run.smithi019.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-04T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-04T08:53:33.808 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-04T08:53:33.808 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m0.313s 2024-03-04T08:53:33.808 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m1.186s 2024-03-04T08:53:33.808 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.249s 2024-03-04T08:53:33.809 INFO:tasks.ceph:Archiving logs... 2024-03-04T08:53:33.809 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi019/log 2024-03-04T08:53:33.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T08:53:34.284 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi204/log 2024-03-04T08:53:34.285 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T08:53:34.475 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T08:53:34.499 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T08:53:34.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T08:53:34.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T08:53:34.583 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T08:53:34.592 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T08:53:34.592 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:53:34.595 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T08:53:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:53:34.610 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +684us[ +689us] +/- 102ms 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1005us[-1001us] +/- 57ms 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +880us[ +880us] +/- 80ms 2024-03-04T08:53:34.612 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:53:34.613 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T08:53:34.614 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-03-04T08:53:34.614 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +680us[ +691us] +/- 102ms 2024-03-04T08:53:34.614 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -998us[ -987us] +/- 57ms 2024-03-04T08:53:34.615 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +885us[ +885us] +/- 80ms 2024-03-04T08:53:34.615 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T08:53:34.616 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T08:53:34.626 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T08:53:34.627 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T08:53:34.660 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T08:53:34.739 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T08:53:34.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:53:34.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:34.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:53:34.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:34.869 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T08:53:34.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T08:53:34.901 INFO:teuthology.task.internal:Duration was 687.070966 seconds 2024-03-04T08:53:34.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T08:53:34.936 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T08:53:34.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T08:53:34.938 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T08:53:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:53:34.982 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:53:35.283 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T08:53:35.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-03-04T08:53:35.284 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T08:53:35.343 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-03-04T08:53:35.343 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T08:53:35.363 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T08:53:35.364 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T08:53:35.385 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T08:53:35.433 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T08:53:35.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T08:53:35.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T08:53:35.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T08:53:35.582 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T08:53:35.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T08:53:35.609 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T08:53:35.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T08:53:35.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T08:53:35.652 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T08:53:35.675 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-03-04T08:53:35.703 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-03-04T08:53:35.720 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T08:53:35.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:35.744 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T08:53:35.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:35.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T08:53:35.785 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T08:53:35.786 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi019 2024-03-04T08:53:35.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T08:53:35.823 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807/remote/smithi204 2024-03-04T08:53:35.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T08:53:35.859 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T08:53:35.859 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T08:53:35.862 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T08:53:35.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T08:53:35.920 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T08:53:35.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T08:53:35.944 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T08:53:35.945 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T08:53:35.947 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T08:53:35.958 INFO:teuthology.orchestra.run.smithi019.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 08:53 /home/ubuntu/cephtest 2024-03-04T08:53:35.963 INFO:teuthology.orchestra.run.smithi204.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 08:53 /home/ubuntu/cephtest 2024-03-04T08:53:35.964 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T08:53:35.977 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T08:53:36.044 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T08:53:36.074 DEBUG:teuthology.nuke:shortname: smithi019 2024-03-04T08:53:36.075 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T08:53:36.099 DEBUG:teuthology.nuke:shortname: smithi204 2024-03-04T08:53:36.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T08:53:36.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:32:58.887987', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9kqw+BqHyBfGE5GCu2rKbuEMZ1KM54owRrtfc5JSlQM9QddMpIXoWd/C3QeoRQaGDSKHW5GAlSdQ/yvKuVnSs='} 2024-03-04T08:53:36.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:32:58.889885', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUmglADe64NXOnrbc/6ULgz/f9+cAf/t3i3c7DUc0onDNLvv5/djyvNx+j/UOisJmmVoK+oplvQR6lhLZOYvPE='} 2024-03-04T08:53:36.155 INFO:teuthology.orchestra.console.smithi019:Power off 2024-03-04T08:53:36.156 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T08:53:36.176 INFO:teuthology.orchestra.console.smithi204:Power off 2024-03-04T08:53:36.177 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T08:53:36.193 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-03-04T08:53:36.193 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:36.209 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-03-04T08:53:36.210 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:36.226 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-04T08:53:36.241 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-04T08:53:40.227 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:40.242 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:40.338 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-04T08:53:40.354 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-04T08:53:44.340 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:44.354 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:44.451 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-04T08:53:44.466 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-04T08:53:48.456 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:48.466 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T08:53:48.567 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-04T08:53:48.577 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-03-04T08:53:48.668 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-03-04T08:53:48.678 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-03-04T08:53:48.783 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} duration: 687.0709657669067 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ce70ed6ec2394a4cacd033b1b165859e status: fail success: false 2024-03-04T08:53:48.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T08:53:48.865 INFO:teuthology.run:FAIL